2024-09-11T06:06:36.020 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T06:06:36.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T06:06:36.114 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900606' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: daaf78de334647fc0c800f4ac495cc9475a26bae owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6175 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 88/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: daaf78de334647fc0c800f4ac495cc9475a26bae targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd4wuqu7CzzUC8iKKxigkLN5/7FYEqHY54LOLmynvPftK/LCS1zJc/Y2O9e3A0XuUnGtDlWjaSFnaff98dbtjg= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPlPHEyrit2lapPG+c6YK2MN7J4GKd2EGBE8nNmi/DYmIgtkYvFnotH0aLFUzejtYM6OiPnx7Ton4QkERMwwIBc= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 deep_copy: true ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_21:16:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T06:06:36.114 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa; will attempt to use it 2024-09-11T06:06:36.115 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa/tasks 2024-09-11T06:06:36.115 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T06:06:36.117 INFO:teuthology.task.internal:Checking packages... 2024-09-11T06:06:36.137 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T06:06:36.138 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T06:06:36.138 INFO:teuthology.packaging:ref: None 2024-09-11T06:06:36.138 INFO:teuthology.packaging:tag: None 2024-09-11T06:06:36.138 INFO:teuthology.packaging:branch: squid 2024-09-11T06:06:36.138 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T06:06:36.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T06:06:36.364 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-308.gdaaf78de 2024-09-11T06:06:36.366 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T06:06:36.372 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T06:06:36.372 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T06:06:36.383 INFO:teuthology.task.internal:Saving configuration 2024-09-11T06:06:36.398 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T06:06:36.405 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T06:06:36.429 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 05:59:40.425021', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd4wuqu7CzzUC8iKKxigkLN5/7FYEqHY54LOLmynvPftK/LCS1zJc/Y2O9e3A0XuUnGtDlWjaSFnaff98dbtjg='} 2024-09-11T06:06:36.453 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 05:59:40.427063', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPlPHEyrit2lapPG+c6YK2MN7J4GKd2EGBE8nNmi/DYmIgtkYvFnotH0aLFUzejtYM6OiPnx7Ton4QkERMwwIBc='} 2024-09-11T06:06:36.453 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T06:06:36.460 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T06:06:36.460 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T06:06:36.460 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T06:06:36.521 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f88b82bb370>, signals=[15]) 2024-09-11T06:06:36.521 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T06:06:36.528 INFO:teuthology.task.internal:Opening connections... 2024-09-11T06:06:36.528 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:06:36.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:06:36.613 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:06:36.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:06:36.690 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T06:06:36.696 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-11T06:06:36.715 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-11T06:06:36.715 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-11T06:06:36.773 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-09-11T06:06:36.773 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-09-11T06:06:36.773 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-09-11T06:06:36.773 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T06:06:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T06:06:36.775 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-11T06:06:36.801 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-11T06:06:36.820 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-11T06:06:36.821 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-11T06:06:36.878 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-09-11T06:06:36.878 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-09-11T06:06:36.878 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T06:06:36.879 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T06:06:36.880 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-11T06:06:36.908 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T06:06:36.917 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T06:06:36.923 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T06:06:36.923 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-11T06:06:36.926 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-11T06:06:36.943 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T06:06:36.949 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T06:06:36.949 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-11T06:06:36.985 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-11T06:06:37.076 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T06:06:37.128 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T06:06:37.143 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T06:06:37.143 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T06:06:37.143 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T06:06:37.144 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T06:06:37.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:06:37.161 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-11T06:06:37.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:06:37.162 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-11T06:06:37.219 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-503.el9.x86_64 2024-09-11T06:06:37.219 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.14.0-503.el9.x86_64 2024-09-11T06:06:37.220 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2024-09-11T06:06:37.221 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-503.el9.x86_64 2024-09-11T06:06:37.221 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.14.0-503.el9.x86_64 2024-09-11T06:06:37.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2024-09-11T06:06:39.599 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T06:06:39.728 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.2 MB 00:00 2024-09-11T06:06:43.046 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-11T06:06:47.413 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-11T06:06:47.682 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 20 MB 00:06 2024-09-11T06:06:48.897 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-11T06:06:49.817 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T06:06:51.957 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-11T06:06:55.024 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 19 kB 00:01 2024-09-11T06:06:55.315 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-11T06:06:55.795 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-11T06:06:57.329 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T06:06:57.330 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T06:06:57.426 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:06:57.434 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:06:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-09-11T06:06:57.434 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:06:57.434 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:06:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T06:06:57.434 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:06:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout:Install 4 Packages 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 79 M 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 126 M 2024-09-11T06:06:57.435 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:06:57.800 INFO:teuthology.orchestra.run.smithi194.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 205 kB/s | 23 kB 00:00 2024-09-11T06:06:58.050 INFO:teuthology.orchestra.run.smithi194.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-09-11T06:06:58.501 INFO:teuthology.orchestra.run.smithi194.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 43 MB/s | 35 MB 00:00 2024-09-11T06:06:58.884 INFO:teuthology.orchestra.run.smithi194.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-11T06:06:58.884 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:06:58.884 INFO:teuthology.orchestra.run.smithi194.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-11T06:06:59.566 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:06:59.910 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:06:59.911 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:07:00.843 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:07:00.843 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:07:01.258 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-11T06:07:03.231 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T06:07:03.231 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T06:07:03.301 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:07:03.330 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:07:03.346 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:07:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-11T06:07:03.346 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:07:03.346 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:07:03.346 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T06:07:03.346 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:07:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T06:07:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T06:07:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T06:07:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:07:03.347 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:07:03.347 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:07:03.347 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-09-11T06:07:03.347 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:07:03.348 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 79 M 2024-09-11T06:07:03.348 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 126 M 2024-09-11T06:07:03.348 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:07:03.460 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 247 kB/s | 23 kB 00:00 2024-09-11T06:07:03.844 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-11T06:07:03.945 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T06:07:04.052 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T06:07:04.227 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-11T06:07:04.561 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-11T06:07:04.561 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:07:04.561 INFO:teuthology.orchestra.run.smithi070.stdout:Total 65 MB/s | 79 MB 00:01 2024-09-11T06:07:05.245 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:07:05.591 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:07:05.591 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:07:06.537 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:07:06.537 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:07:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T06:07:07.003 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T06:07:08.976 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:07:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T06:07:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T06:07:11.826 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T06:07:11.945 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:07:12.583 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T06:07:12.739 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T06:07:16.804 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:07:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T06:07:17.914 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:07:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:07:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:07:55.097 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:07:55.480 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:07:55.480 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T06:07:55.480 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T06:07:55.480 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:07:56.284 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:07:56.634 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T06:07:56.713 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T06:07:56.713 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T06:07:56.714 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T06:07:56.714 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T06:07:56.714 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T06:07:56.714 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T06:07:56.714 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T06:07:56.714 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T06:07:56.773 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T06:07:56.773 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T06:07:56.774 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 82.el9 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8274670 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T06:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:07:56.814 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T06:07:56.815 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T06:07:56.815 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 5.14.0-505.el9.x86_64 2024-09-11T06:07:56.815 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T06:07:57.454 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-09-11T06:07:58.699 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T06:07:58.735 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-09-11T06:07:58.737 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-11T06:07:58.772 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.X2wNy2vkgT 2024-09-11T06:07:58.772 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.X2wNy2vkgT 2024-09-11T06:07:58.856 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.X2wNy2vkgT 2024-09-11T06:07:58.997 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.X2wNy2vkgT is 6KB 2024-09-11T06:07:59.044 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.X2wNy2vkgT 2024-09-11T06:07:59.059 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T06:07:59.122 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T06:07:59.122 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T06:07:59.122 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T06:07:59.122 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T06:07:59.123 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T06:07:59.301 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-09-11T06:08:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:08:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:08:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:08:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T06:08:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T06:08:00.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T06:08:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T06:08:01.788 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:08:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:08:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T06:08:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T06:08:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T06:08:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T06:08:01.789 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:08:01.789 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:08:02.127 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T06:08:02.231 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T06:08:02.231 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T06:08:02.231 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T06:08:02.231 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T06:08:02.231 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T06:08:02.231 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T06:08:02.231 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T06:08:02.232 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T06:08:02.291 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T06:08:02.291 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T06:08:02.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -qi grub2-tools 2024-09-11T06:08:02.328 INFO:teuthology.orchestra.run.smithi070.stdout:Name : grub2-tools 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Epoch : 1 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Version : 2.06 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Release : 82.el9 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: x86_64 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Group : Unspecified 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Size : 8274670 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:License : GPLv3+ 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T06:08:02.329 INFO:teuthology.orchestra.run.smithi070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:Packager : builder@centos.org 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:Vendor : CentOS 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:Summary : Support tools for GRUB. 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:Description : 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:hardware devices. 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:08:02.330 INFO:teuthology.orchestra.run.smithi070.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T06:08:02.331 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T06:08:02.331 INFO:teuthology.task.kernel:Updating grub on smithi070 to boot 5.14.0-505.el9.x86_64 2024-09-11T06:08:02.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T06:08:02.981 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-11T06:08:04.275 INFO:teuthology.orchestra.run.smithi070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T06:08:04.303 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-11T06:08:04.305 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-11T06:08:04.321 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.1mbYIUnpMV 2024-09-11T06:08:04.321 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1mbYIUnpMV 2024-09-11T06:08:04.391 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.1mbYIUnpMV 2024-09-11T06:08:04.535 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.1mbYIUnpMV is 6KB 2024-09-11T06:08:04.584 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.1mbYIUnpMV 2024-09-11T06:08:04.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T06:08:04.662 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T06:08:04.663 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T06:08:04.663 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T06:08:04.663 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T06:08:04.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T06:08:04.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-11T06:08:29.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T06:08:29.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-11T06:08:29.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:08:34.834 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T06:08:34.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T06:08:34.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:09:29.382 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T06:09:34.842 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T06:09:38.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-11T06:09:38.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:09:39.662 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-11T06:09:40.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-11T06:09:40.251 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T06:09:40.252 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-11T06:09:40.268 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-505.el9.x86_64 2024-09-11T06:09:40.268 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T06:09:40.268 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T06:09:40.268 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T06:09:41.269 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T06:09:41.269 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T06:09:41.421 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-09-11T06:09:41.439 DEBUG:teuthology.parallel:result is None 2024-09-11T06:09:43.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T06:09:43.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:09:44.262 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-11T06:09:44.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T06:09:44.810 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T06:09:44.810 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-11T06:09:44.825 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-505.el9.x86_64 2024-09-11T06:09:44.825 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T06:09:44.825 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T06:09:44.825 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T06:09:45.825 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T06:09:45.826 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T06:09:45.897 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-11T06:09:45.917 DEBUG:teuthology.parallel:result is None 2024-09-11T06:09:45.918 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T06:09:45.925 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T06:09:45.926 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T06:09:45.928 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T06:09:45.943 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T06:09:45.949 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T06:09:45.955 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T06:09:45.956 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T06:09:45.983 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T06:09:46.006 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T06:09:46.012 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T06:09:46.012 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T06:09:46.044 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T06:09:46.071 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T06:09:46.079 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T06:09:46.081 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T06:09:46.089 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T06:09:46.091 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T06:09:46.098 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T06:09:46.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T06:09:46.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T06:09:46.157 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T06:09:46.166 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T06:09:46.167 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T06:09:46.198 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T06:09:46.212 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T06:09:46.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T06:09:46.341 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T06:09:46.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T06:09:46.462 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:09:46.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T06:09:46.527 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T06:09:46.564 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T06:09:46.617 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T06:09:46.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T06:09:46.738 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:09:46.738 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T06:09:46.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-11T06:09:46.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-11T06:09:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T06:09:46.895 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T06:09:47.291 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T06:09:47.298 INFO:teuthology.task.internal:Starting timer... 2024-09-11T06:09:47.298 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T06:09:47.308 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T06:09:47.317 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-11T06:09:47.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-09-11T06:09:47.391 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-09-11T06:09:47.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-09-11T06:09:47.523 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-09-11T06:09:47.528 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T06:09:47.528 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-09-11T06:09:47.552 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-09-11T06:09:47.552 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-09-11T06:09:47.613 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-09-11T06:09:47.613 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-09-11T06:09:47.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T06:09:47.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:09:47.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T06:09:47.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:09:47.707 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T06:09:47.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-09-11T06:09:47.739 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-09-11T06:09:47.924 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T06:09:47.932 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T06:09:47.944 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T06:09:47.945 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T06:13:35.173 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-11T06:13:35.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T06:13:35.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:13:35.254 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-11T06:13:35.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-11T06:13:35.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-11T06:13:35.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:13:35.411 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-11T06:13:35.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-11T06:13:35.446 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T06:13:35.457 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T06:13:35.457 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T06:13:35.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T06:13:35.460 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T06:13:35.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T06:13:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T06:13:35.501 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T06:13:35.517 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T06:13:35.525 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-09-11T06:13:35.531 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T06:13:35.536 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-09-11T06:13:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T06:13:35.556 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-09-11T06:13:35.564 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T06:13:35.567 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-09-11T06:13:35.581 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T06:13:35.595 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T06:13:35.615 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-11T06:13:35.618 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T06:13:35.618 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-11T06:13:35.619 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:13:35.619 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:13:35.619 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:13:35.619 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:13:35.658 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-11T06:13:35.661 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T06:13:35.661 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-11T06:13:35.661 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:13:35.661 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:13:35.661 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:13:35.661 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:13:35.662 INFO:teuthology.run_tasks:Running task install... 2024-09-11T06:13:35.672 DEBUG:teuthology.task.install:project ceph 2024-09-11T06:13:35.672 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T06:13:35.672 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T06:13:35.673 INFO:teuthology.task.install:Using flavor: default 2024-09-11T06:13:35.678 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T06:13:35.678 INFO:teuthology.task.install:extra packages: [] 2024-09-11T06:13:35.679 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T06:13:35.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T06:13:35.682 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T06:13:35.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T06:13:35.822 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T06:13:35.822 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T06:13:35.826 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T06:13:35.826 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T06:13:35.935 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T06:13:35.935 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:13:35.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T06:13:35.938 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T06:13:35.938 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:13:35.938 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T06:13:35.962 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T06:13:35.962 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T06:13:35.964 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T06:13:35.965 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T06:13:36.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T06:13:36.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T06:13:36.103 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T06:13:36.105 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T06:13:36.167 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-09-11T06:13:36.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-09-11T06:13:36.169 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-09-11T06:13:36.171 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-09-11T06:13:36.395 INFO:teuthology.orchestra.run.smithi194.stdout:45 files removed 2024-09-11T06:13:36.396 INFO:teuthology.orchestra.run.smithi070.stdout:45 files removed 2024-09-11T06:13:36.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw 2024-09-11T06:13:36.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw 2024-09-11T06:13:36.984 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-11T06:13:37.003 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 283 kB/s | 84 kB 00:00 2024-09-11T06:13:37.277 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-11T06:13:37.287 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T06:13:37.552 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T06:13:37.571 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-11T06:13:38.144 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-11T06:13:42.088 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.2 MB 00:04 2024-09-11T06:13:43.652 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-11T06:13:47.936 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-11T06:13:48.546 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 20 MB 00:05 2024-09-11T06:13:49.320 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 116 kB/s | 19 kB 00:00 2024-09-11T06:13:50.083 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-11T06:13:54.422 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-11T06:13:55.530 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T06:13:56.231 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-11T06:13:57.160 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T06:13:57.921 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:13:57.925 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:13:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:13:57.925 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:13:57.925 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:13:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T06:13:57.925 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-09-11T06:13:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T06:13:57.925 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T06:13:57.926 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T06:13:57.927 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout:Install 30 Packages 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 2 Packages 2024-09-11T06:13:57.928 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:13:57.929 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 60 M 2024-09-11T06:13:57.929 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:13:58.664 INFO:teuthology.orchestra.run.smithi070.stdout:(1/32): ceph-base-19.1.1-298.gb53b6d3e.el9.x86_ 9.7 MB/s | 5.4 MB 00:00 2024-09-11T06:13:58.714 INFO:teuthology.orchestra.run.smithi070.stdout:(2/32): ceph-selinux-19.1.1-298.gb53b6d3e.el9.x 506 kB/s | 25 kB 00:00 2024-09-11T06:13:58.815 INFO:teuthology.orchestra.run.smithi070.stdout:(3/32): libcephfs2-19.1.1-298.gb53b6d3e.el9.x86 7.4 MB/s | 752 kB 00:00 2024-09-11T06:13:58.906 INFO:teuthology.orchestra.run.smithi070.stdout:(4/32): libradosstriper1-19.1.1-298.gb53b6d3e.e 5.4 MB/s | 506 kB 00:00 2024-09-11T06:13:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:(5/32): ceph-radosgw-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 11 MB 00:00 2024-09-11T06:13:59.249 INFO:teuthology.orchestra.run.smithi070.stdout:(6/32): ceph-common-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 21 MB 00:01 2024-09-11T06:13:59.265 INFO:teuthology.orchestra.run.smithi070.stdout:(7/32): python3-ceph-argparse-19.1.1-298.gb53b6 216 kB/s | 45 kB 00:00 2024-09-11T06:13:59.299 INFO:teuthology.orchestra.run.smithi070.stdout:(8/32): python3-ceph-common-19.1.1-298.gb53b6d3 2.7 MB/s | 136 kB 00:00 2024-09-11T06:13:59.324 INFO:teuthology.orchestra.run.smithi070.stdout:(9/32): python3-cephfs-19.1.1-298.gb53b6d3e.el9 2.7 MB/s | 162 kB 00:00 2024-09-11T06:13:59.349 INFO:teuthology.orchestra.run.smithi070.stdout:(10/32): python3-rados-19.1.1-298.gb53b6d3e.el9 6.3 MB/s | 321 kB 00:00 2024-09-11T06:13:59.375 INFO:teuthology.orchestra.run.smithi070.stdout:(11/32): python3-rbd-19.1.1-298.gb53b6d3e.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-11T06:13:59.400 INFO:teuthology.orchestra.run.smithi070.stdout:(12/32): python3-rgw-19.1.1-298.gb53b6d3e.el9.x 1.9 MB/s | 100 kB 00:00 2024-09-11T06:13:59.484 INFO:teuthology.orchestra.run.smithi070.stdout:(13/32): librgw2-19.1.1-298.gb53b6d3e.el9.x86_6 9.3 MB/s | 5.3 MB 00:00 2024-09-11T06:13:59.584 INFO:teuthology.orchestra.run.smithi070.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-09-11T06:13:59.618 INFO:teuthology.orchestra.run.smithi070.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 441 kB/s | 107 kB 00:00 2024-09-11T06:13:59.643 INFO:teuthology.orchestra.run.smithi070.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 661 kB/s | 160 kB 00:00 2024-09-11T06:13:59.685 INFO:teuthology.orchestra.run.smithi070.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-11T06:13:59.735 INFO:teuthology.orchestra.run.smithi070.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-11T06:13:59.769 INFO:teuthology.orchestra.run.smithi070.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-11T06:13:59.796 INFO:teuthology.orchestra.run.smithi070.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 591 kB/s | 36 kB 00:00 2024-09-11T06:13:59.821 INFO:teuthology.orchestra.run.smithi070.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 907 kB/s | 47 kB 00:00 2024-09-11T06:13:59.847 INFO:teuthology.orchestra.run.smithi070.stdout:(22/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-09-11T06:13:59.906 INFO:teuthology.orchestra.run.smithi070.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-11T06:13:59.931 INFO:teuthology.orchestra.run.smithi070.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T06:13:59.956 INFO:teuthology.orchestra.run.smithi070.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 276 kB/s | 26 kB 00:00 2024-09-11T06:13:59.981 INFO:teuthology.orchestra.run.smithi070.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T06:14:00.015 INFO:teuthology.orchestra.run.smithi070.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T06:14:00.065 INFO:teuthology.orchestra.run.smithi070.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-11T06:14:00.115 INFO:teuthology.orchestra.run.smithi070.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T06:14:00.191 INFO:teuthology.orchestra.run.smithi070.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T06:14:00.299 INFO:teuthology.orchestra.run.smithi070.stdout:(31/32): librados2-19.1.1-298.gb53b6d3e.el9.x86 15 MB/s | 3.4 MB 00:00 2024-09-11T06:14:00.383 INFO:teuthology.orchestra.run.smithi070.stdout:(32/32): librbd1-19.1.1-298.gb53b6d3e.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-11T06:14:00.388 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:00.388 INFO:teuthology.orchestra.run.smithi070.stdout:Total 25 MB/s | 60 MB 00:02 2024-09-11T06:14:00.492 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:14:00.528 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:14:00.528 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:14:01.289 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:14:01.289 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:14:02.499 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T06:14:02.791 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:14:02.881 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-11T06:14:02.913 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-11T06:14:02.946 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-11T06:14:02.969 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T06:14:02.990 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T06:14:03.188 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T06:14:03.240 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T06:14:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-11T06:14:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T06:14:03.808 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T06:14:03.897 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/34 2024-09-11T06:14:03.925 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T06:14:03.988 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T06:14:04.025 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-11T06:14:04.069 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 11/34 2024-09-11T06:14:04.139 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T06:14:04.160 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T06:14:04.225 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T06:14:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-11T06:14:04.370 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-11T06:14:04.402 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-11T06:14:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-11T06:14:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-11T06:14:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-11T06:14:04.545 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-11T06:14:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-11T06:14:04.867 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:14:04.879 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:04.879 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:14:04.879 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:04.879 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T06:14:04.880 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T06:14:04.881 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:14:04.882 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:04.883 INFO:teuthology.orchestra.run.smithi194.stdout:Install 30 Packages 2024-09-11T06:14:04.883 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 2 Packages 2024-09-11T06:14:04.883 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:04.883 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 60 M 2024-09-11T06:14:04.883 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:14:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T06:14:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T06:14:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/34 2024-09-11T06:14:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-11T06:14:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-11T06:14:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T06:14:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T06:14:05.718 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/34 2024-09-11T06:14:05.747 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 28/34 2024-09-11T06:14:05.909 INFO:teuthology.orchestra.run.smithi194.stdout:(1/32): ceph-base-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 5.4 MB 00:00 2024-09-11T06:14:05.959 INFO:teuthology.orchestra.run.smithi194.stdout:(2/32): ceph-selinux-19.1.1-298.gb53b6d3e.el9.x 506 kB/s | 25 kB 00:00 2024-09-11T06:14:06.067 INFO:teuthology.orchestra.run.smithi194.stdout:(3/32): libcephfs2-19.1.1-298.gb53b6d3e.el9.x86 6.8 MB/s | 752 kB 00:00 2024-09-11T06:14:06.159 INFO:teuthology.orchestra.run.smithi194.stdout:(4/32): libradosstriper1-19.1.1-298.gb53b6d3e.e 5.4 MB/s | 506 kB 00:00 2024-09-11T06:14:06.309 INFO:teuthology.orchestra.run.smithi194.stdout:(5/32): ceph-radosgw-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 11 MB 00:00 2024-09-11T06:14:06.359 INFO:teuthology.orchestra.run.smithi194.stdout:(6/32): python3-ceph-argparse-19.1.1-298.gb53b6 907 kB/s | 45 kB 00:00 2024-09-11T06:14:06.451 INFO:teuthology.orchestra.run.smithi194.stdout:(7/32): librgw2-19.1.1-298.gb53b6d3e.el9.x86_64 18 MB/s | 5.3 MB 00:00 2024-09-11T06:14:06.477 INFO:teuthology.orchestra.run.smithi194.stdout:(8/32): python3-ceph-common-19.1.1-298.gb53b6d3 1.1 MB/s | 136 kB 00:00 2024-09-11T06:14:06.510 INFO:teuthology.orchestra.run.smithi194.stdout:(9/32): python3-cephfs-19.1.1-298.gb53b6d3e.el9 2.7 MB/s | 162 kB 00:00 2024-09-11T06:14:06.536 INFO:teuthology.orchestra.run.smithi194.stdout:(10/32): python3-rados-19.1.1-298.gb53b6d3e.el9 5.4 MB/s | 321 kB 00:00 2024-09-11T06:14:06.561 INFO:teuthology.orchestra.run.smithi194.stdout:(11/32): python3-rbd-19.1.1-298.gb53b6d3e.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-11T06:14:06.586 INFO:teuthology.orchestra.run.smithi194.stdout:(12/32): python3-rgw-19.1.1-298.gb53b6d3e.el9.x 1.9 MB/s | 100 kB 00:00 2024-09-11T06:14:06.786 INFO:teuthology.orchestra.run.smithi194.stdout:(13/32): ceph-common-19.1.1-298.gb53b6d3e.el9.x 16 MB/s | 21 MB 00:01 2024-09-11T06:14:06.837 INFO:teuthology.orchestra.run.smithi194.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 388 kB/s | 107 kB 00:00 2024-09-11T06:14:06.895 INFO:teuthology.orchestra.run.smithi194.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-11T06:14:06.921 INFO:teuthology.orchestra.run.smithi194.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 479 kB/s | 160 kB 00:00 2024-09-11T06:14:06.971 INFO:teuthology.orchestra.run.smithi194.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 847 kB/s | 42 kB 00:00 2024-09-11T06:14:07.021 INFO:teuthology.orchestra.run.smithi194.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-11T06:14:07.047 INFO:teuthology.orchestra.run.smithi194.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-11T06:14:07.072 INFO:teuthology.orchestra.run.smithi194.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 715 kB/s | 36 kB 00:00 2024-09-11T06:14:07.097 INFO:teuthology.orchestra.run.smithi194.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-11T06:14:07.147 INFO:teuthology.orchestra.run.smithi194.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.0 MB/s | 309 kB 00:00 2024-09-11T06:14:07.181 INFO:teuthology.orchestra.run.smithi194.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 832 kB/s | 26 kB 00:00 2024-09-11T06:14:07.223 INFO:teuthology.orchestra.run.smithi194.stdout:(24/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.7 MB/s | 662 kB 00:00 2024-09-11T06:14:07.248 INFO:teuthology.orchestra.run.smithi194.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 723 kB/s | 49 kB 00:00 2024-09-11T06:14:07.298 INFO:teuthology.orchestra.run.smithi194.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 899 kB/s | 67 kB 00:00 2024-09-11T06:14:07.332 INFO:teuthology.orchestra.run.smithi194.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-11T06:14:07.366 INFO:teuthology.orchestra.run.smithi194.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-11T06:14:07.424 INFO:teuthology.orchestra.run.smithi194.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-11T06:14:07.491 INFO:teuthology.orchestra.run.smithi194.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-11T06:14:07.600 INFO:teuthology.orchestra.run.smithi194.stdout:(31/32): librados2-19.1.1-298.gb53b6d3e.el9.x86 15 MB/s | 3.4 MB 00:00 2024-09-11T06:14:07.658 INFO:teuthology.orchestra.run.smithi194.stdout:(32/32): librbd1-19.1.1-298.gb53b6d3e.el9.x86_6 14 MB/s | 3.2 MB 00:00 2024-09-11T06:14:07.664 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:07.664 INFO:teuthology.orchestra.run.smithi194.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-11T06:14:07.767 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:14:07.803 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:14:07.803 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:14:08.062 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T06:14:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T06:14:08.456 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:14:08.456 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:14:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T06:14:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T06:14:08.800 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T06:14:08.800 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T06:14:08.800 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T06:14:08.800 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:08.832 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T06:14:09.954 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:14:10.037 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-11T06:14:10.071 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-11T06:14:10.097 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-11T06:14:10.119 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T06:14:10.148 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-11T06:14:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T06:14:10.399 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-11T06:14:10.783 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-11T06:14:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T06:14:10.925 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T06:14:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/34 2024-09-11T06:14:11.041 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T06:14:11.096 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/34 2024-09-11T06:14:11.133 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-11T06:14:11.185 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 11/34 2024-09-11T06:14:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T06:14:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T06:14:11.349 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T06:14:11.384 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-11T06:14:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-11T06:14:11.559 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-11T06:14:11.601 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-11T06:14:11.632 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-11T06:14:11.661 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-11T06:14:11.694 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-11T06:14:12.024 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-11T06:14:12.065 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T06:14:12.155 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 22/34 2024-09-11T06:14:12.187 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/34 2024-09-11T06:14:12.231 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-11T06:14:12.711 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-11T06:14:12.743 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T06:14:12.813 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/34 2024-09-11T06:14:12.882 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/34 2024-09-11T06:14:12.911 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 28/34 2024-09-11T06:14:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T06:14:15.283 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T06:14:15.839 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/34 2024-09-11T06:14:15.877 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T06:14:15.970 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 30/34 2024-09-11T06:14:15.970 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T06:14:15.970 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T06:14:15.970 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:16.004 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T06:14:18.838 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T06:14:18.838 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-09-11T06:14:18.838 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-09-11T06:14:18.839 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-09-11T06:14:18.839 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-09-11T06:14:18.839 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-09-11T06:14:18.839 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-09-11T06:14:18.839 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-09-11T06:14:18.839 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T06:14:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T06:14:19.861 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:19.861 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T06:14:19.861 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T06:14:19.861 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T06:14:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T06:14:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T06:14:19.955 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 8/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 9/34 2024-09-11T06:14:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-11T06:14:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-11T06:14:21.184 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-11T06:14:21.185 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-11T06:14:21.185 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-11T06:14:21.185 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-11T06:14:21.185 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-11T06:14:21.185 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-11T06:14:21.185 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T06:14:21.185 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-11T06:14:21.185 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/34 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T06:14:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:22.224 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:14:22.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-test 2024-09-11T06:14:23.143 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:14:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:14:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-09-11T06:14:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:23.287 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 49 M 2024-09-11T06:14:23.287 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 209 M 2024-09-11T06:14:23.287 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:14:23.794 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): libcephsqlite-19.1.1-298.gb53b6d3e.el9.x 716 kB/s | 163 kB 00:00 2024-09-11T06:14:24.178 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 166 kB/s | 64 kB 00:00 2024-09-11T06:14:24.211 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 471 kB/s | 304 kB 00:00 2024-09-11T06:14:25.095 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): ceph-test-19.1.1-298.gb53b6d3e.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-11T06:14:25.097 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:25.097 INFO:teuthology.orchestra.run.smithi070.stdout:Total 27 MB/s | 49 MB 00:01 2024-09-11T06:14:25.124 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:14:25.144 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:14:25.144 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:14:25.530 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:14:25.530 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:14:26.058 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:14:26.138 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T06:14:26.185 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T06:14:26.213 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T06:14:26.245 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T06:14:26.245 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-09-11T06:14:26.245 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-09-11T06:14:26.245 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-09-11T06:14:26.245 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-09-11T06:14:26.245 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-09-11T06:14:26.245 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-09-11T06:14:26.245 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-09-11T06:14:26.246 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:27.208 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T06:14:27.241 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 32/34 2024-09-11T06:14:27.241 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:27.241 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T06:14:27.241 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T06:14:27.241 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T06:14:27.241 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:27.243 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T06:14:27.335 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-11T06:14:27.335 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x 8/34 2024-09-11T06:14:28.543 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86 9/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-11T06:14:28.544 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 31/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-11T06:14:28.545 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/34 2024-09-11T06:14:29.485 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-11T06:14:29.485 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:29.485 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T06:14:29.486 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:29.488 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:14:29.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-test 2024-09-11T06:14:30.377 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:14:30.510 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:14:30.510 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:30.510 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:14:30.510 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout:Install 4 Packages 2024-09-11T06:14:30.511 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:30.512 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 49 M 2024-09-11T06:14:30.512 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 209 M 2024-09-11T06:14:30.512 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:14:30.766 INFO:teuthology.orchestra.run.smithi194.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-11T06:14:30.808 INFO:teuthology.orchestra.run.smithi194.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-11T06:14:30.833 INFO:teuthology.orchestra.run.smithi194.stdout:(3/4): libcephsqlite-19.1.1-298.gb53b6d3e.el9.x 753 kB/s | 163 kB 00:00 2024-09-11T06:14:30.844 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T06:14:30.928 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T06:14:32.167 INFO:teuthology.orchestra.run.smithi194.stdout:(4/4): ceph-test-19.1.1-298.gb53b6d3e.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-11T06:14:32.169 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:32.170 INFO:teuthology.orchestra.run.smithi194.stdout:Total 30 MB/s | 49 MB 00:01 2024-09-11T06:14:32.198 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:14:32.217 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:14:32.217 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:14:32.597 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:14:32.597 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:14:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:14:33.196 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T06:14:33.249 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T06:14:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T06:14:33.371 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T06:14:33.371 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/4 2024-09-11T06:14:33.371 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/4 2024-09-11T06:14:33.371 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T06:14:33.689 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T06:14:33.690 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:33.690 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:14:33.690 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:33.690 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:33.690 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T06:14:33.690 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T06:14:33.690 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:33.690 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:14:33.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph 2024-09-11T06:14:34.565 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:39 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:14:34.709 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:14:34.711 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T06:14:34.712 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T06:14:34.713 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T06:14:34.714 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T06:14:34.715 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T06:14:34.715 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T06:14:34.715 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T06:14:34.715 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:34.715 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:14:34.715 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:34.715 INFO:teuthology.orchestra.run.smithi070.stdout:Install 37 Packages 2024-09-11T06:14:34.715 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:34.716 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 30 M 2024-09-11T06:14:34.716 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 108 M 2024-09-11T06:14:34.716 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:14:35.280 INFO:teuthology.orchestra.run.smithi070.stdout:(1/37): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.rp 48 kB/s | 6.5 kB 00:00 2024-09-11T06:14:35.497 INFO:teuthology.orchestra.run.smithi070.stdout:(2/37): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_6 6.7 MB/s | 2.4 MB 00:00 2024-09-11T06:14:35.538 INFO:teuthology.orchestra.run.smithi070.stdout:(3/37): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_6 3.8 MB/s | 1.5 MB 00:00 2024-09-11T06:14:35.639 INFO:teuthology.orchestra.run.smithi070.stdout:(4/37): ceph-mgr-modules-core-19.1.1-298.gb53b6 2.4 MB/s | 249 kB 00:00 2024-09-11T06:14:35.706 INFO:teuthology.orchestra.run.smithi070.stdout:(5/37): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-09-11T06:14:35.839 INFO:teuthology.orchestra.run.smithi070.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-11T06:14:35.881 INFO:teuthology.orchestra.run.smithi070.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-11T06:14:35.915 INFO:teuthology.orchestra.run.smithi070.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-09-11T06:14:35.940 INFO:teuthology.orchestra.run.smithi070.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-11T06:14:35.966 INFO:teuthology.orchestra.run.smithi070.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-11T06:14:35.991 INFO:teuthology.orchestra.run.smithi070.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-11T06:14:36.016 INFO:teuthology.orchestra.run.smithi070.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-11T06:14:36.041 INFO:teuthology.orchestra.run.smithi070.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-11T06:14:36.208 INFO:teuthology.orchestra.run.smithi070.stdout:(14/37): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_ 24 MB/s | 17 MB 00:00 2024-09-11T06:14:36.234 INFO:teuthology.orchestra.run.smithi070.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 160 kB/s | 35 kB 00:00 2024-09-11T06:14:36.259 INFO:teuthology.orchestra.run.smithi070.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 355 kB/s | 77 kB 00:00 2024-09-11T06:14:36.284 INFO:teuthology.orchestra.run.smithi070.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T06:14:36.326 INFO:teuthology.orchestra.run.smithi070.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-11T06:14:36.351 INFO:teuthology.orchestra.run.smithi070.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 354 kB/s | 42 kB 00:00 2024-09-11T06:14:36.377 INFO:teuthology.orchestra.run.smithi070.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 866 kB/s | 43 kB 00:00 2024-09-11T06:14:36.414 INFO:teuthology.orchestra.run.smithi070.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 144 kB/s | 22 kB 00:00 2024-09-11T06:14:36.447 INFO:teuthology.orchestra.run.smithi070.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-11T06:14:36.473 INFO:teuthology.orchestra.run.smithi070.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 187 kB/s | 11 kB 00:00 2024-09-11T06:14:36.498 INFO:teuthology.orchestra.run.smithi070.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 363 kB/s | 18 kB 00:00 2024-09-11T06:14:36.523 INFO:teuthology.orchestra.run.smithi070.stdout:(25/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2024-09-11T06:14:36.549 INFO:teuthology.orchestra.run.smithi070.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-11T06:14:36.574 INFO:teuthology.orchestra.run.smithi070.stdout:(27/37): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-09-11T06:14:36.599 INFO:teuthology.orchestra.run.smithi070.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-09-11T06:14:36.625 INFO:teuthology.orchestra.run.smithi070.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 612 kB/s | 46 kB 00:00 2024-09-11T06:14:36.650 INFO:teuthology.orchestra.run.smithi070.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-11T06:14:36.675 INFO:teuthology.orchestra.run.smithi070.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-11T06:14:36.700 INFO:teuthology.orchestra.run.smithi070.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-11T06:14:36.726 INFO:teuthology.orchestra.run.smithi070.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-11T06:14:36.760 INFO:teuthology.orchestra.run.smithi070.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-11T06:14:36.785 INFO:teuthology.orchestra.run.smithi070.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-11T06:14:36.818 INFO:teuthology.orchestra.run.smithi070.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-11T06:14:36.843 INFO:teuthology.orchestra.run.smithi070.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.5 MB/s | 427 kB 00:00 2024-09-11T06:14:36.847 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:36.847 INFO:teuthology.orchestra.run.smithi070.stdout:Total 14 MB/s | 30 MB 00:02 2024-09-11T06:14:36.993 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:14:37.033 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:14:37.033 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:14:37.515 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:14:37.516 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:14:37.871 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/4 2024-09-11T06:14:37.950 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T06:14:38.914 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:14:38.980 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T06:14:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T06:14:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T06:14:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T06:14:39.199 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T06:14:39.231 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T06:14:39.323 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T06:14:39.401 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T06:14:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T06:14:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T06:14:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T06:14:39.567 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T06:14:39.600 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T06:14:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T06:14:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T06:14:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T06:14:39.767 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T06:14:39.808 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T06:14:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T06:14:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T06:14:40.102 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T06:14:40.156 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T06:14:40.194 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T06:14:40.259 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T06:14:40.323 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T06:14:40.325 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/4 2024-09-11T06:14:40.326 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/4 2024-09-11T06:14:40.326 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/4 2024-09-11T06:14:40.326 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T06:14:40.511 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T06:14:40.556 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T06:14:40.635 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:40.659 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:14:40.732 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T06:14:40.781 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T06:14:40.897 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T06:14:40.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph 2024-09-11T06:14:41.070 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 32/37 2024-09-11T06:14:41.099 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T06:14:41.125 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T06:14:41.126 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:41.126 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T06:14:41.126 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T06:14:41.126 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T06:14:41.126 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:41.503 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:39 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:14:41.658 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:14:41.660 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:14:41.660 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:41.660 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:14:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T06:14:41.660 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T06:14:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T06:14:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:41.663 INFO:teuthology.orchestra.run.smithi194.stdout:Install 37 Packages 2024-09-11T06:14:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:41.664 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 30 M 2024-09-11T06:14:41.664 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 108 M 2024-09-11T06:14:41.664 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:14:42.159 INFO:teuthology.orchestra.run.smithi194.stdout:(1/37): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.rp 51 kB/s | 6.5 kB 00:00 2024-09-11T06:14:42.376 INFO:teuthology.orchestra.run.smithi194.stdout:(2/37): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_6 6.9 MB/s | 2.4 MB 00:00 2024-09-11T06:14:42.418 INFO:teuthology.orchestra.run.smithi194.stdout:(3/37): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_6 3.9 MB/s | 1.5 MB 00:00 2024-09-11T06:14:42.502 INFO:teuthology.orchestra.run.smithi194.stdout:(4/37): ceph-mgr-modules-core-19.1.1-298.gb53b6 2.9 MB/s | 249 kB 00:00 2024-09-11T06:14:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T06:14:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T06:14:42.595 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:42.595 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T06:14:42.595 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T06:14:42.595 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T06:14:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:42.668 INFO:teuthology.orchestra.run.smithi194.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-11T06:14:42.769 INFO:teuthology.orchestra.run.smithi194.stdout:(6/37): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_6 7.7 MB/s | 4.7 MB 00:00 2024-09-11T06:14:42.936 INFO:teuthology.orchestra.run.smithi194.stdout:(7/37): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-11T06:14:42.977 INFO:teuthology.orchestra.run.smithi194.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 4.0 MB/s | 1.2 MB 00:00 2024-09-11T06:14:43.028 INFO:teuthology.orchestra.run.smithi194.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-11T06:14:43.034 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T06:14:43.053 INFO:teuthology.orchestra.run.smithi194.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 375 kB/s | 106 kB 00:00 2024-09-11T06:14:43.058 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T06:14:43.058 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:43.058 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T06:14:43.059 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T06:14:43.059 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T06:14:43.059 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:43.078 INFO:teuthology.orchestra.run.smithi194.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-11T06:14:43.104 INFO:teuthology.orchestra.run.smithi194.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 807 kB/s | 135 kB 00:00 2024-09-11T06:14:43.220 INFO:teuthology.orchestra.run.smithi194.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 298 kB/s | 35 kB 00:00 2024-09-11T06:14:43.254 INFO:teuthology.orchestra.run.smithi194.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 938 kB/s | 188 kB 00:00 2024-09-11T06:14:43.280 INFO:teuthology.orchestra.run.smithi194.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 856 kB/s | 172 kB 00:00 2024-09-11T06:14:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T06:14:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T06:14:43.309 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:43.309 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T06:14:43.309 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T06:14:43.309 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T06:14:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:43.313 INFO:teuthology.orchestra.run.smithi194.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 869 kB/s | 51 kB 00:00 2024-09-11T06:14:43.338 INFO:teuthology.orchestra.run.smithi194.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 656 kB/s | 77 kB 00:00 2024-09-11T06:14:43.364 INFO:teuthology.orchestra.run.smithi194.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-11T06:14:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T06:14:43.406 INFO:teuthology.orchestra.run.smithi194.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-11T06:14:43.431 INFO:teuthology.orchestra.run.smithi194.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 651 kB/s | 43 kB 00:00 2024-09-11T06:14:43.464 INFO:teuthology.orchestra.run.smithi194.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.0 MB/s | 172 kB 00:00 2024-09-11T06:14:43.489 INFO:teuthology.orchestra.run.smithi194.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 432 kB/s | 11 kB 00:00 2024-09-11T06:14:43.515 INFO:teuthology.orchestra.run.smithi194.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 706 kB/s | 18 kB 00:00 2024-09-11T06:14:43.540 INFO:teuthology.orchestra.run.smithi194.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 931 kB/s | 23 kB 00:00 2024-09-11T06:14:43.565 INFO:teuthology.orchestra.run.smithi194.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 783 kB/s | 19 kB 00:00 2024-09-11T06:14:43.599 INFO:teuthology.orchestra.run.smithi194.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.6 MB/s | 358 kB 00:00 2024-09-11T06:14:43.624 INFO:teuthology.orchestra.run.smithi194.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2024-09-11T06:14:43.649 INFO:teuthology.orchestra.run.smithi194.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-11T06:14:43.683 INFO:teuthology.orchestra.run.smithi194.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-11T06:14:43.708 INFO:teuthology.orchestra.run.smithi194.stdout:(30/37): python3-pecan-1.4.2-3.el9.noarch.rpm 5.2 MB/s | 272 kB 00:00 2024-09-11T06:14:43.737 INFO:teuthology.orchestra.run.smithi194.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 308 kB/s | 16 kB 00:00 2024-09-11T06:14:43.762 INFO:teuthology.orchestra.run.smithi194.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.6 MB/s | 90 kB 00:00 2024-09-11T06:14:43.787 INFO:teuthology.orchestra.run.smithi194.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 721 kB/s | 36 kB 00:00 2024-09-11T06:14:43.812 INFO:teuthology.orchestra.run.smithi194.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-11T06:14:43.847 INFO:teuthology.orchestra.run.smithi194.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 597 kB/s | 20 kB 00:00 2024-09-11T06:14:43.872 INFO:teuthology.orchestra.run.smithi194.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-11T06:14:43.980 INFO:teuthology.orchestra.run.smithi194.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-11T06:14:43.985 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:43.985 INFO:teuthology.orchestra.run.smithi194.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-11T06:14:44.137 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:14:44.178 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:14:44.178 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:14:44.647 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:14:44.648 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:14:45.164 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 6/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T06:14:45.165 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T06:14:45.166 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T06:14:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T06:14:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T06:14:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T06:14:45.167 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T06:14:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T06:14:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T06:14:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T06:14:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T06:14:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T06:14:45.168 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T06:14:46.027 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T06:14:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T06:14:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T06:14:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T06:14:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T06:14:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T06:14:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T06:14:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:46.067 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:14:46.099 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T06:14:46.140 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T06:14:46.177 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T06:14:46.256 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T06:14:46.318 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T06:14:46.350 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T06:14:46.441 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T06:14:46.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-base 2024-09-11T06:14:46.520 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T06:14:46.561 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T06:14:46.596 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T06:14:46.626 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T06:14:46.660 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T06:14:46.694 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T06:14:46.743 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T06:14:46.786 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T06:14:46.821 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T06:14:46.869 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T06:14:46.911 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T06:14:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T06:14:47.035 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:14:47.125 INFO:teuthology.orchestra.run.smithi070.stdout:Package ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:14:47.127 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T06:14:47.168 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:14:47.169 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:14:47.169 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:14:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T06:14:47.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install cephadm 2024-09-11T06:14:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T06:14:47.307 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T06:14:47.356 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T06:14:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T06:14:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T06:14:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T06:14:47.781 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T06:14:47.804 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:14:47.868 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T06:14:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T06:14:47.937 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:14:47.937 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:47.937 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:14:47.937 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:47.938 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:14:47.938 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T06:14:47.938 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:47.938 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:14:47.938 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:47.938 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T06:14:47.938 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:47.939 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 765 k 2024-09-11T06:14:47.939 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 771 k 2024-09-11T06:14:47.939 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:14:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T06:14:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 32/37 2024-09-11T06:14:48.213 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm-19.1.1-298.gb53b6d3e.el9.noarch.rpm 2.7 MB/s | 765 kB 00:00 2024-09-11T06:14:48.213 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:48.213 INFO:teuthology.orchestra.run.smithi070.stdout:Total 2.7 MB/s | 765 kB 00:00 2024-09-11T06:14:48.213 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:14:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T06:14:48.217 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:14:48.217 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:14:48.223 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:14:48.224 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:14:48.239 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 33/37 2024-09-11T06:14:48.239 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:48.239 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T06:14:48.239 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T06:14:48.239 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T06:14:48.239 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:48.298 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:14:48.777 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:14:48.858 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:14:49.259 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:14:49.523 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:14:49.523 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:49.523 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:14:49.523 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:14:49.523 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:49.523 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:14:49.688 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T06:14:49.715 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 34/37 2024-09-11T06:14:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T06:14:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T06:14:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T06:14:49.716 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:49.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T06:14:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T06:14:50.171 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 35/37 2024-09-11T06:14:50.171 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:50.171 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T06:14:50.171 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T06:14:50.171 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T06:14:50.171 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:50.315 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:55 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:14:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T06:14:50.422 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/37 2024-09-11T06:14:50.422 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:50.422 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T06:14:50.422 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T06:14:50.422 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T06:14:50.422 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:50.448 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:14:50.470 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:50.470 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-09-11T06:14:50.470 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:50.470 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:14:50.470 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T06:14:50.470 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:50.470 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:14:50.471 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:50.471 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T06:14:50.471 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:50.471 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 145 k 2024-09-11T06:14:50.471 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 435 k 2024-09-11T06:14:50.471 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:14:50.486 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T06:14:50.645 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-immutable-object-cache-19.1.1-298.gb53b6d3 746 kB/s | 145 kB 00:00 2024-09-11T06:14:50.645 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:50.645 INFO:teuthology.orchestra.run.smithi070.stdout:Total 739 kB/s | 145 kB 00:00 2024-09-11T06:14:50.646 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:14:50.653 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:14:50.653 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:14:50.710 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:14:50.710 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:14:50.858 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:14:50.946 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T06:14:50.972 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T06:14:50.972 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:50.972 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T06:14:50.972 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T06:14:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:51.894 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:14:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:51.894 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:14:52.155 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr 2024-09-11T06:14:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 37/37 2024-09-11T06:14:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/37 2024-09-11T06:14:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 5/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.n 6/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T06:14:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T06:14:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T06:14:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T06:14:52.732 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:57 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:14:52.825 INFO:teuthology.orchestra.run.smithi070.stdout:Package ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:14:52.869 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:14:52.870 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:14:52.870 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:14:52.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T06:14:53.400 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T06:14:53.400 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T06:14:53.401 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T06:14:53.402 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T06:14:53.403 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:53.404 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:14:53.502 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:00:58 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:14:53.634 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T06:14:53.636 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout:Install 12 Packages 2024-09-11T06:14:53.637 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:53.638 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 8.7 M 2024-09-11T06:14:53.638 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 104 M 2024-09-11T06:14:53.638 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:14:53.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-base 2024-09-11T06:14:54.049 INFO:teuthology.orchestra.run.smithi070.stdout:(1/12): ceph-grafana-dashboards-19.1.1-298.gb53 217 kB/s | 32 kB 00:00 2024-09-11T06:14:54.074 INFO:teuthology.orchestra.run.smithi070.stdout:(2/12): ceph-prometheus-alerts-19.1.1-298.gb53b 96 kB/s | 16 kB 00:00 2024-09-11T06:14:54.191 INFO:teuthology.orchestra.run.smithi070.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.3 MB/s | 269 kB 00:00 2024-09-11T06:14:54.308 INFO:teuthology.orchestra.run.smithi070.stdout:(4/12): ceph-mgr-dashboard-19.1.1-298.gb53b6d3e 8.8 MB/s | 3.6 MB 00:00 2024-09-11T06:14:54.341 INFO:teuthology.orchestra.run.smithi070.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-11T06:14:54.377 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:14:54.400 INFO:teuthology.orchestra.run.smithi070.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.8 MB/s | 548 kB 00:00 2024-09-11T06:14:54.417 INFO:teuthology.orchestra.run.smithi070.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 283 kB/s | 19 kB 00:00 2024-09-11T06:14:54.450 INFO:teuthology.orchestra.run.smithi070.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-11T06:14:54.466 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:14:54.467 INFO:teuthology.orchestra.run.smithi070.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-11T06:14:54.501 INFO:teuthology.orchestra.run.smithi070.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-11T06:14:54.508 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:14:54.510 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:14:54.510 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:14:54.534 INFO:teuthology.orchestra.run.smithi070.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.5 MB/s | 863 kB 00:00 2024-09-11T06:14:54.580 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install cephadm 2024-09-11T06:14:54.585 INFO:teuthology.orchestra.run.smithi070.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-11T06:14:54.588 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:54.588 INFO:teuthology.orchestra.run.smithi070.stdout:Total 9.1 MB/s | 8.7 MB 00:00 2024-09-11T06:14:54.635 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:14:54.652 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:14:54.652 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:14:54.850 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:14:54.850 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:14:55.141 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:53 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:14:55.273 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:55.274 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 765 k 2024-09-11T06:14:55.275 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 771 k 2024-09-11T06:14:55.275 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:14:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:14:55.460 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-11T06:14:55.496 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-11T06:14:55.542 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-11T06:14:55.557 INFO:teuthology.orchestra.run.smithi194.stdout:cephadm-19.1.1-298.gb53b6d3e.el9.noarch.rpm 2.6 MB/s | 765 kB 00:00 2024-09-11T06:14:55.558 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:55.559 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.6 MB/s | 765 kB 00:00 2024-09-11T06:14:55.559 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:14:55.564 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:14:55.564 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:14:55.570 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:14:55.570 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:14:55.573 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-11T06:14:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:14:55.681 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-11T06:14:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-11T06:14:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-11T06:14:55.944 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-11T06:14:55.973 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-11T06:14:56.005 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 10/12 2024-09-11T06:14:56.141 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:14:56.235 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:14:56.597 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:14:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:14:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:56.853 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:14:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:14:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:56.853 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:14:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 11/12 2024-09-11T06:14:57.071 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T06:14:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T06:14:57.635 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:55 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:14:57.768 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 145 k 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 435 k 2024-09-11T06:14:57.769 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:14:57.979 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-immutable-object-cache-19.1.1-298.gb53b6d3 693 kB/s | 145 kB 00:00 2024-09-11T06:14:57.979 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:14:57.980 INFO:teuthology.orchestra.run.smithi194.stdout:Total 688 kB/s | 145 kB 00:00 2024-09-11T06:14:57.980 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:14:57.988 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:14:57.988 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:14:58.044 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:14:58.044 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:14:58.216 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:14:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T06:14:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T06:14:58.338 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:14:58.338 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T06:14:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 1/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 2/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 3/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-11T06:14:58.449 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-11T06:14:58.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-11T06:14:58.450 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-11T06:14:58.758 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-11T06:14:58.758 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:58.758 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:14:58.758 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T06:14:58.758 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:58.759 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:14:59.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T06:14:59.290 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.e 1/1 2024-09-11T06:14:59.290 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:59.290 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:14:59.290 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:14:59.291 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:14:59.291 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:14:59.522 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr 2024-09-11T06:14:59.607 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:04 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:14:59.740 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:14:59.741 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-11T06:14:59.741 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:14:59.741 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-11T06:14:59.741 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:14:59.741 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T06:14:59.741 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T06:14:59.742 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T06:14:59.743 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T06:14:59.743 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T06:14:59.743 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:59.743 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:14:59.743 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-11T06:14:59.743 INFO:teuthology.orchestra.run.smithi070.stdout:Install 12 Packages 2024-09-11T06:14:59.743 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:14:59.744 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 38 M 2024-09-11T06:14:59.744 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 212 M 2024-09-11T06:14:59.744 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:00.010 INFO:teuthology.orchestra.run.smithi070.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-11T06:15:00.043 INFO:teuthology.orchestra.run.smithi070.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.8 MB/s | 801 kB 00:00 2024-09-11T06:15:00.096 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:58 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:00.152 INFO:teuthology.orchestra.run.smithi070.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-09-11T06:15:00.190 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:00.233 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:00.234 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:15:00.234 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:00.236 INFO:teuthology.orchestra.run.smithi070.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-11T06:15:00.261 INFO:teuthology.orchestra.run.smithi070.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-09-11T06:15:00.307 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T06:15:00.361 INFO:teuthology.orchestra.run.smithi070.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-29 14 MB/s | 7.4 MB 00:00 2024-09-11T06:15:00.386 INFO:teuthology.orchestra.run.smithi070.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 256 kB/s | 38 kB 00:00 2024-09-11T06:15:00.504 INFO:teuthology.orchestra.run.smithi070.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-11T06:15:00.570 INFO:teuthology.orchestra.run.smithi070.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-11T06:15:00.604 INFO:teuthology.orchestra.run.smithi070.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-11T06:15:00.696 INFO:teuthology.orchestra.run.smithi070.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 11 MB/s | 4.9 MB 00:00 2024-09-11T06:15:00.870 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:58 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:01.003 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:01.004 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:01.004 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:15:01.004 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:01.004 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T06:15:01.005 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T06:15:01.006 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:01.006 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:01.006 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:01.006 INFO:teuthology.orchestra.run.smithi194.stdout:Install 12 Packages 2024-09-11T06:15:01.006 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:01.006 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 8.7 M 2024-09-11T06:15:01.006 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 104 M 2024-09-11T06:15:01.007 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:01.038 INFO:teuthology.orchestra.run.smithi070.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-11T06:15:01.039 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:01.039 INFO:teuthology.orchestra.run.smithi070.stdout:Total 29 MB/s | 38 MB 00:01 2024-09-11T06:15:01.391 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:01.417 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:01.417 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:01.598 INFO:teuthology.orchestra.run.smithi194.stdout:(1/12): ceph-grafana-dashboards-19.1.1-298.gb53 203 kB/s | 32 kB 00:00 2024-09-11T06:15:01.615 INFO:teuthology.orchestra.run.smithi194.stdout:(2/12): ceph-prometheus-alerts-19.1.1-298.gb53b 95 kB/s | 16 kB 00:00 2024-09-11T06:15:01.807 INFO:teuthology.orchestra.run.smithi194.stdout:(3/12): ceph-mgr-dashboard-19.1.1-298.gb53b6d3e 9.7 MB/s | 3.6 MB 00:00 2024-09-11T06:15:01.840 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:01.840 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:01.974 INFO:teuthology.orchestra.run.smithi194.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 5.1 MB/s | 863 kB 00:00 2024-09-11T06:15:02.057 INFO:teuthology.orchestra.run.smithi194.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 6.4 MB/s | 548 kB 00:00 2024-09-11T06:15:02.083 INFO:teuthology.orchestra.run.smithi194.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-11T06:15:02.183 INFO:teuthology.orchestra.run.smithi194.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 20 MB/s | 2.0 MB 00:00 2024-09-11T06:15:02.217 INFO:teuthology.orchestra.run.smithi194.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-11T06:15:02.241 INFO:teuthology.orchestra.run.smithi194.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T06:15:02.267 INFO:teuthology.orchestra.run.smithi194.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-11T06:15:02.623 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T06:15:02.744 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T06:15:02.843 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T06:15:02.878 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T06:15:03.063 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T06:15:03.103 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T06:15:03.180 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T06:15:03.844 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T06:15:03.957 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T06:15:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T06:15:06.236 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T06:15:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T06:15:07.983 INFO:teuthology.orchestra.run.smithi194.stdout:(11/12): python3-protobuf-3.14.0-13.el9.noarch. 42 kB/s | 269 kB 00:06 2024-09-11T06:15:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T06:15:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 1/12 2024-09-11T06:15:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T06:15:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T06:15:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T06:15:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T06:15:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T06:15:09.007 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T06:15:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T06:15:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T06:15:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T06:15:09.008 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T06:15:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T06:15:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T06:15:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T06:15:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:09.396 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:09.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-rook 2024-09-11T06:15:10.350 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:15 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:10.483 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:10.484 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:10.484 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T06:15:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout:Install 13 Packages 2024-09-11T06:15:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:10.487 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 2.2 M 2024-09-11T06:15:10.487 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 26 M 2024-09-11T06:15:10.487 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:10.739 INFO:teuthology.orchestra.run.smithi070.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 222 kB/s | 26 kB 00:00 2024-09-11T06:15:10.755 INFO:teuthology.orchestra.run.smithi070.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 145 kB/s | 19 kB 00:00 2024-09-11T06:15:10.772 INFO:teuthology.orchestra.run.smithi070.stdout:(3/13): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el9. 330 kB/s | 49 kB 00:00 2024-09-11T06:15:10.898 INFO:teuthology.orchestra.run.smithi070.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-11T06:15:10.932 INFO:teuthology.orchestra.run.smithi070.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.1 MB/s | 222 kB 00:00 2024-09-11T06:15:10.949 INFO:teuthology.orchestra.run.smithi070.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-11T06:15:10.982 INFO:teuthology.orchestra.run.smithi070.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 640 kB/s | 32 kB 00:00 2024-09-11T06:15:11.007 INFO:teuthology.orchestra.run.smithi070.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-11T06:15:11.024 INFO:teuthology.orchestra.run.smithi070.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-11T06:15:11.049 INFO:teuthology.orchestra.run.smithi070.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.1 MB/s | 59 kB 00:00 2024-09-11T06:15:11.074 INFO:teuthology.orchestra.run.smithi070.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-11T06:15:11.100 INFO:teuthology.orchestra.run.smithi070.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-11T06:15:11.142 INFO:teuthology.orchestra.run.smithi070.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-11T06:15:11.144 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:11.145 INFO:teuthology.orchestra.run.smithi070.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-11T06:15:11.207 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:11.221 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:11.221 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:11.814 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:11.989 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T06:15:12.051 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T06:15:12.107 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T06:15:12.141 INFO:teuthology.orchestra.run.smithi194.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 98 kB/s | 1.0 MB 00:10 2024-09-11T06:15:12.144 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T06:15:12.145 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:12.148 INFO:teuthology.orchestra.run.smithi194.stdout:Total 797 kB/s | 8.7 MB 00:11 2024-09-11T06:15:12.185 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T06:15:12.196 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:12.214 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:12.214 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T06:15:12.398 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T06:15:12.414 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:12.414 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:12.462 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T06:15:12.967 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:13.058 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-11T06:15:13.093 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-11T06:15:13.139 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-11T06:15:13.178 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-11T06:15:13.182 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T06:15:13.257 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T06:15:13.285 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T06:15:13.287 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-11T06:15:13.342 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T06:15:13.363 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T06:15:13.411 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-11T06:15:13.665 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-11T06:15:13.708 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-11T06:15:13.745 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-11T06:15:13.776 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 10/12 2024-09-11T06:15:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T06:15:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 1/13 2024-09-11T06:15:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T06:15:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T06:15:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T06:15:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T06:15:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T06:15:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T06:15:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T06:15:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T06:15:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T06:15:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T06:15:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T06:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T06:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T06:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T06:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T06:15:14.489 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:14.490 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:14.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T06:15:14.820 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 11/12 2024-09-11T06:15:14.861 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T06:15:15.341 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:20 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:15.475 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T06:15:15.476 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T06:15:15.477 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T06:15:15.477 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:15.477 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:15.477 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:15.477 INFO:teuthology.orchestra.run.smithi070.stdout:Install 6 Packages 2024-09-11T06:15:15.477 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:15.477 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 7.0 M 2024-09-11T06:15:15.477 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 33 M 2024-09-11T06:15:15.478 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:15.761 INFO:teuthology.orchestra.run.smithi070.stdout:(1/6): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e.el 719 kB/s | 146 kB 00:00 2024-09-11T06:15:15.811 INFO:teuthology.orchestra.run.smithi070.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-11T06:15:15.836 INFO:teuthology.orchestra.run.smithi070.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 891 kB/s | 248 kB 00:00 2024-09-11T06:15:15.862 INFO:teuthology.orchestra.run.smithi070.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T06:15:15.903 INFO:teuthology.orchestra.run.smithi070.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 12/12 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9 1/12 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noar 2/12 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9. 3/12 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-11T06:15:16.060 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-11T06:15:16.061 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-11T06:15:16.061 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-11T06:15:16.061 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-11T06:15:16.395 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T06:15:16.396 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T06:15:16.397 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T06:15:16.397 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T06:15:16.397 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:16.397 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:16.661 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T06:15:17.220 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:15 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:17.354 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:17.355 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-11T06:15:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:15:17.355 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-11T06:15:17.355 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T06:15:17.355 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:15:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T06:15:17.355 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:17.356 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-11T06:15:17.357 INFO:teuthology.orchestra.run.smithi194.stdout:Install 12 Packages 2024-09-11T06:15:17.357 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:17.357 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 38 M 2024-09-11T06:15:17.357 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 212 M 2024-09-11T06:15:17.357 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:17.696 INFO:teuthology.orchestra.run.smithi070.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.8 MB/s | 6.0 MB 00:02 2024-09-11T06:15:17.698 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:17.698 INFO:teuthology.orchestra.run.smithi070.stdout:Total 3.2 MB/s | 7.0 MB 00:02 2024-09-11T06:15:17.770 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:17.783 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:17.783 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:17.882 INFO:teuthology.orchestra.run.smithi194.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 858 kB/s | 191 kB 00:00 2024-09-11T06:15:17.886 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:17.886 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:17.982 INFO:teuthology.orchestra.run.smithi194.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-11T06:15:18.008 INFO:teuthology.orchestra.run.smithi194.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-11T06:15:18.058 INFO:teuthology.orchestra.run.smithi194.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-11T06:15:18.166 INFO:teuthology.orchestra.run.smithi194.stdout:(5/12): ceph-mgr-diskprediction-local-19.1.1-29 15 MB/s | 7.4 MB 00:00 2024-09-11T06:15:18.192 INFO:teuthology.orchestra.run.smithi194.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-11T06:15:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:18.292 INFO:teuthology.orchestra.run.smithi194.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-11T06:15:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T06:15:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T06:15:18.493 INFO:teuthology.orchestra.run.smithi194.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-11T06:15:18.559 INFO:teuthology.orchestra.run.smithi194.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-11T06:15:18.584 INFO:teuthology.orchestra.run.smithi194.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-11T06:15:18.643 INFO:teuthology.orchestra.run.smithi194.stdout:(11/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 4.5 MB/s | 3.0 MB 00:00 2024-09-11T06:15:18.910 INFO:teuthology.orchestra.run.smithi194.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-09-11T06:15:18.911 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:18.911 INFO:teuthology.orchestra.run.smithi194.stdout:Total 25 MB/s | 38 MB 00:01 2024-09-11T06:15:18.943 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T06:15:19.033 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T06:15:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T06:15:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T06:15:19.265 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:19.290 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:19.290 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:19.712 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:19.712 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:19.911 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T06:15:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/6 2024-09-11T06:15:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T06:15:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T06:15:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T06:15:19.912 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T06:15:20.213 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T06:15:20.213 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:20.213 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:20.213 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:20.213 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T06:15:20.214 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T06:15:20.214 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T06:15:20.214 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T06:15:20.214 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T06:15:20.214 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:20.214 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:20.476 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:20.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-fuse 2024-09-11T06:15:20.545 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T06:15:20.615 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T06:15:20.715 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T06:15:20.751 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T06:15:20.934 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T06:15:20.967 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T06:15:21.049 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:26 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:21.054 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T06:15:21.182 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:21.182 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:15:21.182 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:21.182 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:21.182 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T06:15:21.182 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-11T06:15:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T06:15:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:21.183 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:21.183 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:21.183 INFO:teuthology.orchestra.run.smithi070.stdout:Install 2 Packages 2024-09-11T06:15:21.183 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:21.183 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 977 k 2024-09-11T06:15:21.184 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 2.9 M 2024-09-11T06:15:21.184 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:21.347 INFO:teuthology.orchestra.run.smithi070.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 678 kB/s | 80 kB 00:00 2024-09-11T06:15:21.523 INFO:teuthology.orchestra.run.smithi070.stdout:(2/2): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-11T06:15:21.523 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:21.523 INFO:teuthology.orchestra.run.smithi070.stdout:Total 2.8 MB/s | 977 kB 00:00 2024-09-11T06:15:21.536 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:21.557 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:21.557 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:21.638 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:21.639 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:21.702 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T06:15:21.820 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T06:15:21.836 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:21.966 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T06:15:22.040 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T06:15:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T06:15:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/2 2024-09-11T06:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T06:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T06:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:22.955 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:23.076 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T06:15:23.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-volume 2024-09-11T06:15:23.872 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:24.010 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:24.011 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-11T06:15:24.011 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:24.011 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T06:15:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:24.011 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:24.012 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:24.012 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T06:15:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:24.012 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 285 k 2024-09-11T06:15:24.012 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 1.3 M 2024-09-11T06:15:24.012 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T06:15:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T06:15:24.244 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-volume-19.1.1-298.gb53b6d3e.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-11T06:15:24.245 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:24.245 INFO:teuthology.orchestra.run.smithi070.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-11T06:15:24.245 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:24.254 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:24.254 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:24.284 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:24.285 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:15:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:15:24.588 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:15:24.588 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T06:15:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:15:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:25.662 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:25.662 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:25.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librados-devel 2024-09-11T06:15:26.571 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:26.657 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 12/12 2024-09-11T06:15:26.657 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d 1/12 2024-09-11T06:15:26.657 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T06:15:26.657 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T06:15:26.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T06:15:26.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T06:15:26.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T06:15:26.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T06:15:26.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T06:15:26.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T06:15:26.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T06:15:26.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T06:15:26.706 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:26.706 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-09-11T06:15:26.706 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:26.706 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:26.706 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T06:15:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:26.707 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:26.707 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:26.707 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T06:15:26.707 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:26.707 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 127 k 2024-09-11T06:15:26.707 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 456 k 2024-09-11T06:15:26.707 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:26.917 INFO:teuthology.orchestra.run.smithi070.stdout:librados-devel-19.1.1-298.gb53b6d3e.el9.x86_64. 603 kB/s | 127 kB 00:00 2024-09-11T06:15:26.918 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:26.918 INFO:teuthology.orchestra.run.smithi070.stdout:Total 599 kB/s | 127 kB 00:00 2024-09-11T06:15:26.918 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:26.924 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:26.924 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:26.987 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:26.987 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:27.088 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T06:15:27.088 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:27.088 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:27.088 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:27.088 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:27.089 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:27.239 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:27.546 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-rook 2024-09-11T06:15:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:27.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:27.953 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:27.953 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:27.953 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:27.953 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:27.953 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:28.110 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:26 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:28.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install libcephfs2 2024-09-11T06:15:28.244 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T06:15:28.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout:Install 13 Packages 2024-09-11T06:15:28.247 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:28.248 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 2.2 M 2024-09-11T06:15:28.248 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 26 M 2024-09-11T06:15:28.248 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:28.780 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:28.781 INFO:teuthology.orchestra.run.smithi194.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 218 kB/s | 19 kB 00:00 2024-09-11T06:15:28.805 INFO:teuthology.orchestra.run.smithi194.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 227 kB/s | 26 kB 00:00 2024-09-11T06:15:28.871 INFO:teuthology.orchestra.run.smithi070.stdout:Package libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:28.897 INFO:teuthology.orchestra.run.smithi194.stdout:(3/13): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el9. 240 kB/s | 49 kB 00:00 2024-09-11T06:15:28.914 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:28.915 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:15:28.915 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:28.923 INFO:teuthology.orchestra.run.smithi194.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-11T06:15:28.948 INFO:teuthology.orchestra.run.smithi194.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-11T06:15:28.990 INFO:teuthology.orchestra.run.smithi194.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.3 MB/s | 54 kB 00:00 2024-09-11T06:15:29.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install libcephfs-devel 2024-09-11T06:15:29.023 INFO:teuthology.orchestra.run.smithi194.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 429 kB/s | 32 kB 00:00 2024-09-11T06:15:29.048 INFO:teuthology.orchestra.run.smithi194.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 249 kB/s | 14 kB 00:00 2024-09-11T06:15:29.074 INFO:teuthology.orchestra.run.smithi194.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-11T06:15:29.099 INFO:teuthology.orchestra.run.smithi194.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.4 MB/s | 279 kB 00:00 2024-09-11T06:15:29.124 INFO:teuthology.orchestra.run.smithi194.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T06:15:29.174 INFO:teuthology.orchestra.run.smithi194.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-11T06:15:29.199 INFO:teuthology.orchestra.run.smithi194.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 895 kB/s | 90 kB 00:00 2024-09-11T06:15:29.202 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:29.203 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-11T06:15:29.267 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:29.282 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:29.282 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:29.370 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:29.370 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:29.572 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:29.705 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:29.705 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 32 k 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 142 k 2024-09-11T06:15:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:29.846 INFO:teuthology.orchestra.run.smithi070.stdout:libcephfs-devel-19.1.1-298.gb53b6d3e.el9.x86_64 226 kB/s | 32 kB 00:00 2024-09-11T06:15:29.847 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:29.847 INFO:teuthology.orchestra.run.smithi070.stdout:Total 224 kB/s | 32 kB 00:00 2024-09-11T06:15:29.847 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:29.851 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:29.851 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:29.866 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:29.867 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:29.913 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:30.080 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T06:15:30.134 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T06:15:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T06:15:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T06:15:30.268 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T06:15:30.380 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T06:15:30.426 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:30.488 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T06:15:30.536 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T06:15:30.677 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:30.677 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:30.677 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:30.677 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:30.678 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:30.678 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:30.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librados2 2024-09-11T06:15:31.251 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T06:15:31.291 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T06:15:31.325 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T06:15:31.373 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T06:15:31.395 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T06:15:31.428 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:36 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:31.519 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:31.563 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:31.564 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:15:31.564 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:31.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install librbd1 2024-09-11T06:15:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 13/13 2024-09-11T06:15:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 1/13 2024-09-11T06:15:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T06:15:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T06:15:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T06:15:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T06:15:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T06:15:32.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T06:15:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T06:15:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T06:15:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T06:15:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T06:15:32.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T06:15:32.196 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:32.285 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:32.328 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:32.329 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:15:32.329 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:32.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rados 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T06:15:32.486 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T06:15:32.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T06:15:32.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T06:15:32.487 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T06:15:32.487 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:32.487 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:32.760 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T06:15:32.966 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:33.057 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:33.100 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:33.101 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:15:33.101 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:33.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rgw 2024-09-11T06:15:33.325 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:33.462 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T06:15:33.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T06:15:33.464 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:33.464 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:33.464 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:33.464 INFO:teuthology.orchestra.run.smithi194.stdout:Install 6 Packages 2024-09-11T06:15:33.464 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:33.464 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 7.0 M 2024-09-11T06:15:33.465 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 33 M 2024-09-11T06:15:33.465 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:33.748 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:33.839 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:33.882 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:33.883 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:15:33.883 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:33.942 INFO:teuthology.orchestra.run.smithi194.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-11T06:15:33.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-cephfs 2024-09-11T06:15:33.968 INFO:teuthology.orchestra.run.smithi194.stdout:(2/6): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e.el 740 kB/s | 146 kB 00:00 2024-09-11T06:15:34.018 INFO:teuthology.orchestra.run.smithi194.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-11T06:15:34.043 INFO:teuthology.orchestra.run.smithi194.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 768 kB/s | 58 kB 00:00 2024-09-11T06:15:34.068 INFO:teuthology.orchestra.run.smithi194.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-11T06:15:34.143 INFO:teuthology.orchestra.run.smithi194.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-11T06:15:34.146 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:34.146 INFO:teuthology.orchestra.run.smithi194.stdout:Total 10 MB/s | 7.0 MB 00:00 2024-09-11T06:15:34.217 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:34.229 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:34.229 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:34.327 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:34.329 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:34.521 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:34.611 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:34.654 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:34.655 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:15:34.655 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:34.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install python3-rbd 2024-09-11T06:15:34.793 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T06:15:34.853 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T06:15:35.290 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:35.380 INFO:teuthology.orchestra.run.smithi070.stdout:Package python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:35.381 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T06:15:35.423 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:35.424 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-09-11T06:15:35.424 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:35.465 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T06:15:35.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-fuse 2024-09-11T06:15:35.529 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T06:15:35.566 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T06:15:36.059 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:41 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:36.192 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T06:15:36.193 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:36.194 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 85 k 2024-09-11T06:15:36.194 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 231 k 2024-09-11T06:15:36.194 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:36.320 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 6/6 2024-09-11T06:15:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 1/6 2024-09-11T06:15:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T06:15:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T06:15:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T06:15:36.321 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T06:15:36.391 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 432 kB/s | 85 kB 00:00 2024-09-11T06:15:36.392 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:36.392 INFO:teuthology.orchestra.run.smithi070.stdout:Total 428 kB/s | 85 kB 00:00 2024-09-11T06:15:36.392 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:36.400 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:36.400 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:36.465 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:36.465 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:36.592 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:36.624 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:36.732 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:36.882 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-fuse 2024-09-11T06:15:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:37.403 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:37.403 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:37.447 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:37.581 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:37.582 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:37.583 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:37.583 INFO:teuthology.orchestra.run.smithi194.stdout:Install 2 Packages 2024-09-11T06:15:37.583 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:37.583 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 977 k 2024-09-11T06:15:37.583 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 2.9 M 2024-09-11T06:15:37.583 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:37.685 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-mirror 2024-09-11T06:15:37.828 INFO:teuthology.orchestra.run.smithi194.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 617 kB/s | 80 kB 00:00 2024-09-11T06:15:37.995 INFO:teuthology.orchestra.run.smithi194.stdout:(2/2): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-11T06:15:37.995 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:37.995 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.3 MB/s | 977 kB 00:00 2024-09-11T06:15:38.007 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:38.029 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:38.029 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:38.110 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:38.110 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:38.261 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:38.400 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:38.400 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repo Size 2024-09-11T06:15:38.400 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:38.401 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T06:15:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:38.401 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:38.401 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:38.401 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T06:15:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:38.402 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 3.1 M 2024-09-11T06:15:38.402 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 13 M 2024-09-11T06:15:38.402 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:38.440 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T06:15:38.512 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T06:15:38.737 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-mirror-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 9.2 MB/s | 3.1 MB 00:00 2024-09-11T06:15:38.738 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:38.738 INFO:teuthology.orchestra.run.smithi070.stdout:Total 9.2 MB/s | 3.1 MB 00:00 2024-09-11T06:15:38.739 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:38.747 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:38.748 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:38.828 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:38.828 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:39.231 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/2 2024-09-11T06:15:39.232 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/2 2024-09-11T06:15:39.270 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T06:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T06:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T06:15:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T06:15:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:39.504 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T06:15:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:39.505 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:39.791 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-volume 2024-09-11T06:15:40.374 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:40.513 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:40.513 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:40.513 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-11T06:15:40.513 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 285 k 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 1.3 M 2024-09-11T06:15:40.514 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:40.532 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:40.532 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:40.532 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:40.750 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-volume-19.1.1-298.gb53b6d3e.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-11T06:15:40.750 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:40.751 INFO:teuthology.orchestra.run.smithi194.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-11T06:15:40.751 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:40.759 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:40.759 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:40.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install rbd-nbd 2024-09-11T06:15:40.793 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:40.794 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:41.009 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:41.086 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:15:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:15:41.101 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:15:41.101 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T06:15:41.102 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:41.344 INFO:teuthology.orchestra.run.smithi070.stdout:Last metadata expiration check: 0:01:46 ago on Wed 11 Sep 2024 06:13:55 AM UTC. 2024-09-11T06:15:41.481 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-11T06:15:41.481 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:41.481 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-11T06:15:41.481 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:Install 1 Package 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 171 k 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 494 k 2024-09-11T06:15:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-11T06:15:41.692 INFO:teuthology.orchestra.run.smithi070.stdout:rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 816 kB/s | 171 kB 00:00 2024-09-11T06:15:41.693 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:41.693 INFO:teuthology.orchestra.run.smithi070.stdout:Total 810 kB/s | 171 kB 00:00 2024-09-11T06:15:41.693 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-11T06:15:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-11T06:15:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-11T06:15:41.766 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-11T06:15:41.766 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-11T06:15:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-11T06:15:42.014 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 1/1 2024-09-11T06:15:42.131 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:42.132 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T06:15:42.132 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:42.132 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:42.461 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados-devel 2024-09-11T06:15:42.464 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:42.742 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-11T06:15:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:15:42.742 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-11T06:15:43.012 DEBUG:teuthology.parallel:result is None 2024-09-11T06:15:43.037 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:41 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:43.173 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:43.174 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:43.174 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-09-11T06:15:43.174 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:43.174 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:43.174 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T06:15:43.174 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:43.175 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:43.175 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:43.175 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-11T06:15:43.175 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:43.175 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 127 k 2024-09-11T06:15:43.175 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 456 k 2024-09-11T06:15:43.175 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:43.382 INFO:teuthology.orchestra.run.smithi194.stdout:librados-devel-19.1.1-298.gb53b6d3e.el9.x86_64. 616 kB/s | 127 kB 00:00 2024-09-11T06:15:43.382 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:43.382 INFO:teuthology.orchestra.run.smithi194.stdout:Total 612 kB/s | 127 kB 00:00 2024-09-11T06:15:43.383 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:43.387 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:43.387 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:43.450 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:43.450 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:43.711 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:44.137 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:44.386 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:44.386 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:44.386 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:44.386 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:44.387 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:44.387 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:44.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs2 2024-09-11T06:15:45.254 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:45.349 INFO:teuthology.orchestra.run.smithi194.stdout:Package libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:45.395 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:45.396 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:15:45.396 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:45.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs-devel 2024-09-11T06:15:46.034 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:46.168 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:46.169 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-11T06:15:46.170 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:46.170 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 32 k 2024-09-11T06:15:46.170 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 142 k 2024-09-11T06:15:46.170 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:46.334 INFO:teuthology.orchestra.run.smithi194.stdout:libcephfs-devel-19.1.1-298.gb53b6d3e.el9.x86_64 193 kB/s | 32 kB 00:00 2024-09-11T06:15:46.335 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:46.335 INFO:teuthology.orchestra.run.smithi194.stdout:Total 191 kB/s | 32 kB 00:00 2024-09-11T06:15:46.335 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:46.339 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:46.339 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:46.364 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:46.365 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:46.456 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:46.564 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:47.231 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:47.232 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:47.232 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:47.232 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:47.423 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados2 2024-09-11T06:15:47.986 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:45 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:48.077 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:48.120 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:48.121 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:15:48.121 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:48.194 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librbd1 2024-09-11T06:15:48.760 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:46 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:48.851 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:48.894 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:48.895 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:15:48.895 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:48.972 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rados 2024-09-11T06:15:49.538 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:47 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:15:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:49.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rgw 2024-09-11T06:15:50.311 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:48 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:50.402 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:50.445 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:50.446 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:15:50.447 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:50.520 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-cephfs 2024-09-11T06:15:51.084 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:49 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:51.176 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:51.219 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:51.220 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:15:51.220 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:51.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rbd 2024-09-11T06:15:51.852 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:49 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:51.945 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 is already installed. 2024-09-11T06:15:51.987 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:51.988 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-11T06:15:51.988 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:52.063 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-fuse 2024-09-11T06:15:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:50 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:52.758 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:52.759 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:52.759 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-09-11T06:15:52.759 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:52.759 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:52.759 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T06:15:52.759 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:52.760 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:52.760 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:52.760 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-11T06:15:52.760 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:52.760 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 85 k 2024-09-11T06:15:52.760 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 231 k 2024-09-11T06:15:52.760 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:52.963 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 420 kB/s | 85 kB 00:00 2024-09-11T06:15:52.963 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:52.963 INFO:teuthology.orchestra.run.smithi194.stdout:Total 418 kB/s | 85 kB 00:00 2024-09-11T06:15:52.963 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:52.970 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:52.971 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:53.033 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:53.033 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:53.176 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:53.284 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:53.695 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:53.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:53.945 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:53.945 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:53.945 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:53.945 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:53.945 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:54.204 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-mirror 2024-09-11T06:15:54.785 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:52 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:54.925 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-11T06:15:54.926 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:54.927 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 3.1 M 2024-09-11T06:15:54.927 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 13 M 2024-09-11T06:15:54.927 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:55.299 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-mirror-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 8.3 MB/s | 3.1 MB 00:00 2024-09-11T06:15:55.299 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:55.300 INFO:teuthology.orchestra.run.smithi194.stdout:Total 8.3 MB/s | 3.1 MB 00:00 2024-09-11T06:15:55.300 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:55.309 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:55.309 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:55.389 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:55.390 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:55.835 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:55.934 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T06:15:55.934 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T06:15:55.934 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T06:15:55.934 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T06:15:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:57.027 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:57.028 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:57.028 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:57.028 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:57.028 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:57.028 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:57.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-nbd 2024-09-11T06:15:57.826 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:55 ago on Wed 11 Sep 2024 06:14:02 AM UTC. 2024-09-11T06:15:57.962 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-11T06:15:57.962 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:57.962 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 171 k 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 494 k 2024-09-11T06:15:57.963 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-11T06:15:58.176 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_64.rpm 803 kB/s | 171 kB 00:00 2024-09-11T06:15:58.177 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-11T06:15:58.177 INFO:teuthology.orchestra.run.smithi194.stdout:Total 797 kB/s | 171 kB 00:00 2024-09-11T06:15:58.177 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-11T06:15:58.185 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-11T06:15:58.185 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-11T06:15:58.248 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-11T06:15:58.249 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-11T06:15:58.418 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-11T06:15:58.524 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:58.940 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:59.210 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/1 2024-09-11T06:15:59.210 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:59.210 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-11T06:15:59.210 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T06:15:59.211 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:15:59.211 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-11T06:15:59.440 DEBUG:teuthology.parallel:result is None 2024-09-11T06:15:59.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T06:15:59.590 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T06:15:59.615 INFO:teuthology.orchestra.run.smithi070.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T06:15:59.616 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T06:15:59.616 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T06:15:59.618 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T06:15:59.763 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T06:15:59.785 INFO:teuthology.orchestra.run.smithi194.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T06:15:59.786 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T06:15:59.786 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T06:15:59.787 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T06:15:59.788 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:15:59.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T06:15:59.818 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:15:59.818 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T06:15:59.851 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T06:15:59.852 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:15:59.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T06:15:59.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T06:15:59.955 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:15:59.955 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T06:15:59.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T06:16:00.050 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T06:16:00.050 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:00.050 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T06:16:00.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T06:16:00.145 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:00.146 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T06:16:00.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T06:16:00.235 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T06:16:00.235 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:00.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T06:16:00.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T06:16:00.327 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:00.327 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T06:16:00.352 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T06:16:00.417 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T06:16:00.492 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T06:16:00.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-09-11T06:16:00.495 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-09-11T06:16:00.519 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T06:16:00.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T06:16:00.561 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T06:16:00.585 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T06:16:00.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T06:16:00.626 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T06:16:00.660 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T06:16:00.660 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T06:16:00.660 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900606', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6175, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '88/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae', 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHd4wuqu7CzzUC8iKKxigkLN5/7FYEqHY54LOLmynvPftK/LCS1zJc/Y2O9e3A0XuUnGtDlWjaSFnaff98dbtjg=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPlPHEyrit2lapPG+c6YK2MN7J4GKd2EGBE8nNmi/DYmIgtkYvFnotH0aLFUzejtYM6OiPnx7Ton4QkERMwwIBc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'deep_copy': True, 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_21:16:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T06:16:00.661 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T06:16:00.692 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T06:16:00.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T06:16:00.748 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T06:16:00.773 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:00.773 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T06:16:00.826 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T06:16:00.827 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-11T06:16:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T06:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T06:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T06:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T06:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T06:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-11 06:15:39.741845374 +0000 2024-09-11T06:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-11 06:13:17.488885715 +0000 2024-09-11T06:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-11 06:13:17.488885715 +0000 2024-09-11T06:16:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-11 06:13:17.488885715 +0000 2024-09-11T06:16:00.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T06:16:00.946 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-11T06:16:00.946 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-11T06:16:00.946 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 7.8903e-05 s, 6.5 MB/s 2024-09-11T06:16:00.947 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T06:16:01.004 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-11 06:15:39.742845343 +0000 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-11 06:13:17.820875428 +0000 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-11 06:13:17.820875428 +0000 2024-09-11T06:16:01.059 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-11 06:13:17.820875428 +0000 2024-09-11T06:16:01.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T06:16:01.122 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-11T06:16:01.122 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-11T06:16:01.122 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000101963 s, 5.0 MB/s 2024-09-11T06:16:01.123 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T06:16:01.180 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-11 06:15:39.742845343 +0000 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-11 06:13:18.143865419 +0000 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-11 06:13:18.143865419 +0000 2024-09-11T06:16:01.235 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-11 06:13:18.143865419 +0000 2024-09-11T06:16:01.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T06:16:01.297 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-11T06:16:01.297 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-11T06:16:01.297 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 9.5047e-05 s, 5.4 MB/s 2024-09-11T06:16:01.298 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T06:16:01.354 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-11T06:16:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T06:16:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T06:16:01.410 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-11T06:16:01.410 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T06:16:01.410 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T06:16:01.410 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-11 06:15:39.742845343 +0000 2024-09-11T06:16:01.410 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-11 06:13:18.463855503 +0000 2024-09-11T06:16:01.411 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-11 06:13:18.463855503 +0000 2024-09-11T06:16:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-11 06:13:18.463855503 +0000 2024-09-11T06:16:01.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T06:16:01.473 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-11T06:16:01.474 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-11T06:16:01.474 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000122841 s, 4.2 MB/s 2024-09-11T06:16:01.475 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T06:16:01.531 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:01.531 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:01.531 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T06:16:01.549 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T06:16:01.549 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-11 06:15:56.178525443 +0000 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-11 06:13:07.850299941 +0000 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-11 06:13:07.850299941 +0000 2024-09-11T06:16:01.605 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-11 06:13:07.850299941 +0000 2024-09-11T06:16:01.605 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T06:16:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-11T06:16:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-11T06:16:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000337955 s, 1.5 MB/s 2024-09-11T06:16:01.671 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T06:16:01.728 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-11T06:16:01.784 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T06:16:01.784 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T06:16:01.784 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T06:16:01.784 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T06:16:01.784 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T06:16:01.784 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-11 06:15:56.179525420 +0000 2024-09-11T06:16:01.784 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-11 06:13:08.187292379 +0000 2024-09-11T06:16:01.784 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-11 06:13:08.187292379 +0000 2024-09-11T06:16:01.785 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-11 06:13:08.187292379 +0000 2024-09-11T06:16:01.785 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T06:16:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-11T06:16:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-11T06:16:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000187864 s, 2.7 MB/s 2024-09-11T06:16:01.849 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T06:16:01.905 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-11T06:16:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T06:16:01.961 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T06:16:01.961 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T06:16:01.961 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T06:16:01.961 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T06:16:01.961 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-11 06:15:56.179525420 +0000 2024-09-11T06:16:01.961 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-11 06:13:08.506285220 +0000 2024-09-11T06:16:01.962 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-11 06:13:08.506285220 +0000 2024-09-11T06:16:01.962 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-11 06:13:08.506285220 +0000 2024-09-11T06:16:01.962 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T06:16:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-11T06:16:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-11T06:16:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000296484 s, 1.7 MB/s 2024-09-11T06:16:02.026 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T06:16:02.083 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-11T06:16:02.138 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T06:16:02.138 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T06:16:02.138 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-11T06:16:02.138 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T06:16:02.138 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T06:16:02.138 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-11 06:15:56.179525420 +0000 2024-09-11T06:16:02.138 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-11 06:13:08.839277747 +0000 2024-09-11T06:16:02.138 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-11 06:13:08.839277747 +0000 2024-09-11T06:16:02.139 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-11 06:13:08.839277747 +0000 2024-09-11T06:16:02.139 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T06:16:02.204 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-11T06:16:02.204 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-11T06:16:02.204 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00020407 s, 2.5 MB/s 2024-09-11T06:16:02.205 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T06:16:02.262 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:02.263 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T06:16:02.263 INFO:tasks.ceph:Generating config... 2024-09-11T06:16:02.264 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-11T06:16:02.264 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-11T06:16:02.264 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-11T06:16:02.264 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T06:16:02.264 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T06:16:02.264 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T06:16:02.264 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T06:16:02.264 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T06:16:02.265 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-11T06:16:02.266 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T06:16:02.266 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T06:16:02.266 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T06:16:02.266 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T06:16:02.327 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T06:16:02.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T06:16:02.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T06:16:02.399 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70'), ('mon.c', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]'), ('mon.b', '172.21.15.194')] 2024-09-11T06:16:02.399 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.194', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-11T06:16:02.400 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:02.400 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T06:16:02.455 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --addv c '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --add b 172.21.15.194 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid 7a868aca-1727-4b78-b18f-580564f1ab22 2024-09-11T06:16:02.541 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 7a868aca-1727-4b78-b18f-580564f1ab22 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2024-09-11T06:16:02.541880+0000 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-11T06:16:02.541880+0000 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 17 (quincy) 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-11T06:16:02.542 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T06:16:02.543 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T06:16:02.558 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7a868aca-1727-4b78-b18f-580564f1ab22... 2024-09-11T06:16:02.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T06:16:02.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T06:16:02.641 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-11T06:16:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-09-11T06:16:02.641 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T06:16:02.642 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-09-11T06:16:02.643 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.194" 2024-09-11T06:16:02.644 INFO:teuthology.orchestra.run.smithi070.stdout: mon client directed command retry = 5 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on pool no app = False 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: ms inject socket failures = 5000 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 7a868aca-1727-4b78-b18f-580564f1ab22 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-09-11T06:16:02.645 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-09-11T06:16:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-09-11T06:16:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore compression algorithm = lz4 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore compression mode = aggressive 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-09-11T06:16:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: osd blocked scrub grace period = 3600 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: osd max markdown count = 1000 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: osd shutdown pgref assert = True 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-09-11T06:16:02.649 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-09-11T06:16:02.650 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T06:16:02.651 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T06:16:02.652 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-09-11T06:16:02.653 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-09-11T06:16:02.653 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-09-11T06:16:02.653 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-09-11T06:16:02.653 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-09-11T06:16:02.653 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T06:16:02.653 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-09-11T06:16:02.653 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.654 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-09-11T06:16:02.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-09-11T06:16:02.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.194" 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: mon client directed command retry = 5 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on pool no app = False 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject socket failures = 5000 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 7a868aca-1727-4b78-b18f-580564f1ab22 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.657 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore compression algorithm = lz4 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore compression mode = aggressive 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-09-11T06:16:02.659 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: osd blocked scrub grace period = 3600 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: osd max markdown count = 1000 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: osd shutdown pgref assert = True 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-11T06:16:02.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-09-11T06:16:02.661 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-09-11T06:16:02.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-09-11T06:16:02.663 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-09-11T06:16:02.665 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T06:16:02.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T06:16:02.758 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T06:16:02.759 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:02.759 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T06:16:02.774 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:02.774 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T06:16:02.828 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:16:02.829 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:02.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T06:16:02.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T06:16:02.903 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:02.903 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:02.958 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:16:02.958 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:02.958 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T06:16:02.958 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T06:16:02.993 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:02.993 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:03.050 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T06:16:03.051 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T06:16:03.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T06:16:03.101 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T06:16:03.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T06:16:03.198 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T06:16:03.201 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T06:16:03.201 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T06:16:03.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T06:16:03.242 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T06:16:03.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T06:16:03.296 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T06:16:03.308 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T06:16:03.308 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T06:16:03.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T06:16:03.333 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:03.333 INFO:tasks.ceph:role: osd.0 2024-09-11T06:16:03.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:16:03.333 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T06:16:03.398 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T06:16:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T06:16:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T06:16:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T06:16:03.398 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T06:16:03.398 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-11T06:16:03.398 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T06:16:03.398 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T06:16:03.399 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T06:16:03.399 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T06:16:03.431 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-11T06:16:03.433 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-11T06:16:03.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T06:16:03.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T06:16:03.572 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T06:16:03.637 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:03.637 INFO:tasks.ceph:role: osd.1 2024-09-11T06:16:03.637 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:16:03.637 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T06:16:03.701 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T06:16:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T06:16:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T06:16:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T06:16:03.702 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T06:16:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-11T06:16:03.702 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T06:16:03.702 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T06:16:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T06:16:03.702 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T06:16:03.734 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-11T06:16:03.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-11T06:16:03.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T06:16:03.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T06:16:03.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T06:16:03.941 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:03.941 INFO:tasks.ceph:role: osd.2 2024-09-11T06:16:03.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:16:03.942 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T06:16:04.006 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T06:16:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T06:16:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T06:16:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T06:16:04.006 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T06:16:04.006 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-11T06:16:04.006 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T06:16:04.006 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T06:16:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T06:16:04.007 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T06:16:04.038 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-11T06:16:04.040 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-11T06:16:04.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T06:16:04.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T06:16:04.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T06:16:04.244 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:04.244 INFO:tasks.ceph:role: osd.3 2024-09-11T06:16:04.244 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:16:04.244 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T06:16:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T06:16:04.309 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T06:16:04.340 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-11T06:16:04.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-11T06:16:04.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T06:16:04.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T06:16:04.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:04.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:04.575+0000 7f80ae816640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T06:16:04.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:04.575+0000 7f80ae816640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T06:16:04.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:04.575+0000 7f80ae816640 -1 bdev(0x557dea1df800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T06:16:04.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:04.575+0000 7f80ae816640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T06:16:07.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T06:16:07.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:07.840+0000 7fc77c80b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T06:16:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:07.840+0000 7fc77c80b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T06:16:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:07.840+0000 7fc77c80b640 -1 bdev(0x5591f0325800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T06:16:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:07.840+0000 7fc77c80b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T06:16:11.256 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T06:16:11.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:11.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:11.376+0000 7f2692a0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T06:16:11.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:11.376+0000 7f2692a0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T06:16:11.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:11.376+0000 7f2692a0f640 -1 bdev(0x560628863800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T06:16:11.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:11.376+0000 7f2692a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T06:16:14.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T06:16:14.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:14.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:14.679+0000 7fb7a500d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T06:16:14.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:14.679+0000 7fb7a500d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T06:16:14.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:14.679+0000 7fb7a500d640 -1 bdev(0x564d45f49800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T06:16:14.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-11T06:16:14.679+0000 7fb7a500d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T06:16:17.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T06:16:17.617 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T06:16:17.647 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:17.647 INFO:tasks.ceph:role: osd.4 2024-09-11T06:16:17.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:16:17.648 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T06:16:17.724 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T06:16:17.724 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T06:16:17.724 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T06:16:17.725 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T06:16:17.725 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T06:16:17.725 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-11T06:16:17.725 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T06:16:17.725 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T06:16:17.725 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T06:16:17.725 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T06:16:18.231 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-11T06:16:18.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-11T06:16:18.234 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T06:16:18.332 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T06:16:18.362 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T06:16:18.428 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:18.428 INFO:tasks.ceph:role: osd.5 2024-09-11T06:16:18.428 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:16:18.429 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T06:16:18.502 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T06:16:18.960 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-11T06:16:18.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-11T06:16:18.962 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T06:16:19.034 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T06:16:19.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T06:16:19.168 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:19.168 INFO:tasks.ceph:role: osd.6 2024-09-11T06:16:19.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:16:19.168 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T06:16:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T06:16:19.241 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T06:16:19.725 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-11T06:16:19.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-11T06:16:19.728 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T06:16:19.821 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T06:16:19.850 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T06:16:19.916 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T06:16:19.916 INFO:tasks.ceph:role: osd.7 2024-09-11T06:16:19.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:16:19.917 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T06:16:19.989 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T06:16:19.989 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T06:16:19.989 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T06:16:19.989 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T06:16:19.989 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T06:16:19.989 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-11T06:16:19.989 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T06:16:19.990 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T06:16:19.990 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T06:16:19.990 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T06:16:20.511 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-11T06:16:20.513 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-11T06:16:20.514 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T06:16:20.660 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T06:16:20.691 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:20.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:20.785+0000 7f574b40b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T06:16:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:20.789+0000 7f574b40b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T06:16:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:20.789+0000 7f574b40b640 -1 bdev(0x563fd1085800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T06:16:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:20.789+0000 7f574b40b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T06:16:23.703 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T06:16:23.730 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:23.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:23.817+0000 7fb6b6789640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T06:16:23.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:23.817+0000 7fb6b6789640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T06:16:23.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:23.818+0000 7fb6b6789640 -1 bdev(0x55bc50cf5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T06:16:23.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:23.818+0000 7fb6b6789640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T06:16:26.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T06:16:27.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:27.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:27.092+0000 7f1713019640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T06:16:27.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:27.093+0000 7f1713019640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T06:16:27.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:27.093+0000 7f1713019640 -1 bdev(0x55a0a4a11800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T06:16:27.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:27.093+0000 7f1713019640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T06:16:30.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T06:16:30.029 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:30.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:30.113+0000 7f33dde1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T06:16:30.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:30.113+0000 7f33dde1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T06:16:30.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:30.113+0000 7f33dde1a640 -1 bdev(0x563e41075800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T06:16:30.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-11T06:16:30.114+0000 7f33dde1a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T06:16:33.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T06:16:33.059 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T06:16:33.060 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:33.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T06:16:33.091 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:33.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T06:16:33.159 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:33.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T06:16:33.225 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:33.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T06:16:33.292 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:33.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T06:16:33.359 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:33.359 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T06:16:33.389 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:33.389 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T06:16:33.457 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:33.457 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T06:16:33.526 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:33.526 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T06:16:33.594 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:33.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T06:16:33.661 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:33.661 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T06:16:33.678 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:33.679 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T06:16:33.718 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T06:16:33.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T06:16:33.721 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T06:16:33.761 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-09-11T06:16:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCjNeFmRYIRBhAAznKZMoId4dZGDlD+WzNOAA== 2024-09-11T06:16:33.761 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-09-11T06:16:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCkNeFm7xlVIhAAK9wsJhPcw5LOtDjVTxwBlA== 2024-09-11T06:16:33.761 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-09-11T06:16:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCnNeFmNW40MhAAnfyvtku2Ta0tLjXJDjzAWQ== 2024-09-11T06:16:33.761 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCrNeFmqkN/FhAAIK+7bNsmpHbLdriDIU4dww== 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCuNeFmYOKHKBAAAPg4KqOof70+si4ahx93mg== 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCjNeFmOj/dCxAARMJLynY5rKXxA5hk1+I1IQ== 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC0NeFmv+zmLhAAseXw0r1jqNDmTDoy4uvuIg== 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC3NeFmPlLYMBAAlAd5adY8G3dfT0sLopSe1A== 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC7NeFmu2OiBRAA7CzNWy5KmnmiTg5/ECpQyQ== 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-09-11T06:16:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC+NeFmBKvgBhAAVwzPLcMYKwzrwRpSpfYmdg== 2024-09-11T06:16:33.763 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-11T06:16:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCjNeFmAKV7DhAAX9Q5nezNduErgohK3DuG4Q== 2024-09-11T06:16:33.763 INFO:teuthology.orchestra.run.smithi070.stdout:[client.1] 2024-09-11T06:16:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCjNeFm7mOpERAAG6tiQbvt6wNhVTB2B+iRXw== 2024-09-11T06:16:33.782 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2024-09-11T06:16:33.782 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQCjNeFmRYIRBhAAznKZMoId4dZGDlD+WzNOAA== 2024-09-11T06:16:33.782 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-09-11T06:16:33.782 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQCkNeFm7xlVIhAAK9wsJhPcw5LOtDjVTxwBlA== 2024-09-11T06:16:33.782 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQCnNeFmNW40MhAAnfyvtku2Ta0tLjXJDjzAWQ== 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQCrNeFmqkN/FhAAIK+7bNsmpHbLdriDIU4dww== 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQCuNeFmYOKHKBAAAPg4KqOof70+si4ahx93mg== 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQCjNeFmOj/dCxAARMJLynY5rKXxA5hk1+I1IQ== 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQC0NeFmv+zmLhAAseXw0r1jqNDmTDoy4uvuIg== 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQC3NeFmPlLYMBAAlAd5adY8G3dfT0sLopSe1A== 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2024-09-11T06:16:33.783 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQC7NeFmu2OiBRAA7CzNWy5KmnmiTg5/ECpQyQ== 2024-09-11T06:16:33.784 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2024-09-11T06:16:33.784 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQC+NeFmBKvgBhAAVwzPLcMYKwzrwRpSpfYmdg== 2024-09-11T06:16:33.784 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-09-11T06:16:33.784 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQCjNeFmAKV7DhAAX9Q5nezNduErgohK3DuG4Q== 2024-09-11T06:16:33.784 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-09-11T06:16:33.784 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQCjNeFm7mOpERAAG6tiQbvt6wNhVTB2B+iRXw== 2024-09-11T06:16:33.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T06:16:33.806 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T06:16:33.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:33.879 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:33.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:33.932 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:33.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:33.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.037 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T06:16:34.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T06:16:34.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.143 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.197 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.251 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T06:16:34.353 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T06:16:34.356 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T06:16:34.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T06:16:34.411 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T06:16:34.465 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T06:16:34.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T06:16:34.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T06:16:34.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T06:16:34.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T06:16:34.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T06:16:34.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T06:16:34.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T06:16:34.820 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T06:16:34.917 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T06:16:34.942 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:34.944 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T06:16:34.997 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T06:16:34.998 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T06:16:34.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T06:16:35.001 INFO:tasks.ceph.mon.a:Started 2024-09-11T06:16:35.001 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T06:16:35.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T06:16:35.003 INFO:tasks.ceph.mon.c:Started 2024-09-11T06:16:35.003 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T06:16:35.003 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T06:16:35.040 INFO:tasks.ceph.mon.b:Started 2024-09-11T06:16:35.040 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T06:16:35.040 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T06:16:35.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T06:16:35.042 INFO:tasks.ceph.mgr.y:Started 2024-09-11T06:16:35.042 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T06:16:35.042 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T06:16:35.044 INFO:tasks.ceph.mgr.x:Started 2024-09-11T06:16:35.044 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T06:16:35.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T06:16:40.392 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-11T06:16:40.404 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T06:16:40.405 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T06:16:40.405 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:40.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T06:16:40.425 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:40.424+0000 7f0d8eb1e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T06:16:40.428 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:40.426+0000 7fc9c6df9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T06:16:40.430 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:40.430 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T06:16:40.467 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:40.466+0000 7f0d8eb1e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T06:16:40.470 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:40.468+0000 7fc9c6df9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T06:16:40.494 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:40.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T06:16:40.559 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-11T06:16:40.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T06:16:40.610 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:40.609+0000 7f0d8eb1e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T06:16:40.614 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:40.612+0000 7fc9c6df9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T06:16:40.624 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:40.624 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T06:16:40.649 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:40.649 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T06:16:40.663 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:40.662+0000 7f0d8eb1e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T06:16:40.666 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:40.665+0000 7fc9c6df9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T06:16:40.687 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:40.687 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T06:16:40.752 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-11T06:16:40.752 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T06:16:40.818 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new dba31bd4-e78d-407b-b639-5bb5104f3693 0 2024-09-11T06:16:40.828 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:40.828+0000 7f0d8eb1e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T06:16:40.833 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:40.831+0000 7fc9c6df9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T06:16:40.941 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:40.940+0000 7fc9c6df9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T06:16:40.944 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:40.943+0000 7f0d8eb1e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T06:16:41.004 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-09-11T06:16:41.016 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d 1 2024-09-11T06:16:41.196 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-11T06:16:41.207 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 1c946778-5c51-4d07-94a2-ada9d70d1bba 2 2024-09-11T06:16:41.263 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:41.262+0000 7fc9c6df9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T06:16:41.291 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:41.290+0000 7f0d8eb1e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T06:16:41.319 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:41.318+0000 7fc9c6df9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T06:16:41.357 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:41.357+0000 7f0d8eb1e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T06:16:41.395 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-09-11T06:16:41.407 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 1833d4e7-d511-4086-bbde-e7822ec6c1f3 3 2024-09-11T06:16:41.470 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:41.469+0000 7fc9c6df9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T06:16:41.515 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:41.514+0000 7f0d8eb1e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T06:16:41.588 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-09-11T06:16:41.599 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 28e56042-c64d-4193-be5b-752137116220 4 2024-09-11T06:16:41.784 INFO:teuthology.orchestra.run.smithi194.stdout:4 2024-09-11T06:16:41.795 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 80e06445-79b9-4069-851a-b5f63a882000 5 2024-09-11T06:16:41.977 INFO:teuthology.orchestra.run.smithi194.stdout:5 2024-09-11T06:16:41.989 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 05e46d6f-c759-41f4-bfd4-9514c0bd73fb 6 2024-09-11T06:16:42.169 INFO:teuthology.orchestra.run.smithi194.stdout:6 2024-09-11T06:16:42.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 26bcdc28-2387-4117-9005-399f68fc0439 7 2024-09-11T06:16:42.358 INFO:teuthology.orchestra.run.smithi194.stdout:7 2024-09-11T06:16:42.369 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T06:16:42.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T06:16:42.372 INFO:tasks.ceph.osd.0:Started 2024-09-11T06:16:42.372 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T06:16:42.372 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T06:16:42.374 INFO:tasks.ceph.osd.1:Started 2024-09-11T06:16:42.374 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T06:16:42.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T06:16:42.376 INFO:tasks.ceph.osd.2:Started 2024-09-11T06:16:42.376 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T06:16:42.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T06:16:42.378 INFO:tasks.ceph.osd.3:Started 2024-09-11T06:16:42.378 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T06:16:42.379 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T06:16:42.381 INFO:tasks.ceph.osd.4:Started 2024-09-11T06:16:42.381 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T06:16:42.381 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T06:16:42.383 INFO:tasks.ceph.osd.5:Started 2024-09-11T06:16:42.383 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T06:16:42.383 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T06:16:42.385 INFO:tasks.ceph.osd.6:Started 2024-09-11T06:16:42.385 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T06:16:42.386 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T06:16:42.388 INFO:tasks.ceph.osd.7:Started 2024-09-11T06:16:42.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T06:16:42.489 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:42.488+0000 7fc9c6df9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T06:16:42.545 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:42.544+0000 7fc9c6df9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T06:16:42.557 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:42.557+0000 7f0d8eb1e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T06:16:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:16:42.585 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:16:42.356322+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T06:16:42.356322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:16:42.596 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T06:16:42.596 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T06:16:42.609 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:42.608+0000 7f0d8eb1e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T06:16:42.917 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:42.916+0000 7fc9c6df9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T06:16:42.974 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:42.973+0000 7f0d8eb1e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T06:16:43.001 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.000+0000 7fc9c6df9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T06:16:43.061 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.060+0000 7f0d8eb1e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T06:16:43.109 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.109+0000 7fc9c6df9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T06:16:43.155 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.154+0000 7fc9c6df9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T06:16:43.166 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.165+0000 7f0d8eb1e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T06:16:43.211 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.211+0000 7f0d8eb1e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T06:16:43.268 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.267+0000 7fc9c6df9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T06:16:43.322 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.322+0000 7fc9c6df9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T06:16:43.327 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.326+0000 7f0d8eb1e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T06:16:43.369 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.368+0000 7fc9c6df9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T06:16:43.381 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.380+0000 7f0d8eb1e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T06:16:43.401 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T06:16:43.426 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.425+0000 7f0d8eb1e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T06:16:43.484 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.484+0000 7fc9c6df9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T06:16:43.538 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.537+0000 7f0d8eb1e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T06:16:43.538 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.537+0000 7fc9c6df9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T06:16:43.561 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-11T06:16:43.561 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":10,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:16:42.356322+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T06:16:42.356322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:16:43.571 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T06:16:43.587 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:16:43.586+0000 7f7b4b285640 -1 Falling back to public interface 2024-09-11T06:16:43.589 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.588+0000 7f0d8eb1e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T06:16:43.590 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:16:43.589+0000 7f3363b58640 -1 Falling back to public interface 2024-09-11T06:16:43.594 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.594+0000 7fc9c6df9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T06:16:43.641 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.640+0000 7f0d8eb1e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T06:16:43.664 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.663+0000 7fc9c6df9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T06:16:43.707 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.706+0000 7fc9c6df9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T06:16:43.708 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.707+0000 7f0d8eb1e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T06:16:43.750 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:43.750+0000 7fc9c6df9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T06:16:43.752 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.751+0000 7f0d8eb1e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T06:16:43.797 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:43.796+0000 7f0d8eb1e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T06:16:43.818 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:16:43.817+0000 7fcc5343e640 -1 Falling back to public interface 2024-09-11T06:16:43.845 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:16:43.844+0000 7f067dcf1640 -1 Falling back to public interface 2024-09-11T06:16:43.853 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:16:43.852+0000 7ff81a40c640 -1 Falling back to public interface 2024-09-11T06:16:44.067 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:16:44.066+0000 7fb1a3a0b640 -1 Falling back to public interface 2024-09-11T06:16:44.083 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:16:44.082+0000 7f2e9edc5640 -1 Falling back to public interface 2024-09-11T06:16:44.093 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:16:44.093+0000 7f353b2e8640 -1 Falling back to public interface 2024-09-11T06:16:44.407 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:44.406+0000 7fc9c6df9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T06:16:44.453 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-11T06:16:44.452+0000 7f0d8eb1e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T06:16:45.422 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:45.421+0000 7fc9676c7640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T06:16:45.422 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:16:45.421+0000 7fc9676c7640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T06:16:47.404 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:16:47.403+0000 7f067dcf1640 -1 osd.7 0 log_to_monitors true 2024-09-11T06:16:47.590 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:16:47.589+0000 7fcc5343e640 -1 osd.1 0 log_to_monitors true 2024-09-11T06:16:47.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:16:47.642+0000 7ff81a40c640 -1 osd.4 0 log_to_monitors true 2024-09-11T06:16:47.645 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:16:47.644+0000 7f7b4b285640 -1 osd.3 0 log_to_monitors true 2024-09-11T06:16:47.881 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:16:47.880+0000 7f353b2e8640 -1 osd.0 0 log_to_monitors true 2024-09-11T06:16:47.922 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:16:47.921+0000 7f3363b58640 -1 osd.2 0 log_to_monitors true 2024-09-11T06:16:48.078 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:16:48.078+0000 7fb1a3a0b640 -1 osd.5 0 log_to_monitors true 2024-09-11T06:16:48.125 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:16:48.124+0000 7f2e9edc5640 -1 osd.6 0 log_to_monitors true 2024-09-11T06:16:49.125 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:16:49.124+0000 7f0679c80640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T06:16:49.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:16:49.142+0000 7f0671aa0640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:16:50.377 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T06:16:50.412 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:16:50.411+0000 7f2e9ad54640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T06:16:50.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:16:50.422+0000 7ff815d1e640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T06:16:50.425 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:16:50.425+0000 7f2e92b74640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:16:50.426 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:16:50.425+0000 7fb19f44b640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T06:16:50.435 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:16:50.434+0000 7f7b47a28640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T06:16:50.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:16:50.443+0000 7ff80db3e640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:16:50.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:16:50.443+0000 7fb19726b640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:16:50.448 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:16:50.447+0000 7f33602fb640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T06:16:50.452 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:16:50.451+0000 7f7b3f034640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:16:50.465 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:16:50.465+0000 7f3357907640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:16:50.480 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:16:50.479+0000 7fcc4fbe1640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T06:16:50.485 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:16:50.484+0000 7f3537277640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T06:16:50.496 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:16:50.496+0000 7fcc471ed640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:16:50.501 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:16:50.501+0000 7f352f097640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:16:50.676 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-11T06:16:50.676 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":14,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:16:50.451275+0000","last_up_change":"2024-09-11T06:16:50.451275+0000","last_in_change":"2024-09-11T06:16:42.356322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6825","nonce":3016223649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6827","nonce":3016223649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6831","nonce":3016223649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6829","nonce":3016223649}]},"public_addr":"172.21.15.194:6825/3016223649","cluster_addr":"172.21.15.194:6827/3016223649","heartbeat_back_addr":"172.21.15.194:6831/3016223649","heartbeat_front_addr":"172.21.15.194:6829/3016223649","state":["exists","up"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6801","nonce":2361511015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6803","nonce":2361511015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6807","nonce":2361511015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6805","nonce":2361511015}]},"public_addr":"172.21.15.194:6801/2361511015","cluster_addr":"172.21.15.194:6803/2361511015","heartbeat_back_addr":"172.21.15.194:6807/2361511015","heartbeat_front_addr":"172.21.15.194:6805/2361511015","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.365417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:16:50.687 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-11T06:16:57.494 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T06:16:57.775 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-11T06:16:57.775 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":18,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:16:54.529382+0000","last_up_change":"2024-09-11T06:16:51.453603+0000","last_in_change":"2024-09-11T06:16:42.356322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T06:16:52.447451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6825","nonce":2621452558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6827","nonce":2621452558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6831","nonce":2621452558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6829","nonce":2621452558}]},"public_addr":"172.21.15.70:6825/2621452558","cluster_addr":"172.21.15.70:6827/2621452558","heartbeat_back_addr":"172.21.15.70:6831/2621452558","heartbeat_front_addr":"172.21.15.70:6829/2621452558","state":["exists","up"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6817","nonce":569448355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6819","nonce":569448355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6823","nonce":569448355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6821","nonce":569448355}]},"public_addr":"172.21.15.70:6817/569448355","cluster_addr":"172.21.15.70:6819/569448355","heartbeat_back_addr":"172.21.15.70:6823/569448355","heartbeat_front_addr":"172.21.15.70:6821/569448355","state":["exists","up"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6809","nonce":720689704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6811","nonce":720689704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6815","nonce":720689704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6813","nonce":720689704}]},"public_addr":"172.21.15.70:6809/720689704","cluster_addr":"172.21.15.70:6811/720689704","heartbeat_back_addr":"172.21.15.70:6815/720689704","heartbeat_front_addr":"172.21.15.70:6813/720689704","state":["exists","up"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6801","nonce":2301707714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6803","nonce":2301707714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6807","nonce":2301707714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6805","nonce":2301707714}]},"public_addr":"172.21.15.70:6801/2301707714","cluster_addr":"172.21.15.70:6803/2301707714","heartbeat_back_addr":"172.21.15.70:6807/2301707714","heartbeat_front_addr":"172.21.15.70:6805/2301707714","state":["exists","up"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6809","nonce":2043476445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6811","nonce":2043476445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6815","nonce":2043476445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6813","nonce":2043476445}]},"public_addr":"172.21.15.194:6809/2043476445","cluster_addr":"172.21.15.194:6811/2043476445","heartbeat_back_addr":"172.21.15.194:6815/2043476445","heartbeat_front_addr":"172.21.15.194:6813/2043476445","state":["exists","up"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6817","nonce":213940923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6819","nonce":213940923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6823","nonce":213940923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6821","nonce":213940923}]},"public_addr":"172.21.15.194:6817/213940923","cluster_addr":"172.21.15.194:6819/213940923","heartbeat_back_addr":"172.21.15.194:6823/213940923","heartbeat_front_addr":"172.21.15.194:6821/213940923","state":["exists","up"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6825","nonce":3016223649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6827","nonce":3016223649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6831","nonce":3016223649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6829","nonce":3016223649}]},"public_addr":"172.21.15.194:6825/3016223649","cluster_addr":"172.21.15.194:6827/3016223649","heartbeat_back_addr":"172.21.15.194:6831/3016223649","heartbeat_front_addr":"172.21.15.194:6829/3016223649","state":["exists","up"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6801","nonce":2361511015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6803","nonce":2361511015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6807","nonce":2361511015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6805","nonce":2361511015}]},"public_addr":"172.21.15.194:6801/2361511015","cluster_addr":"172.21.15.194:6803/2361511015","heartbeat_back_addr":"172.21.15.194:6807/2361511015","heartbeat_front_addr":"172.21.15.194:6805/2361511015","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.852226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.638877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.930981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.677178+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.636635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.104700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.150845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.365417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:16:57.786 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T06:16:57.786 INFO:tasks.ceph:Creating RBD pool 2024-09-11T06:16:57.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T06:16:58.616 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'rbd' created 2024-09-11T06:16:58.631 DEBUG:teuthology.orchestra.run.smithi070:> rbd --cluster ceph pool init rbd 2024-09-11T06:17:01.635 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T06:17:01.635 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T06:17:01.636 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T06:17:01.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T06:17:01.636 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T06:17:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:01.982 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1671262786},{"type":"v1","addr":"172.21.15.70:6833","nonce":1671262786}]},"active_addr":"172.21.15.70:6833/1671262786","active_change":"2024-09-11T06:16:44.408943+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2059832043}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":227847653}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1112510805}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1926760085}]}]} 2024-09-11T06:17:01.986 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T06:17:01.986 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T06:17:01.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T06:17:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:02.264 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:17:01.623067+0000","last_up_change":"2024-09-11T06:16:51.453603+0000","last_in_change":"2024-09-11T06:16:42.356322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T06:16:52.447451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T06:16:58.078189+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6825","nonce":2621452558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6827","nonce":2621452558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6831","nonce":2621452558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6829","nonce":2621452558}]},"public_addr":"172.21.15.70:6825/2621452558","cluster_addr":"172.21.15.70:6827/2621452558","heartbeat_back_addr":"172.21.15.70:6831/2621452558","heartbeat_front_addr":"172.21.15.70:6829/2621452558","state":["exists","up"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6817","nonce":569448355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6819","nonce":569448355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6823","nonce":569448355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6821","nonce":569448355}]},"public_addr":"172.21.15.70:6817/569448355","cluster_addr":"172.21.15.70:6819/569448355","heartbeat_back_addr":"172.21.15.70:6823/569448355","heartbeat_front_addr":"172.21.15.70:6821/569448355","state":["exists","up"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6809","nonce":720689704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6811","nonce":720689704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6815","nonce":720689704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6813","nonce":720689704}]},"public_addr":"172.21.15.70:6809/720689704","cluster_addr":"172.21.15.70:6811/720689704","heartbeat_back_addr":"172.21.15.70:6815/720689704","heartbeat_front_addr":"172.21.15.70:6813/720689704","state":["exists","up"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6801","nonce":2301707714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6803","nonce":2301707714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6807","nonce":2301707714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6805","nonce":2301707714}]},"public_addr":"172.21.15.70:6801/2301707714","cluster_addr":"172.21.15.70:6803/2301707714","heartbeat_back_addr":"172.21.15.70:6807/2301707714","heartbeat_front_addr":"172.21.15.70:6805/2301707714","state":["exists","up"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6809","nonce":2043476445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6811","nonce":2043476445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6815","nonce":2043476445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6813","nonce":2043476445}]},"public_addr":"172.21.15.194:6809/2043476445","cluster_addr":"172.21.15.194:6811/2043476445","heartbeat_back_addr":"172.21.15.194:6815/2043476445","heartbeat_front_addr":"172.21.15.194:6813/2043476445","state":["exists","up"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6817","nonce":213940923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6819","nonce":213940923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6823","nonce":213940923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6821","nonce":213940923}]},"public_addr":"172.21.15.194:6817/213940923","cluster_addr":"172.21.15.194:6819/213940923","heartbeat_back_addr":"172.21.15.194:6823/213940923","heartbeat_front_addr":"172.21.15.194:6821/213940923","state":["exists","up"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6825","nonce":3016223649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6827","nonce":3016223649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6831","nonce":3016223649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6829","nonce":3016223649}]},"public_addr":"172.21.15.194:6825/3016223649","cluster_addr":"172.21.15.194:6827/3016223649","heartbeat_back_addr":"172.21.15.194:6831/3016223649","heartbeat_front_addr":"172.21.15.194:6829/3016223649","state":["exists","up"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6801","nonce":2361511015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6803","nonce":2361511015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6807","nonce":2361511015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6805","nonce":2361511015}]},"public_addr":"172.21.15.194:6801/2361511015","cluster_addr":"172.21.15.194:6803/2361511015","heartbeat_back_addr":"172.21.15.194:6807/2361511015","heartbeat_front_addr":"172.21.15.194:6805/2361511015","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.852226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.638877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.930981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.677178+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.636635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.104700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.150845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.365417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:17:02.276 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T06:17:02.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T06:17:02.553 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:02.554 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":22,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:17:01.623067+0000","last_up_change":"2024-09-11T06:16:51.453603+0000","last_in_change":"2024-09-11T06:16:42.356322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T06:16:52.447451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T06:16:58.078189+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6825","nonce":2621452558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6827","nonce":2621452558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6831","nonce":2621452558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6829","nonce":2621452558}]},"public_addr":"172.21.15.70:6825/2621452558","cluster_addr":"172.21.15.70:6827/2621452558","heartbeat_back_addr":"172.21.15.70:6831/2621452558","heartbeat_front_addr":"172.21.15.70:6829/2621452558","state":["exists","up"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6817","nonce":569448355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6819","nonce":569448355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6823","nonce":569448355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":569448355},{"type":"v1","addr":"172.21.15.70:6821","nonce":569448355}]},"public_addr":"172.21.15.70:6817/569448355","cluster_addr":"172.21.15.70:6819/569448355","heartbeat_back_addr":"172.21.15.70:6823/569448355","heartbeat_front_addr":"172.21.15.70:6821/569448355","state":["exists","up"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6809","nonce":720689704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6811","nonce":720689704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6815","nonce":720689704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":720689704},{"type":"v1","addr":"172.21.15.70:6813","nonce":720689704}]},"public_addr":"172.21.15.70:6809/720689704","cluster_addr":"172.21.15.70:6811/720689704","heartbeat_back_addr":"172.21.15.70:6815/720689704","heartbeat_front_addr":"172.21.15.70:6813/720689704","state":["exists","up"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6801","nonce":2301707714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6803","nonce":2301707714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6807","nonce":2301707714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6805","nonce":2301707714}]},"public_addr":"172.21.15.70:6801/2301707714","cluster_addr":"172.21.15.70:6803/2301707714","heartbeat_back_addr":"172.21.15.70:6807/2301707714","heartbeat_front_addr":"172.21.15.70:6805/2301707714","state":["exists","up"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6809","nonce":2043476445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6811","nonce":2043476445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6815","nonce":2043476445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6813","nonce":2043476445}]},"public_addr":"172.21.15.194:6809/2043476445","cluster_addr":"172.21.15.194:6811/2043476445","heartbeat_back_addr":"172.21.15.194:6815/2043476445","heartbeat_front_addr":"172.21.15.194:6813/2043476445","state":["exists","up"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6817","nonce":213940923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6819","nonce":213940923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6823","nonce":213940923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6821","nonce":213940923}]},"public_addr":"172.21.15.194:6817/213940923","cluster_addr":"172.21.15.194:6819/213940923","heartbeat_back_addr":"172.21.15.194:6823/213940923","heartbeat_front_addr":"172.21.15.194:6821/213940923","state":["exists","up"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6825","nonce":3016223649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6827","nonce":3016223649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6831","nonce":3016223649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6829","nonce":3016223649}]},"public_addr":"172.21.15.194:6825/3016223649","cluster_addr":"172.21.15.194:6827/3016223649","heartbeat_back_addr":"172.21.15.194:6831/3016223649","heartbeat_front_addr":"172.21.15.194:6829/3016223649","state":["exists","up"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6801","nonce":2361511015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6803","nonce":2361511015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6807","nonce":2361511015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6805","nonce":2361511015}]},"public_addr":"172.21.15.194:6801/2361511015","cluster_addr":"172.21.15.194:6803/2361511015","heartbeat_back_addr":"172.21.15.194:6807/2361511015","heartbeat_front_addr":"172.21.15.194:6805/2361511015","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.852226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.638877+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.930981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.677178+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.636635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.104700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.150845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.365417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:17:02.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T06:17:02.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T06:17:02.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T06:17:02.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T06:17:02.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T06:17:02.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T06:17:02.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T06:17:02.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T06:17:02.795 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:02.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T06:17:02.809 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T06:17:02.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T06:17:02.810 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:02.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T06:17:02.811 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:02.811 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:02.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T06:17:02.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T06:17:02.814 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:02.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T06:17:02.815 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-11T06:17:02.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T06:17:02.820 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:02.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T06:17:03.382 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-09-11T06:17:03.400 INFO:teuthology.orchestra.run.smithi070.stdout:60129542147 2024-09-11T06:17:03.400 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-09-11T06:17:03.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-11T06:17:03.402 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-09-11T06:17:03.413 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-09-11T06:17:03.413 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-09-11T06:17:03.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-09-11T06:17:03.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.4 2024-09-11T06:17:03.423 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2024-09-11T06:17:03.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-11T06:17:03.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-11T06:17:03.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-11T06:17:03.436 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-09-11T06:17:03.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-09-11T06:17:03.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-11T06:17:04.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T06:17:04.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T06:17:04.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T06:17:04.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T06:17:04.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T06:17:04.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T06:17:04.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T06:17:04.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T06:17:04.970 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:04.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-09-11T06:17:04.989 DEBUG:teuthology.parallel:result is None 2024-09-11T06:17:05.015 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-11T06:17:05.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-09-11T06:17:05.029 DEBUG:teuthology.parallel:result is None 2024-09-11T06:17:05.036 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:05.044 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:05.048 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:05.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.4 2024-09-11T06:17:05.051 DEBUG:teuthology.parallel:result is None 2024-09-11T06:17:05.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-11T06:17:05.060 DEBUG:teuthology.parallel:result is None 2024-09-11T06:17:05.060 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2024-09-11T06:17:05.064 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:05.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-09-11T06:17:05.068 DEBUG:teuthology.parallel:result is None 2024-09-11T06:17:05.074 INFO:teuthology.orchestra.run.smithi070.stdout:64424509445 2024-09-11T06:17:05.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-09-11T06:17:05.079 DEBUG:teuthology.parallel:result is None 2024-09-11T06:17:05.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-11T06:17:05.082 DEBUG:teuthology.parallel:result is None 2024-09-11T06:17:05.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-11T06:17:05.088 DEBUG:teuthology.parallel:result is None 2024-09-11T06:17:05.089 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T06:17:05.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:05.404 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:05.416 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-11T06:17:05.085681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234712,"kb_used_data":1812,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740008,"statfs":{"total":773094113280,"available":772853768192,"internally_reserved":0,"allocated":1855488,"data_stored":1761662,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.470842"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627923+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:01.627923+0000","last_peered":"2024-09-11T06:17:01.627923+0000","last_clean":"2024-09-11T06:17:01.627923+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:01.627923+0000","last_undegraded":"2024-09-11T06:17:01.627923+0000","last_fullsized":"2024-09-11T06:17:01.627923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627002+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:01.627002+0000","last_peered":"2024-09-11T06:17:01.627002+0000","last_clean":"2024-09-11T06:17:01.627002+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:01.627002+0000","last_undegraded":"2024-09-11T06:17:01.627002+0000","last_fullsized":"2024-09-11T06:17:01.627002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627167+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:01.627167+0000","last_peered":"2024-09-11T06:17:01.627167+0000","last_clean":"2024-09-11T06:17:01.627167+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:01.627167+0000","last_undegraded":"2024-09-11T06:17:01.627167+0000","last_fullsized":"2024-09-11T06:17:01.627167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.971289+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:01.971289+0000","last_peered":"2024-09-11T06:17:01.971289+0000","last_clean":"2024-09-11T06:17:01.971289+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:01.971289+0000","last_undegraded":"2024-09-11T06:17:01.971289+0000","last_fullsized":"2024-09-11T06:17:01.971289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.629926+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:01.629926+0000","last_peered":"2024-09-11T06:17:01.629926+0000","last_clean":"2024-09-11T06:17:01.629926+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:01.629926+0000","last_undegraded":"2024-09-11T06:17:01.629926+0000","last_fullsized":"2024-09-11T06:17:01.629926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:02.030090+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:02.030090+0000","last_peered":"2024-09-11T06:17:02.030090+0000","last_clean":"2024-09-11T06:17:02.030090+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:02.030090+0000","last_undegraded":"2024-09-11T06:17:02.030090+0000","last_fullsized":"2024-09-11T06:17:02.030090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627586+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:01.627586+0000","last_peered":"2024-09-11T06:17:01.627586+0000","last_clean":"2024-09-11T06:17:01.627586+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:01.627586+0000","last_undegraded":"2024-09-11T06:17:01.627586+0000","last_fullsized":"2024-09-11T06:17:01.627586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627558+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:01.627558+0000","last_peered":"2024-09-11T06:17:01.627558+0000","last_clean":"2024-09-11T06:17:01.627558+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:01.627558+0000","last_undegraded":"2024-09-11T06:17:01.627558+0000","last_fullsized":"2024-09-11T06:17:01.627558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.626083+0000","last_change":"2024-09-11T06:16:53.499469+0000","last_active":"2024-09-11T06:17:01.626083+0000","last_peered":"2024-09-11T06:17:01.626083+0000","last_clean":"2024-09-11T06:17:01.626083+0000","last_became_active":"2024-09-11T06:16:53.498584+0000","last_became_peered":"2024-09-11T06:16:53.498584+0000","last_unstale":"2024-09-11T06:17:01.626083+0000","last_undegraded":"2024-09-11T06:17:01.626083+0000","last_fullsized":"2024-09-11T06:17:01.626083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:54.729518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":659334,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":665166,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:05.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:05.704 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-11T06:17:05.085681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234712,"kb_used_data":1812,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740008,"statfs":{"total":773094113280,"available":772853768192,"internally_reserved":0,"allocated":1855488,"data_stored":1761662,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.470842"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627923+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:01.627923+0000","last_peered":"2024-09-11T06:17:01.627923+0000","last_clean":"2024-09-11T06:17:01.627923+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:01.627923+0000","last_undegraded":"2024-09-11T06:17:01.627923+0000","last_fullsized":"2024-09-11T06:17:01.627923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627002+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:01.627002+0000","last_peered":"2024-09-11T06:17:01.627002+0000","last_clean":"2024-09-11T06:17:01.627002+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:01.627002+0000","last_undegraded":"2024-09-11T06:17:01.627002+0000","last_fullsized":"2024-09-11T06:17:01.627002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627167+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:01.627167+0000","last_peered":"2024-09-11T06:17:01.627167+0000","last_clean":"2024-09-11T06:17:01.627167+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:01.627167+0000","last_undegraded":"2024-09-11T06:17:01.627167+0000","last_fullsized":"2024-09-11T06:17:01.627167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.971289+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:01.971289+0000","last_peered":"2024-09-11T06:17:01.971289+0000","last_clean":"2024-09-11T06:17:01.971289+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:01.971289+0000","last_undegraded":"2024-09-11T06:17:01.971289+0000","last_fullsized":"2024-09-11T06:17:01.971289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.629926+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:01.629926+0000","last_peered":"2024-09-11T06:17:01.629926+0000","last_clean":"2024-09-11T06:17:01.629926+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:01.629926+0000","last_undegraded":"2024-09-11T06:17:01.629926+0000","last_fullsized":"2024-09-11T06:17:01.629926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:02.030090+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:02.030090+0000","last_peered":"2024-09-11T06:17:02.030090+0000","last_clean":"2024-09-11T06:17:02.030090+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:02.030090+0000","last_undegraded":"2024-09-11T06:17:02.030090+0000","last_fullsized":"2024-09-11T06:17:02.030090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627586+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:01.627586+0000","last_peered":"2024-09-11T06:17:01.627586+0000","last_clean":"2024-09-11T06:17:01.627586+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:01.627586+0000","last_undegraded":"2024-09-11T06:17:01.627586+0000","last_fullsized":"2024-09-11T06:17:01.627586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627558+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:01.627558+0000","last_peered":"2024-09-11T06:17:01.627558+0000","last_clean":"2024-09-11T06:17:01.627558+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:01.627558+0000","last_undegraded":"2024-09-11T06:17:01.627558+0000","last_fullsized":"2024-09-11T06:17:01.627558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.626083+0000","last_change":"2024-09-11T06:16:53.499469+0000","last_active":"2024-09-11T06:17:01.626083+0000","last_peered":"2024-09-11T06:17:01.626083+0000","last_clean":"2024-09-11T06:17:01.626083+0000","last_became_active":"2024-09-11T06:16:53.498584+0000","last_became_peered":"2024-09-11T06:16:53.498584+0000","last_unstale":"2024-09-11T06:17:01.626083+0000","last_undegraded":"2024-09-11T06:17:01.626083+0000","last_fullsized":"2024-09-11T06:17:01.626083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:54.729518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":659334,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":665166,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:05.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T06:17:05.705 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T06:17:05.705 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T06:17:05.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T06:17:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:06.020 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T06:17:06.031 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T06:17:06.031 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-11T06:17:06.041 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-11T06:17:06.041 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}} 2024-09-11T06:17:06.041 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-11T06:17:06.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-11T06:17:06.337 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-11T06:17:06.337 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T06:17:06.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:06.612 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:06.612 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:06.624 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T06:17:06.417614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234712,"kb_used_data":1812,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740008,"statfs":{"total":773094113280,"available":772853768192,"internally_reserved":0,"allocated":1855488,"data_stored":1761662,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001099"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627923+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:01.627923+0000","last_peered":"2024-09-11T06:17:01.627923+0000","last_clean":"2024-09-11T06:17:01.627923+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:01.627923+0000","last_undegraded":"2024-09-11T06:17:01.627923+0000","last_fullsized":"2024-09-11T06:17:01.627923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627002+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:01.627002+0000","last_peered":"2024-09-11T06:17:01.627002+0000","last_clean":"2024-09-11T06:17:01.627002+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:01.627002+0000","last_undegraded":"2024-09-11T06:17:01.627002+0000","last_fullsized":"2024-09-11T06:17:01.627002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627167+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:01.627167+0000","last_peered":"2024-09-11T06:17:01.627167+0000","last_clean":"2024-09-11T06:17:01.627167+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:01.627167+0000","last_undegraded":"2024-09-11T06:17:01.627167+0000","last_fullsized":"2024-09-11T06:17:01.627167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.971289+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:01.971289+0000","last_peered":"2024-09-11T06:17:01.971289+0000","last_clean":"2024-09-11T06:17:01.971289+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:01.971289+0000","last_undegraded":"2024-09-11T06:17:01.971289+0000","last_fullsized":"2024-09-11T06:17:01.971289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.629926+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:01.629926+0000","last_peered":"2024-09-11T06:17:01.629926+0000","last_clean":"2024-09-11T06:17:01.629926+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:01.629926+0000","last_undegraded":"2024-09-11T06:17:01.629926+0000","last_fullsized":"2024-09-11T06:17:01.629926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:02.030090+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:02.030090+0000","last_peered":"2024-09-11T06:17:02.030090+0000","last_clean":"2024-09-11T06:17:02.030090+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:02.030090+0000","last_undegraded":"2024-09-11T06:17:02.030090+0000","last_fullsized":"2024-09-11T06:17:02.030090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627586+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:01.627586+0000","last_peered":"2024-09-11T06:17:01.627586+0000","last_clean":"2024-09-11T06:17:01.627586+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:01.627586+0000","last_undegraded":"2024-09-11T06:17:01.627586+0000","last_fullsized":"2024-09-11T06:17:01.627586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627558+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:01.627558+0000","last_peered":"2024-09-11T06:17:01.627558+0000","last_clean":"2024-09-11T06:17:01.627558+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:01.627558+0000","last_undegraded":"2024-09-11T06:17:01.627558+0000","last_fullsized":"2024-09-11T06:17:01.627558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.626083+0000","last_change":"2024-09-11T06:16:53.499469+0000","last_active":"2024-09-11T06:17:01.626083+0000","last_peered":"2024-09-11T06:17:01.626083+0000","last_clean":"2024-09-11T06:17:01.626083+0000","last_became_active":"2024-09-11T06:16:53.498584+0000","last_became_peered":"2024-09-11T06:16:53.498584+0000","last_unstale":"2024-09-11T06:17:01.626083+0000","last_undegraded":"2024-09-11T06:17:01.626083+0000","last_fullsized":"2024-09-11T06:17:01.626083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:54.729518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":659334,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":665166,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:06.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:06.898 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:06.899 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:06.910 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T06:17:06.417614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234712,"kb_used_data":1812,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740008,"statfs":{"total":773094113280,"available":772853768192,"internally_reserved":0,"allocated":1855488,"data_stored":1761662,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001099"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627923+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:01.627923+0000","last_peered":"2024-09-11T06:17:01.627923+0000","last_clean":"2024-09-11T06:17:01.627923+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:01.627923+0000","last_undegraded":"2024-09-11T06:17:01.627923+0000","last_fullsized":"2024-09-11T06:17:01.627923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627002+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:01.627002+0000","last_peered":"2024-09-11T06:17:01.627002+0000","last_clean":"2024-09-11T06:17:01.627002+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:01.627002+0000","last_undegraded":"2024-09-11T06:17:01.627002+0000","last_fullsized":"2024-09-11T06:17:01.627002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627167+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:01.627167+0000","last_peered":"2024-09-11T06:17:01.627167+0000","last_clean":"2024-09-11T06:17:01.627167+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:01.627167+0000","last_undegraded":"2024-09-11T06:17:01.627167+0000","last_fullsized":"2024-09-11T06:17:01.627167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.971289+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:01.971289+0000","last_peered":"2024-09-11T06:17:01.971289+0000","last_clean":"2024-09-11T06:17:01.971289+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:01.971289+0000","last_undegraded":"2024-09-11T06:17:01.971289+0000","last_fullsized":"2024-09-11T06:17:01.971289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.629926+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:01.629926+0000","last_peered":"2024-09-11T06:17:01.629926+0000","last_clean":"2024-09-11T06:17:01.629926+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:01.629926+0000","last_undegraded":"2024-09-11T06:17:01.629926+0000","last_fullsized":"2024-09-11T06:17:01.629926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:02.030090+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:02.030090+0000","last_peered":"2024-09-11T06:17:02.030090+0000","last_clean":"2024-09-11T06:17:02.030090+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:02.030090+0000","last_undegraded":"2024-09-11T06:17:02.030090+0000","last_fullsized":"2024-09-11T06:17:02.030090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627586+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:01.627586+0000","last_peered":"2024-09-11T06:17:01.627586+0000","last_clean":"2024-09-11T06:17:01.627586+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:01.627586+0000","last_undegraded":"2024-09-11T06:17:01.627586+0000","last_fullsized":"2024-09-11T06:17:01.627586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.627558+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:01.627558+0000","last_peered":"2024-09-11T06:17:01.627558+0000","last_clean":"2024-09-11T06:17:01.627558+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:01.627558+0000","last_undegraded":"2024-09-11T06:17:01.627558+0000","last_fullsized":"2024-09-11T06:17:01.627558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T06:17:01.626083+0000","last_change":"2024-09-11T06:16:53.499469+0000","last_active":"2024-09-11T06:17:01.626083+0000","last_peered":"2024-09-11T06:17:01.626083+0000","last_clean":"2024-09-11T06:17:01.626083+0000","last_became_active":"2024-09-11T06:16:53.498584+0000","last_became_peered":"2024-09-11T06:16:53.498584+0000","last_unstale":"2024-09-11T06:17:01.626083+0000","last_undegraded":"2024-09-11T06:17:01.626083+0000","last_fullsized":"2024-09-11T06:17:01.626083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:54.729518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":659334,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":665166,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:06.911 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T06:17:06.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-11T06:17:07.185 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 23 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 7a868aca-1727-4b78-b18f-580564f1ab22 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-11T06:16:40.301387+0000 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-11T06:17:05.084199+0000 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 5 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client jewel 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-09-11T06:17:07.186 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 4.98 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 8 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6824/2621452558,v1:172.21.15.70:6825/2621452558] [v2:172.21.15.70:6826/2621452558,v1:172.21.15.70:6827/2621452558] exists,up dba31bd4-e78d-407b-b639-5bb5104f3693 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 15 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6816/569448355,v1:172.21.15.70:6817/569448355] [v2:172.21.15.70:6818/569448355,v1:172.21.15.70:6819/569448355] exists,up 7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6808/720689704,v1:172.21.15.70:6809/720689704] [v2:172.21.15.70:6810/720689704,v1:172.21.15.70:6811/720689704] exists,up 1c946778-5c51-4d07-94a2-ada9d70d1bba 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 15 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/2301707714,v1:172.21.15.70:6801/2301707714] [v2:172.21.15.70:6802/2301707714,v1:172.21.15.70:6803/2301707714] exists,up 1833d4e7-d511-4086-bbde-e7822ec6c1f3 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 15 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/2043476445,v1:172.21.15.194:6809/2043476445] [v2:172.21.15.194:6810/2043476445,v1:172.21.15.194:6811/2043476445] exists,up 28e56042-c64d-4193-be5b-752137116220 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 15 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/213940923,v1:172.21.15.194:6817/213940923] [v2:172.21.15.194:6818/213940923,v1:172.21.15.194:6819/213940923] exists,up 80e06445-79b9-4069-851a-b5f63a882000 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/3016223649,v1:172.21.15.194:6825/3016223649] [v2:172.21.15.194:6826/3016223649,v1:172.21.15.194:6827/3016223649] exists,up 05e46d6f-c759-41f4-bfd4-9514c0bd73fb 2024-09-11T06:17:07.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 13 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/2361511015,v1:172.21.15.194:6801/2361511015] [v2:172.21.15.194:6802/2361511015,v1:172.21.15.194:6803/2361511015] exists,up 26bcdc28-2387-4117-9005-399f68fc0439 2024-09-11T06:17:07.198 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6824/2621452558,v1:172.21.15.70:6825/2621452558] [v2:172.21.15.70:6826/2621452558,v1:172.21.15.70:6827/2621452558] exists,up dba31bd4-e78d-407b-b639-5bb5104f3693', 'osd.1 up in weight 1 up_from 15 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6816/569448355,v1:172.21.15.70:6817/569448355] [v2:172.21.15.70:6818/569448355,v1:172.21.15.70:6819/569448355] exists,up 7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6808/720689704,v1:172.21.15.70:6809/720689704] [v2:172.21.15.70:6810/720689704,v1:172.21.15.70:6811/720689704] exists,up 1c946778-5c51-4d07-94a2-ada9d70d1bba', 'osd.3 up in weight 1 up_from 15 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/2301707714,v1:172.21.15.70:6801/2301707714] [v2:172.21.15.70:6802/2301707714,v1:172.21.15.70:6803/2301707714] exists,up 1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'osd.4 up in weight 1 up_from 15 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/2043476445,v1:172.21.15.194:6809/2043476445] [v2:172.21.15.194:6810/2043476445,v1:172.21.15.194:6811/2043476445] exists,up 28e56042-c64d-4193-be5b-752137116220', 'osd.5 up in weight 1 up_from 15 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/213940923,v1:172.21.15.194:6817/213940923] [v2:172.21.15.194:6818/213940923,v1:172.21.15.194:6819/213940923] exists,up 80e06445-79b9-4069-851a-b5f63a882000', 'osd.6 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/3016223649,v1:172.21.15.194:6825/3016223649] [v2:172.21.15.194:6826/3016223649,v1:172.21.15.194:6827/3016223649] exists,up 05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'osd.7 up in weight 1 up_from 13 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/2361511015,v1:172.21.15.194:6801/2361511015] [v2:172.21.15.194:6802/2361511015,v1:172.21.15.194:6803/2361511015] exists,up 26bcdc28-2387-4117-9005-399f68fc0439'] 2024-09-11T06:17:07.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-11T06:17:07.296 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mon.a", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster": "ceph", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket_mode": "", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_client_required": "cephx, none", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_cluster_required": "cephx", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_debug": "true", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-11T06:17:07.297 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_required": "cephx", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_supported": "cephx", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio": "true", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_poll_ms": "250", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_reap_max": "16", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_async_discard": "false", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_block_size": "4096", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio": "false", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-11T06:17:07.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_inflight_ios": "false", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_enable_discard": "false", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry": "3", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash": "0", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring": "false", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_hipri": "false", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-11T06:17:07.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_type": "", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_alloc_size": "1048576", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_allocator": "hybrid", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_buffered_io": "true", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_for_zeros": "false", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_compact_log_sync": "false", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_log_runway": "4194304", 2024-09-11T06:17:07.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_prefetch": "1048576", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_flush_size": "524288", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_log_runway": "1048576", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery": "false", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_sync_write": "false", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocation_from_file": "true", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocator": "hybrid", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-11T06:17:07.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_multi": "true", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_create": "true", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_create": "false", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_path": "", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_size": "0", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_path": "", 2024-09-11T06:17:07.302 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_preallocate_file": "false", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_size": "107374182400", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_create": "false", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_path": "", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_size": "100663296", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs": "true", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-11T06:17:07.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune": "true", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size": "0", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_type": "2q", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-11T06:17:07.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_clone_cow": "true", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_mode": "none", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_csum_type": "crc32c", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_freelist": "false", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-11T06:17:07.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_small_allocations": "0", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-11T06:17:07.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_read": "true", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_write": "false", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fail_eio": "false", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-11T06:17:07.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount": "false", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount": "false", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-11T06:17:07.308 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_ignore_data_csum": "false", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_op_age": "5.000000", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_alloc_size": "0", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size": "0", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_deferred_txc": "32", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size": "0", 2024-09-11T06:17:07.309 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_nid_prealloc": "1024", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_retry_disk_reads": "3", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cf": "true", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-11T06:17:07.310 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_mem": "512", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_tracing": "false", 2024-09-11T06:17:07.311 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_zero_block_detection": "false", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-11T06:17:07.312 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_signatures": "false", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_version": "2", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_signatures": "false", 2024-09-11T06:17:07.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_version": "2", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_signatures": "false", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_version": "2", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_sign_messages": "true", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "chdir": "", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_acl_type": "", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_asio_thread_count": "2", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_mid": "0.750000", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_size": "16384", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_caps_release_delay": "5", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_check_pool_perm": "true", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_force_sync_read": "false", 2024-09-11T06:17:07.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_getattr_caps": "false", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_features": "", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_tick_delay": "0", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_remount": "false", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_dirsize_rbytes": "true", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_force_lazyio": "false", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_fs": "", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_release_failure": "false", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_inline_size": "4096", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mds_namespace": "", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_metadata": "", 2024-09-11T06:17:07.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_gid": "-1", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_timeout": "300", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_uid": "-1", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mountpoint": "/", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_notify_timeout": "10", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc": "true", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty": "104857600", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_objects": "1000", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_size": "209715200", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_target_dirty": "8388608", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_permissions": "true", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota": "true", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota_df": "true", 2024-09-11T06:17:07.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_bytes": "0", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_periods": "4", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_min": "131072", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_reconnect_stale": "false", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_shutdown_timeout": "30", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_snapdir": ".snap", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_tick_interval": "1", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_trace": "", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_try_dentry_invalidate": "false", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_faked_inos": "false", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_random_mds": "false", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog": "false", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-11T06:17:07.317 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_port": "12201", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_monitors": "default=true", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog": "false", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_level": "info", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "-", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network": "", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network_interface": "", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_isal": "false", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_level": "5", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_winsize": "-15", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zstd_level": "1", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-11T06:17:07.318 INFO:teuthology.orchestra.run.smithi070.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_op_num_threads": "6", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_stat_interval": "0", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_cpu_cores": "", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_num_threads": "0", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location": "", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook": "", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook_timeout": "10", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "daemonize": "false", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "daos_pool": "tank", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-11T06:17:07.319 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_alienstore": "0/5", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_allow_any_pool_priority": "false", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok": "1/5", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok_assert_abort": "false", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asserts_on_shutdown": "true", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_auth": "20/20", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bdev": "1/3", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluefs": "1/5", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluestore": "1/5", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_buffer": "0/1", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ceph_exporter": "1/5", 2024-09-11T06:17:07.320 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephfs_mirror": "0/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephsqlite": "0/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_client": "0/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_compressor": "1/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_context": "0/1", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crimson_interrupt": "0/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crush": "1/1", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crypto": "1/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cyanstore": "0/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_deliberately_leak_memory": "false", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_disable_randomized_ping": "false", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_dpdk": "1/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_eventtrace": "1/5", 2024-09-11T06:17:07.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filer": "0/1", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filestore": "1/3", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_finisher": "1/1", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_fuse": "1/5", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeat_testing_span": "0", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeatmap": "1/5", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_javaclient": "1/5", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journal": "1/3", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journaler": "0/5", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_kstore": "1/5", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_lockdep": "0/1", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mclock": "1/5", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds": "1/5", 2024-09-11T06:17:07.322 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_balancer": "1/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_locker": "1/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log": "1/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log_expire": "1/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_migrator": "1/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_quiesce": "3/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_memstore": "1/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgr": "2/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgrc": "1/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mon": "20/20", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_monc": "0/10", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ms": "1/1", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_none": "0/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objclass": "0/5", 2024-09-11T06:17:07.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objectcacher": "0/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objecter": "0/1", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_optracker": "0/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_osd": "1/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_paxos": "20/20", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_perfcounter": "1/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_prioritycache": "1/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rados": "0/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd": "0/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_mirror": "0/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_pwl": "0/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_replay": "0/5", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_refs": "0/0", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_reserver": "1/1", 2024-09-11T06:17:07.324 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw": "1/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_access": "1/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_datacache": "1/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_dbstore": "1/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_flight": "1/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_sync": "1/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rocksdb": "4/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore": "0/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_backref": "0/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cache": "0/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cleaner": "0/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_device": "0/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_epm": "0/5", 2024-09-11T06:17:07.325 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_journal": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_lba": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_odata": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_omap": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_onode": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_t": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_tm": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_striper": "0/1", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_test": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_throttle": "1/1", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_timer": "0/1", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_tp": "0/5", 2024-09-11T06:17:07.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_trace": "1/5", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "device_failure_prediction_mode": "none", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_graylog": "false", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_journald": "false", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_stderr": "true", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_syslog": "false", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event_tracing": "false", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_addr": "0.0.0.0", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_http_port": "9926", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_prio_limit": "5", 2024-09-11T06:17:07.327 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sort_metrics": "true", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_stats_period": "5", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "fake_statfs_for_testing": "0", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "fatal_signal_handlers": "true", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_purge_ops": "10", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_truncate_ops": "128", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_apply_finisher_threads": "1", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_blackhole": "false", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_clone_range": "true", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_snap": "true", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_caller_concurrency": "10", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_collect_device_partition_information": "true", 2024-09-11T06:17:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_commit_timeout": "600.000000", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_inject_read_err": "false", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_omap_check": "false", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_verify_split": "false", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_dump_file": "", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fadvise": "true", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fail_eio": "true", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_shards": "16", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_size": "128", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap": "false", 2024-09-11T06:17:07.329 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap_threshold": "4096", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_inject_stall": "0", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_parallel": "false", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_trailing": "false", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_writeahead": "false", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_kill_at": "0", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs": "0", 2024-09-11T06:17:07.330 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size": "0", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_merge_threshold": "-10", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_odsync_write": "false", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend": "rocksdb", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend_path": "", 2024-09-11T06:17:07.331 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_timeout": "60", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_threads": "2", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_punch_hole": "false", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-11T06:17:07.332 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_ops": "50", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_seek_data_hole": "false", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc": "false", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_splice": "false", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_multiple": "2", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_rand_factor": "20", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_update_to": "1000", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-11T06:17:07.333 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_enable": "true", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_xfs_extsize": "false", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_zfs_snap": "false", 2024-09-11T06:17:07.334 INFO:teuthology.orchestra.run.smithi070.stdout: "fio_dir": "/tmp/fio", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_allow_other": "true", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_atomic_o_trunc": "true", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_big_writes": "true", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_debug": "false", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_default_permissions": "false", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_disable_pagecache": "false", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_max_write": "0", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_multithreaded": "true", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_require_active_mds": "true", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_set_user_groups": "true", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_move": "true", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_read": "true", 2024-09-11T06:17:07.335 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_write": "true", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_use_invalidate_cb": "true", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_target_name": "ceph", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_file": "", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_inject_failure": "0", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_interval": "5", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "host": "smithi070", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-11T06:17:07.336 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "inject_early_sigterm": "false", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_agent_port": "6799", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_tracing_enable": "false", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_aio": "true", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_align_min_size": "65536", 2024-09-11T06:17:07.337 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_align": "true", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_size": "4096", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_dio": "true", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_discard": "false", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_force_aio": "false", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_ignore_corruption": "false", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_bytes": "10485760", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_entries": "100", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_replay_from": "0", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_write_header_frequency": "0", 2024-09-11T06:17:07.338 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_zero_on_create": "false", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prefetch_periods": "10", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prezero_periods": "5", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_write_head_interval": "15", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "keyfile": "", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_backend": "rocksdb", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_default_stripe_size": "65536", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount": "false", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_bytes": "67108864", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_ops": "512", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_nid_prealloc": "1024", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_onode_map_size": "1024", 2024-09-11T06:17:07.339 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_submit_transaction": "false", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_transaction": "false", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "librados_thread_count": "2", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep": "false", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep_force_backtrace": "false", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_coarse_timestamps": "true", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_flush_on_exit": "false", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_host": "127.0.0.1", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_port": "12201", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_new": "1000", 2024-09-11T06:17:07.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_recent": "10000", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stderr_prefix": "", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stop_at_utilization": "0.970000", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": "true", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_graylog": "false", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_journald": "false", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_stderr": "false", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_syslog": "false", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "max_rotating_auth_attempts": "10", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_action_on_write_error": "1", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_alternate_name_max": "8192", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_asio_thread_count": "2", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_export_pin": "true", 2024-09-11T06:17:07.341 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_dirs": "true", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_interval": "5", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_interval": "10", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max": "-1", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max_until": "-1", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_merge_size": "50", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_midchunk": "0.300000", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_start": "0.200000", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_minchunk": "0.001000", 2024-09-11T06:17:07.342 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_mode": "0", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_max": "1.200000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_min": "0.800000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_overload_epochs": "2", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_bits": "3", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_size": "10000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_target_decay": "10.000000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_grace": "15.000000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_interval": "4.000000", 2024-09-11T06:17:07.343 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_mid": "0.700000", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_delay": "0", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_release_free_interval": "10", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_reservation": "0.050000", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_interval": "1", 2024-09-11T06:17:07.344 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_threshold": "262144", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_prealloc_inos": "1000", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_connect_bootstrapping": "false", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_damage_table_max_entries": "10000", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_auth_pins": "false", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_frag": "false", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_scatterstat": "false", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_subtrees": "false", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_decay_halflife": "5.000000", 2024-09-11T06:17:07.345 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_default_dir_hash": "2", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_defer_session_stale": "true", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_deny_all_reconnect": "false", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_keys_per_op": "16384", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_commit_size": "10", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_entries": "0", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_prefetch": "true", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_on_map": "false", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_early_reply": "true", 2024-09-11T06:17:07.346 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enable_op_tracker": "true", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enforce_unique_name": "true", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random": "true", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_summarize_threshold": "10", 2024-09-11T06:17:07.347 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_health_dummy": "false", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_migrator_session_race": "false", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_join_fs": "", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_journal_format": "1", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_create_at": "0", 2024-09-11T06:17:07.348 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_export_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_import_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_expire_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_replay_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_link_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_mdstable_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_openc_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_rename_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_shutdown_at": "0", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_event_large_threshold": "524288", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_events_per_segment": "1024", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_events": "-1", 2024-09-11T06:17:07.349 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_segments": "128", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_pause": "false", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_segment_size": "0", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_threshold": "128", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_warn_factor": "2.000000", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_caps_per_client": "1048576", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_flushes": "100000", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_requests": "100000", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_export_size": "20971520", 2024-09-11T06:17:07.350 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_file_recover": "32", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_files": "64", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops": "8192", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_snaps_per_dir": "100", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_metrics_update_interval": "2", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_per_client": "100", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_working_set": "10000", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_numa_node": "-1", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_complaint_time": "30.000000", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_duration": "600", 2024-09-11T06:17:07.351 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_size": "20", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_slow_op_size": "20", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_log_threshold": "5", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_grace": "15", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_interval": "5", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_caps": "30000", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_threshold": "262144", 2024-09-11T06:17:07.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_interval": "1.000000", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_gid": "0", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_uid": "0", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-11T06:17:07.353 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_shutdown_check": "0", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_skip_ino": "0", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_max_uid": "4294967294", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_min_uid": "0", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_rstat": "false", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_standby_replay_damaged": "false", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_symlink_recovery": "true", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_exports": "0", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_fragments": "0", 2024-09-11T06:17:07.354 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_tick_interval": "5.000000", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_valgrind_exit": "false", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_backtrace": "1", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_scatter": "false", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_sessions": "false", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool_debug": "false", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_device_bytes": "1073741824", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_set": "false", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_size": "65536", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_bytes": "134217728", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_messages": "512", 2024-09-11T06:17:07.355 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_disabled_modules": "", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_enable_op_tracker": "true", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_max_pg_num_change": "128", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_bytes": "134217728", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_messages": "128", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_bytes": "134217728", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_messages": "128", 2024-09-11T06:17:07.356 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_duration": "600", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_size": "20", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_log_threshold": "5", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_bytes": "536870912", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_messages": "8192", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_pool": "true", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_standby_modules": "true", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_period": "5", 2024-09-11T06:17:07.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_threshold": "5", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_tick_period": "2", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_delete": "true", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_size_one": "true", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_auth_validate_all_caps": "true", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_bytes": "104857600", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_directed_command_retry": "5", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-11T06:17:07.358 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_parallel": "3", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_log_interval": "1.000000", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_interval": "10.000000", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_target_rank": "-1", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file_level": "debug", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_file": "true", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-11T06:17:07.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_journald": "false", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_bootstrap": "false", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_start": "false", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_trim": "true", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-11T06:17:07.360 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cpu_threads": "4", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_crush_min_required_version": "hammer", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_daemon_bytes": "419430400", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_crit": "5", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_warn": "5", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_size_warn": "16106127360", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_json": "false", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_transactions": "false", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_extra_checks": "false", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-11T06:17:07.361 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_reef": "false", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_squid": "false", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_mkfs_grace": "120", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_uptime_grace": "60", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_default_strategy": "1", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_timeout": "5.000000", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_divisor": "2", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-11T06:17:07.362 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_enable_op_tracker": "true", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fake_pool_delete": "false", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_force_quorum_join": "false", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_globalid_prealloc": "10000", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_detail_to_clog": "false", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_log_update_period": "5", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_max_detail": "50", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog": "true", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_interval": "600", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host": "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.194", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host_override": "", 2024-09-11T06:17:07.363 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_initial_members": "", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease": "5.000000", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_full_interval": "50", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max": "10000", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max_summary": "50", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-11T06:17:07.364 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_epochs": "500", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_osd": "10000", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pg_per_osd": "10000", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pool_pg_num": "65536", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_force_trim_to": "0", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_skip_sanity": "false", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_autotune": "true", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_target": "2147483648", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_beacon_grace": "30", 2024-09-11T06:17:07.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_digest_period": "5", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_inactive_grace": "60", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_min_osdmap_epochs": "500", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_complaint_time": "30", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_duration": "600", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_size": "20", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_size": "20", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_log_threshold": "5", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-11T06:17:07.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_in": "false", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size": "500", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_interval": "600", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_force_trim_to": "0", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-11T06:17:07.367 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_down_reporters": "2", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-11T06:17:07.368 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_report_timeout": "900", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_stuck_threshold": "60", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-11T06:17:07.369 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_probe_timeout": "2.000000", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_change": "0.050000", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_osds": "4", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_interval": "86400", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_max_keys": "100", 2024-09-11T06:17:07.370 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_timeout": "300", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_session_timeout": "300", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_smart_report_timeout": "5", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stat_smooth_intervals": "6", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_min_size": "2", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_size": "4", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_debug": "false", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_provider_kill_at": "0", 2024-09-11T06:17:07.371 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_requester_kill_at": "0", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_timeout": "60.000000", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_target_pg_per_osd": "100", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_tick_interval": "5", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_interval": "300.000000", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_use_min_delay_socket": "false", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_older_version_delay": "604800", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-11T06:17:07.372 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_misplaced": "false", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_older_version": "true", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-11T06:17:07.373 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "monmap": "", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_tracing_enabled": "false", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_op_threads": "3", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_cm": "false", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_device_name": "", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_dscp": "96", 2024-09-11T06:17:07.374 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_local_gid": "", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_port_num": "1", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_sl": "3", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_support_srq": "true", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_type": "ib", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_reap_threshold": "5", 2024-09-11T06:17:07.375 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_before_connect": "false", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv4": "true", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv6": "false", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr1": "true", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr2": "true", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_max": "7568", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_min": "6800", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_count": "3", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_delay": "5", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_client": "false", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mds": "false", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mgr": "false", 2024-09-11T06:17:07.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mon": "false", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_osd": "false", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_client_mode": "crc secure", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_mode": "crc secure", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_type": "", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_compress_secure": "false", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_idle_timeout": "900", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_ready_timeout": "10", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_data": "true", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_header": "true", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bad_msg": "false", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bug": "true", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_old_message": "true", 2024-09-11T06:17:07.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_skipped_message": "false", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_coremask": "0xF", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_enable_tso": "true", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hugepages": "", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_lro": "true", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_memory_channel": "4", 2024-09-11T06:17:07.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_pmd": "", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_port_id": "0", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_on_send": "false", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_initial_backoff": "0.200000", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_max": "1.000000", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_type": "", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_network_congestion": "0", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_socket_failures": "5000", 2024-09-11T06:17:07.379 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_learn_addr_from_peer": "true", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_accept_failures": "4", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_backoff": "15.000000", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_client_mode": "secure crc", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_service_mode": "secure crc", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_min_size": "1024", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_mode": "none", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_min_cost": "65536", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_public_type": "", 2024-09-11T06:17:07.380 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_service_mode": "crc secure", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_listen_backlog": "512", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_nodelay": "true", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_rcvbuf": "0", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_type": "async+posix", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "no_config_file": "false", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_completion_locks_per_session": "32", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_ops": "1024", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_tick_interval": "5.000000", 2024-09-11T06:17:07.381 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_timeout": "10.000000", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_blackhole": "false", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "openssl_engine_opts": "", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_delay_time": "5.000000", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_hist_halflife": "1000", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_low_ops": "2", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_ops": "4", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_slop": "0.020000", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_asio_thread_count": "2", 2024-09-11T06:17:07.382 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_async_recovery_min_cost": "100", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_max": "512", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_min": "64", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_degraded": "false", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_peering": "false", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_unfound": "true", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_beacon_report_interval": "300", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_duration": "30", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_max_block_size": "67108864", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-11T06:17:07.383 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blkin_trace_all": "false", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_for_log_corruption": "false", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_update_on_start": "true", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_cap": "256", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_size_cap": "524288000", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_op_priority": "63", 2024-09-11T06:17:07.384 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_watch_timeout": "30", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_command_max_records": "256", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_compact_on_start": "false", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_on_start": "true", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_weight_set": "true", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-11T06:17:07.385 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_feed_pullee": "-1", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_misdirected_ops": "false", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_acting_change": "false", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_purge_strays": "false", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_op_order": "false", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_shutdown": "false", 2024-09-11T06:17:07.386 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_trim_objects": "false", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_snaps": "false", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_keys": "1024", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_stride": "524288", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-11T06:17:07.387 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_notify_timeout": "30", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep": "0.000000", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_discard_disconnected_ops": "true", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_enable_op_tracker": "true", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_info": "true", 2024-09-11T06:17:07.388 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown": "true", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_function_tracing": "false", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_grace": "20", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_interval": "6", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_peers": "10", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_size": "2000", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_stale": "600", 2024-09-11T06:17:07.389 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_max_size": "100000", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_min_size": "1000", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_size": "5120", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_kill_backfill_at": "0", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_cache_size": "50", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_dedup": "true", 2024-09-11T06:17:07.390 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max": "40", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_share_max_epochs": "40", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_name_len": "100", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_size": "0", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_backfills": "1", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_count": "5", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_period": "600", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_name_len": "2048", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_namespace_len": "256", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_size": "134217728", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_blocked_by": "16", 2024-09-11T06:17:07.391 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_log_entries": "10000", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pgls": "1024", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_cost": "8388608", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_objects": "10", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_scrubs": "3", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_trimming_pgs": "2", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_op_reply_len": "64", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_size": "90", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-11T06:17:07.392 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_profile": "balanced", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-11T06:17:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_base": "805306368", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_min": "134217728", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target": "4294967296", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_autotune": "false", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_pg_log_entries": "250", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_recovery_priority": "0", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-11T06:17:07.394 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_interval": "5", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_cache_shards": "32", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_op_tracker_shard": "32", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_auto_affinity": "true", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_node": "-1", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_prefer_iface": "true", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objecter_finishers": "1", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore": "bluestore", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_fuse": "false", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_tracing": "false", 2024-09-11T06:17:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_complaint_time": "30.000000", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_duration": "600", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_size": "20", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_size": "20", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_log_threshold": "5", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards": "0", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_hdd": "5", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_ssd": "8", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-11T06:17:07.396 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_min_cost": "65536", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue_cut_off": "high", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_timeout": "15", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_open_classes_on_start": "true", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_os_flags": "0", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_peering_op_priority": "255", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_cost": "1048576", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_priority": "5", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-11T06:17:07.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_max": "10000", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_min": "100", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crimson": "false", 2024-09-11T06:17:07.398 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flags": "0", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_min_size": "0", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_num": "32", 2024-09-11T06:17:07.399 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pgp_num": "0", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_ratio": "70", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_size": "2", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_type": "replicated", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_push_per_object_cost": "1000", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap": "true", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_cost": "20971520", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-11T06:17:07.400 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active": "0", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_single_start": "1", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_priority": "3", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_priority": "5", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep": "0.000000", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-11T06:17:07.401 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_repair_during_recovery": "false", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_requested_scrub_priority": "120", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair": "false", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_hour": "0", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_week_day": "0", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_max": "25", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_min": "5", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_cost": "52428800", 2024-09-11T06:17:07.402 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_during_recovery": "false", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_hour": "0", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_week_day": "0", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_event_cost": "4096", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_invalid_stats": "true", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_preemptions": "5", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_priority": "5", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_sleep": "0.000000", 2024-09-11T06:17:07.403 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_skip_data_digest": "false", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_smart_report_timeout": "5", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_cost": "1048576", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_priority": "5", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-11T06:17:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_transaction_size": "30", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tracing": "false", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_use_stale_snap": "false", 2024-09-11T06:17:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "osdc_blkin_trace_all": "false", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_kill_at": "0", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_max_join_drift": "10", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min": "500", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min_wait": "0.050000", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_propose_interval": "1.000000", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max": "500", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_min": "250", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_stash_full_interval": "25", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_max": "500", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_min": "250", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "perf": "true", 2024-09-11T06:17:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "-", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrv": "", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "public_bind_addr": "-", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network": "", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network_interface": "", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_busy_polling": "false", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_enabled": "false", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_session_max_number": "256", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_mon_op_timeout": "0", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_osd_op_timeout": "0", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_tracing": "false", 2024-09-11T06:17:07.407 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_atime_update_interval": "60", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_parent_reads": "false", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_snap_reads": "false", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blkin_trace_all": "false", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache": "true", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_policy": "writearound", 2024-09-11T06:17:07.408 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_size": "33554432", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_clone_copy_on_read": "false", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_compression_hint": "none", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_concurrent_management_ops": "10", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_clone_format": "auto", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_data_pool": "", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_features": "61", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_format": "2", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_map_options": "", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_order": "22", 2024-09-11T06:17:07.409 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_pool": "rbd", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_count": "0", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_unit": "0", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_enable_alloc_hint": "true", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler": "simple", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-11T06:17:07.410 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_order": "24", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_pool": "", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_splay_width": "4", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_parent_reads": "false", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_snap_reads": "false", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-11T06:17:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-11T06:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-11T06:17:07.413 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mtime_update_interval": "60", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_non_blocking_aio": "true", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_thread_timeout": "60", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_threads": "1", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_parent_cache_enabled": "false", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_plugins": "", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst": "0", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_limit": "0", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_exclude_ops": "0", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst": "0", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-11T06:17:07.414 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_limit": "0", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-11T06:17:07.415 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_read_from_replica_policy": "default", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_skip_partial_discard": "true", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_tracing": "false", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_names": "true", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_pool": "true", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_base_url": "", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_log_level": "", 2024-09-11T06:17:07.416 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_acl_grants_max_num": "100", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_admin_entry": "admin", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_backend_store": "rados", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_barbican_url": "", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_beast_enable_async": "true", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_counters_cache": "false", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-11T06:17:07.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_enabled": "true", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_expiry_interval": "900", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_lru_size": "25000", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_config_store": "rados", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_content_length_compat": "false", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress": "true", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cors_rules_max_num": "100", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cross_domain_policy": "", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-11T06:17:07.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_addr": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_password": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_username": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_require_ssl": "true", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-11T06:17:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_addr": "", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_auth": "token", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_namespace": "", 2024-09-11T06:17:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_prefix": "", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_token_file": "", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_buffersize": "524288", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_time": "300", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-11T06:17:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_port": "6379", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_changes_size": "1000", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_num_shards": "128", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_window": "30", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-11T06:17:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-11T06:17:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_name": "", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_s3website_name": "", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dynamic_resharding": "true", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-11T06:17:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_gc_threads": "true", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_lc_threads": "true", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_ops_log": "false", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_quota_threads": "true", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_static_website": "false", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_usage_log": "false", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enforce_swift_acls": "true", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_exit_timeout_secs": "120", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_expose_bucket": "false", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_extended_http_attrs": "", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_filter": "none", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontends": "beast port=7480", 2024-09-11T06:17:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred": "50", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_objs": "32", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_period": "3600", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_init_timeout": "300", 2024-09-11T06:17:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_connection_idle": "300", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_domain": "", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password": "", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password_path": "", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_project": "", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_tenant": "", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token": "", 2024-09-11T06:17:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token_path": "", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_user": "", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_api_version": "2", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_domain": "", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_password": "", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_project": "", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_user": "", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-11T06:17:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_url": "", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_debug_interval": "-1", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_lock_max_time": "90", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_objs": "32", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_rules": "1000", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_worker": "3", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_thread_delay": "0", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_dnattr": "uid", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-11T06:17:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchfilter": "", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_uri": "", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_http_headers": "", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name_utc": "false", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_name_len": "0", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_size": "0", 2024-09-11T06:17:07.430 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_chunk_size": "4194304", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_listing_results": "1000", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_notify_retries": "10", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_param_size": "1048576", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_size": "5368709120", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_slo_entries": "1000", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_log_max_shards": "64", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-11T06:17:07.431 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mp_lock_max_time": "600", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_max_gc": "300", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-11T06:17:07.432 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_async_rados_threads": "32", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_control_oids": "8", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_numa_node": "-1", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_chunk_size": "100", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_gc_interval": "600", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-11T06:17:07.433 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_timeout": "600", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_tracing": "false", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_token": "", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_url": "", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_verify_ssl": "true", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_rados": "false", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_socket_path": "", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval": "2.000000", 2024-09-11T06:17:07.434 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_lanes": "3", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_partitions": "3", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_continue": "true", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-11T06:17:07.435 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_tracing": "false", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm": "", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_id": "", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region": "", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_request_uri": "", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_batch_size": "64", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-11T06:17:07.436 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_max_aio": "128", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_num_logs": "16", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_thread_interval": "600", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_resolve_cname": "false", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_run_sync_thread": "true", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-11T06:17:07.437 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_scheduler_type": "throttler", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_script_uri": "", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_service_provider_name": "", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_id": "", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_secret": "", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_entry": "sts", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_key": "sts", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_min_session_duration": "900", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_token_introspection_url": "", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_account_in_url": "false", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_entry": "auth", 2024-09-11T06:17:07.438 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_url": "", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_custom_header": "", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_need_stats": "true", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_tenant_name": "", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_token_expiration": "86400", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url": "", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url_prefix": "swift", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_lease_period": "120", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-11T06:17:07.439 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_thread_pool_size": "512", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_comment": "", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_createby": "", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_encoding": "", 2024-09-11T06:17:07.440 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_flag": "false", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_origin": "", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_tracker": "", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_trust_forwarded_https": "false", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_shards": "32", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_user_shards": "1", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_use_opa_authz": "false", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_counters_cache": "false", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-11T06:17:07.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_max_buckets": "1000", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_policies_max_num": "100", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_unique_email": "true", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_verify_ssl": "true", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone": "", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_id": "", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup": "", 2024-09-11T06:17:07.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_id": "", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_auto_session_clear": "true", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_block_size": "4096", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_size": "536870912", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-11T06:17:07.443 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_index_type": "binary_search", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_partition_filters": "false", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_perf": "false", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-11T06:17:07.444 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "run_dir": "/var/run/ceph", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_block_create": "true", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cache_lru_size": "67108864", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_max_object_size": "16777216", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_device_size": "53687091200", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_full_integrity_check": "false", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_capacity": "16", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-11T06:17:07.445 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-11T06:17:07.446 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_main_device_type": "SSD", 2024-09-11T06:17:07.446 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-11T06:17:07.446 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-11T06:17:07.446 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-11T06:17:07.446 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-11T06:17:07.446 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-11T06:17:07.446 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-11T06:17:07.447 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_segment_size": "67108864", 2024-09-11T06:17:07.447 INFO:teuthology.orchestra.run.smithi070.stdout: "set_keepcaps": "false", 2024-09-11T06:17:07.447 INFO:teuthology.orchestra.run.smithi070.stdout: "setgroup": "", 2024-09-11T06:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser": "", 2024-09-11T06:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser_match_path": "", 2024-09-11T06:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-11T06:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "thp": "false", 2024-09-11T06:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_default_timeout": "60", 2024-09-11T06:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-11T06:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout: "throttler_perf_counter": "true" 2024-09-11T06:17:07.448 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:07.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-11T06:17:07.561 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2024-09-11T06:17:07.562 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T06:17:07.571 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2024-09-11T06:17:07.572 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T06:17:07.580 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2024-09-11T06:17:07.580 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T06:17:07.590 DEBUG:teuthology.orchestra.run.smithi070:> type ceph-objectstore-tool 2024-09-11T06:17:07.605 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T06:17:07.605 DEBUG:teuthology.orchestra.run.smithi194:> type ceph-objectstore-tool 2024-09-11T06:17:07.623 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T06:17:07.623 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-11T06:17:07.633 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-11T06:17:07.634 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-11T06:17:07.634 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T06:17:07.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T06:17:07.634 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-11T06:17:07.634 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-11T06:17:07.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:07.635 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-11T06:17:07.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:07.635 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-11T06:17:07.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:17:07.636 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -g pool_client.0 image_client.0 2024-09-11T06:17:07.665 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:07.663+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:mapped writes DISABLED 2024-09-11T06:17:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:mapped reads DISABLED 2024-09-11T06:17:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:Seed set to 3294 2024-09-11T06:17:07.736 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:07.735+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:07.761 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:07.761 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:07.761 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:07.761 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:07.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:07.788 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:07.789 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:07.806 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:07.807 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:07.824 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:07.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:07.835+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:07.842 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:07.860 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:07.892 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:07.892 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:07.895 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:07.895 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:07.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:07.909 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:07.910 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:07.927 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:07.937 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:07.936+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:08.014 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:08.014 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:08.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:08.066 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:08.065+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:08.125 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:08.125 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:08.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:08.175 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:08.174+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:08.241 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:08.240+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:08.276 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:08.276 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:08.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:08.369 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:08.368+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:08.429 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:08.429 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:08.437 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:08.443 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:08.442+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:08.544 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:08.543+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:08.580 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:08.580 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:08.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:08.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:08.644+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:17:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T06:17:08.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T06:17:08.739 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:08.739 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:08.746 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:08.745+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:08.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:08.846 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:08.845+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:08.895 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:08.895 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:08.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:08.948 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:08.947+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:09.008 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:09.009 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:09.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:09.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:09.048+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:09.149 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:09.148+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:09.159 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:09.159 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:09.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:09.251 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:09.249+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:09.271 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:09.271 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:09.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:09.352 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:09.352+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:09.394 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:09.394 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:09.403 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:09.453 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:09.451+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:09.507 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:09.507 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:09.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:09.558 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:09.556+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:09.654 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:09.652+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:09.659 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:09.659 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:09.667 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:09.670 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T06:17:09.695 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T06:17:09.754 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:09.753+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:09.776 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:09.776 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:09.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:09.868 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:09.867+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:09.928 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:09.928 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:09.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:09.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:09.984 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:09.982+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:10.058 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:10.056+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:10.059 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:10.059 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:10.075 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:10.076 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:10.079 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:10.080 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:10.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:10.092 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:10.092 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:10.107 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:10.108 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:10.124 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:10.124 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:10.140 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:10.141 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:10.156 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:10.157 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:10.159 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:10.157+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:10.173 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:10.193 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:10.193 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:10.193 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:10.193 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:10.202 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:10.259 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:10.258+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:10.305 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:10.305 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:10.314 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:10.360 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:10.359+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:10.416 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4263.0:5 2.2 e21/19 2:5cea7035:::rbd_info:head v 21'1, mlcod=0'0)", 2024-09-11T06:17:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:00.627214+0000", 2024-09-11T06:17:10.416 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7888353420000005, 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00086251299999999997, 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.627214+0000", 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.627214+0000", 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.627214+0000", 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-07 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.627224+0000", 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4960000000000002e-06 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.627236+0000", 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2473999999999999e-05 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.627244+0000", 2024-09-11T06:17:10.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7400000000000004e-06 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.627298+0000", 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3847000000000001e-05 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.627335+0000", 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7469999999999999e-05 2024-09-11T06:17:10.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.628042+0000", 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00070685099999999999 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:00.628077+0000", 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4452999999999997e-05 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:10.421 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4263.0:7 2.2 e22/19 2:5cea7035:::rbd_info:head v 22'2, mlcod=0'0)", 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:01.628843+0000", 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.7872068359999993, 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00086886400000000001, 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:10.422 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.628843+0000", 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.628843+0000", 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.628843+0000", 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6e-07 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.628848+0000", 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6380000000000003e-06 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:10.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.628859+0000", 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1212e-05 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.628869+0000", 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8789999999999998e-06 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.628921+0000", 2024-09-11T06:17:10.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2509999999999997e-05 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.628939+0000", 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7918999999999999e-05 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.629652+0000", 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00071279700000000004 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:10.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:01.629712+0000", 2024-09-11T06:17:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9749e-05 2024-09-11T06:17:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:10.427 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:10.427 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:10.428 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:10.471 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:10.470+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:10.531 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:10.531 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:10.531 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:10.539 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:10.581 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:10.579+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:10.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:10.661+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:10.683 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:10.683 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:10.683 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:10.683 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:10.683 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:10.685 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T06:17:10.693 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:10.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:17:10.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T06:17:10.784 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:10.782+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:10.836 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [] 2024-09-11T06:17:10.837 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:10.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:10.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:10.864+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:10.952 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:10.952 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:10.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:11.005 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:11.003+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:11.065 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:11.065 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:11.067 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:11.066+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:11.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:11.168 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:11.166+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:11.216 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [] 2024-09-11T06:17:11.217 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:11.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:11.310 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:11.308+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:11.369 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:11.369 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:11.370 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:11.368+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:11.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:11.470 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:11.468+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:11.520 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:11.521 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:11.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:11.571 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:11.570+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:11.673 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:11.671+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.204804418999998, 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.033646662000000001, 2024-09-11T06:17:11.675 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468221+0000", 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8980000000000001e-06 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468228+0000", 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6199999999999999e-06 2024-09-11T06:17:11.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468240+0000", 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.203e-05 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468251+0000", 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1055e-05 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468324+0000", 2024-09-11T06:17:11.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2313999999999999e-05 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468333+0000", 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.268e-06 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.498835+0000", 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030502224000000001 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.498990+0000", 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015499700000000001 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.499128+0000", 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013830599999999999 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.499645+0000", 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051640400000000004 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501797+0000", 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021517260000000001 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501837+0000", 2024-09-11T06:17:11.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0229999999999999e-05 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501865+0000", 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8589999999999999e-05 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:33 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525181+0000", 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.147841943, 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069277330000000002, 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 33 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525181+0000", 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525181+0000", 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525182+0000", 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525187+0000", 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525196+0000", 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0250000000000008e-06 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525202+0000", 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7740000000000001e-06 2024-09-11T06:17:11.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.526565+0000", 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013637639999999999 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.526615+0000", 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9718000000000001e-05 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.526703+0000", 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7947000000000003e-05 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528558+0000", 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001854585 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532044+0000", 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034860080000000001 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532080+0000", 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5880000000000002e-05 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532109+0000", 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9417999999999999e-05 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525213+0000", 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.147810576000001, 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070020999999999998, 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525213+0000", 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525213+0000", 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525213+0000", 2024-09-11T06:17:11.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8999999999999997e-07 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525217+0000", 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8789999999999996e-06 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525223+0000", 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2870000000000001e-06 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525228+0000", 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527227+0000", 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019984009999999999 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527280+0000", 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527376+0000", 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5863e-05 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528890+0000", 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001514409 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532155+0000", 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032650349999999999 2024-09-11T06:17:11.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532188+0000", 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3139000000000002e-05 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532215+0000", 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6444e-05 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.147786159999999, 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070729950000000003, 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 35 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.75e-07 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525293+0000", 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5958000000000002e-05 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525302+0000", 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525310+0000", 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9910000000000002e-06 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527653+0000", 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023429869999999999 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527703+0000", 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0297000000000003e-05 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527800+0000", 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7048999999999999e-05 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528893+0000", 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001093105 2024-09-11T06:17:11.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532256+0000", 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033627280000000002 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532286+0000", 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0035e-05 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532310+0000", 2024-09-11T06:17:11.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3932000000000001e-05 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.147701454, 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070648619999999999, 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6000000000000003e-07 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525328+0000", 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3850000000000001e-06 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525335+0000", 2024-09-11T06:17:11.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1810000000000004e-06 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525340+0000", 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2360000000000004e-06 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528201+0000", 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028612630000000002 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528257+0000", 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5121999999999998e-05 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528330+0000", 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2988e-05 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528918+0000", 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058871300000000004 2024-09-11T06:17:11.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532338+0000", 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034194070000000002 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532365+0000", 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7203999999999999e-05 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532387+0000", 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1702999999999999e-05 2024-09-11T06:17:11.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.14767359, 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097079330000000002, 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 37 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:11.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525354+0000", 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1819999999999999e-06 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525365+0000", 2024-09-11T06:17:11.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0984e-05 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525371+0000", 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528586+0000", 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032157240000000001 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528635+0000", 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8426e-05 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528717+0000", 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2531e-05 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.529194+0000", 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047665199999999999 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.534996+0000", 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058021319999999998 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.535030+0000", 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3841999999999999e-05 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.535057+0000", 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7441e-05 2024-09-11T06:17:11.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875468+0000", 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.797555342999999, 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057859490000000003, 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 114 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875468+0000", 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875468+0000", 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875468+0000", 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875472+0000", 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875478+0000", 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875484+0000", 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1879999999999999e-06 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.879605+0000", 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041212219999999999 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.879651+0000", 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5255e-05 2024-09-11T06:17:11.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.879727+0000", 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6655000000000004e-05 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880907+0000", 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001179617 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881207+0000", 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029965299999999999 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881234+0000", 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7498e-05 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881254+0000", 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9731000000000001e-05 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875491+0000", 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.797532057000002, 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061870889999999998, 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 115 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875491+0000", 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875491+0000", 2024-09-11T06:17:11.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875491+0000", 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875541+0000", 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9991000000000003e-05 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875549+0000", 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0790000000000001e-06 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875555+0000", 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.879950+0000", 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043944700000000001 2024-09-11T06:17:11.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880015+0000", 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5279999999999998e-05 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880095+0000", 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9896999999999998e-05 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881263+0000", 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001168372 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881630+0000", 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036727899999999998 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881657+0000", 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6647000000000001e-05 2024-09-11T06:17:11.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881678+0000", 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1112e-05 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875565+0000", 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.797458516999999, 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069691620000000001, 2024-09-11T06:17:11.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875565+0000", 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875565+0000", 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875565+0000", 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0800000000000005e-07 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875569+0000", 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.653e-06 2024-09-11T06:17:11.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875575+0000", 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.19e-06 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875580+0000", 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8319999999999996e-06 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880597+0000", 2024-09-11T06:17:11.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050170370000000002 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880638+0000", 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1597999999999997e-05 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880707+0000", 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8516999999999995e-05 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881271+0000", 2024-09-11T06:17:11.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056436599999999996 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882484+0000", 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001212313 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882511+0000", 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7449000000000001e-05 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882534+0000", 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699000000000001e-05 2024-09-11T06:17:11.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.797434448000001, 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070818540000000003, 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875593+0000", 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.54e-06 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875600+0000", 2024-09-11T06:17:11.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.165e-06 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875605+0000", 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.702e-06 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880930+0000", 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053258730000000001 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880973+0000", 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3106999999999999e-05 2024-09-11T06:17:11.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881055+0000", 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1613000000000006e-05 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881418+0000", 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000362553 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882579+0000", 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011616700000000001 2024-09-11T06:17:11.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882633+0000", 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3494e-05 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882671+0000", 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725000000000002e-05 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.210001+0000", 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.463021924, 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056764210000000001, 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210001+0000", 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210001+0000", 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210002+0000", 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:17:11.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210008+0000", 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210015+0000", 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4309999999999999e-06 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210019+0000", 2024-09-11T06:17:11.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.213819+0000", 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037998789999999999 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.213866+0000", 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6356999999999997e-05 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.213942+0000", 2024-09-11T06:17:11.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6700999999999996e-05 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215015+0000", 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010724969999999999 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215583+0000", 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056848300000000005 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215636+0000", 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2346000000000003e-05 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215678+0000", 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.189e-05 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.210027+0000", 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.462995713000002, 2024-09-11T06:17:11.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061981500000000004, 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210027+0000", 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210027+0000", 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210028+0000", 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210034+0000", 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T06:17:11.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210040+0000", 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1460000000000001e-06 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210045+0000", 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.214671+0000", 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046259040000000001 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.214715+0000", 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3776000000000002e-05 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.214786+0000", 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600999999999994e-05 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216027+0000", 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012404339999999999 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216178+0000", 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151163 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216205+0000", 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7523000000000001e-05 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216226+0000", 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0112999999999999e-05 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.210053+0000", 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.462970217999999, 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006459327, 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 140 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210053+0000", 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210053+0000", 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210053+0000", 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000002e-07 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210099+0000", 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5685000000000001e-05 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210104+0000", 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8960000000000002e-06 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210115+0000", 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0716999999999999e-05 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215046+0000", 2024-09-11T06:17:11.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049314559999999999 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215093+0000", 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7196e-05 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215173+0000", 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9864999999999995e-05 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216033+0000", 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085994100000000003 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216466+0000", 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000432724 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216491+0000", 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5497999999999999e-05 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216512+0000", 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0928e-05 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.210121+0000", 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.462901771999999, 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066554450000000003, 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 141 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210121+0000", 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210121+0000", 2024-09-11T06:17:11.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210122+0000", 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210125+0000", 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2210000000000002e-06 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210129+0000", 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6119999999999999e-06 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210131+0000", 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6079999999999998e-06 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215703+0000", 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055721750000000004 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215745+0000", 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1853000000000001e-05 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215815+0000", 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9562999999999998e-05 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216311+0000", 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049622900000000005 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216735+0000", 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042431700000000001 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216760+0000", 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4295e-05 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216777+0000", 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7210999999999998e-05 2024-09-11T06:17:11.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:144 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.455969473, 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007057191, 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217090+0000", 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5488999999999999e-05 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217094+0000", 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0419999999999996e-06 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217097+0000", 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9380000000000001e-06 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217790+0000", 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069392200000000003 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217834+0000", 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3198000000000002e-05 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217906+0000", 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2194999999999996e-05 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218629+0000", 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072349100000000004 2024-09-11T06:17:11.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224059+0000", 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054295790000000003 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224089+0000", 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9886000000000002e-05 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224111+0000", 2024-09-11T06:17:11.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2033000000000001e-05 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:145 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.455921355000001, 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070969580000000004, 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 145 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:11.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217140+0000", 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8330000000000001e-05 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217144+0000", 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217147+0000", 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218177+0000", 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010300210000000001 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218228+0000", 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0284999999999997e-05 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218309+0000", 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0990999999999998e-05 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218747+0000", 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043851300000000002 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224139+0000", 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053918730000000002 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224170+0000", 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0605000000000003e-05 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224199+0000", 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9190999999999999e-05 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675594+0000", 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.997428645999999, 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056644160000000002, 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 157 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675594+0000", 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675594+0000", 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675595+0000", 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675597+0000", 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.849e-06 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675600+0000", 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2540000000000001e-06 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675603+0000", 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-06 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678036+0000", 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002433078 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678082+0000", 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6165000000000003e-05 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678152+0000", 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9858999999999996e-05 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679057+0000", 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00090553599999999997 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.681171+0000", 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002113434 2024-09-11T06:17:11.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.681221+0000", 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9959000000000001e-05 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.681259+0000", 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8161000000000003e-05 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.997414204999998, 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086769610000000004, 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 158 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:11.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-07 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675636+0000", 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6585999999999999e-05 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675640+0000", 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675644+0000", 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.155e-06 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678391+0000", 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027472210000000002 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678465+0000", 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3613000000000001e-05 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678587+0000", 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122021 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679562+0000", 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097518400000000003 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684201+0000", 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046387779999999997 2024-09-11T06:17:11.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684249+0000", 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8554000000000003e-05 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684286+0000", 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6529000000000002e-05 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.997373541999998, 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087271420000000002, 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 159 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.65e-07 2024-09-11T06:17:11.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675652+0000", 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-06 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675655+0000", 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2899999999999998e-06 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675658+0000", 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6199999999999999e-06 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679082+0000", 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034247219999999998 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679158+0000", 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5807000000000001e-05 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679285+0000", 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012634500000000001 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679765+0000", 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048002899999999998 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684315+0000", 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045503439999999996 2024-09-11T06:17:11.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684354+0000", 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8575999999999998e-05 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684377+0000", 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3144000000000001e-05 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.789 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:161 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 65536~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.684562+0000", 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.988461015999999, 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052068649999999998, 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684562+0000", 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684562+0000", 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684563+0000", 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684610+0000", 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7734000000000001e-05 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684617+0000", 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2469999999999997e-06 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684620+0000", 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2959999999999999e-06 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684970+0000", 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035030899999999998 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.685043+0000", 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2737000000000005e-05 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.685159+0000", 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116118 2024-09-11T06:17:11.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.685643+0000", 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048383900000000001 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.689690+0000", 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040468580000000004 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.689735+0000", 2024-09-11T06:17:11.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4904999999999998e-05 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.689769+0000", 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4394000000000003e-05 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:11.795 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:11.797 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:11.797 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T06:17:11.798 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:17:11.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T06:17:11.799 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:11.795+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:11.897 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:11.897+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:11.944 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:11.945 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:11.945 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:11.945 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:11.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:11.998 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:11.997+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:12.059 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:12.059 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:12.059 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:12.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:12.099 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:12.098+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:12.173 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4263.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-11T06:17:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.910508+0000", 2024-09-11T06:17:12.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.262552603, 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069084500000000004, 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910508+0000", 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:12.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910508+0000", 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910508+0000", 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910512+0000", 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3749999999999996e-06 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:12.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910523+0000", 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910530+0000", 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4340000000000003e-06 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910572+0000", 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1357999999999999e-05 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:12.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910597+0000", 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5131999999999999e-05 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911143+0000", 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054650100000000002 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911199+0000", 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5306999999999997e-05 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:12.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:12.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:12.178 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:12.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:12.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:12.199 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:12.198+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:12.288 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:12.288 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:12.288 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:12.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:12.300 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:12.299+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:12.362 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:12.362 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:12.381 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:12.381 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:12.397 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:12.397 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:12.401 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:12.399+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:12.404 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:12.404 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:12.404 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:12.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:12.414 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:12.415 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:12.432 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:12.432 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:12.451 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:12.451 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:12.467 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:12.468 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:12.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:12.520 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:12.520 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:12.520 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:12.518+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:12.529 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:12.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:12.601+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:12.645 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:12.645 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:12.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T06:17:12.703 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:12.702+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:12.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T06:17:12.800 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:12.800 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:12.804 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:12.803+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:12.809 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:12.906 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:12.904+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:12.952 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:12.952 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:12.961 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:13.044 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:13.044+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:13.103 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:13.103 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:13.106 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:13.106+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:13.111 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:13.207 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:13.206+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:13.255 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:13.255 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:13.264 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:13.348 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:13.347+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:13.401 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0xe2a7a61 2024-09-11T06:17:13.409 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:13.409 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:13.409 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:13.408+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:13.417 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:13.418 INFO:teuthology.orchestra.run.smithi070.stdout:1 trunc from 0x0 to 0xe2a7a61 2024-09-11T06:17:13.422 INFO:teuthology.orchestra.run.smithi070.stdout:3 read 0x111c248 thru 0x1123751 (0x750a bytes) 2024-09-11T06:17:13.423 INFO:teuthology.orchestra.run.smithi070.stdout:4 punch from 0xc885d72 to 0xc88dbed, (0x7e7b bytes) 2024-09-11T06:17:13.423 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:13.423 INFO:teuthology.orchestra.run.smithi070.stdout:8 punch from 0x4ac63fb to 0x4ac7138, (0xd3d bytes) 2024-09-11T06:17:13.427 INFO:teuthology.orchestra.run.smithi070.stdout:9 trunc from 0xe2a7a61 to 0xa7e55a8 2024-09-11T06:17:13.432 INFO:teuthology.orchestra.run.smithi070.stdout:10 read 0x2620c95 thru 0x26237e3 (0x2b4f bytes) 2024-09-11T06:17:13.434 INFO:teuthology.orchestra.run.smithi070.stdout:11 trunc from 0xa7e55a8 to 0xc1b9955 2024-09-11T06:17:13.439 INFO:teuthology.orchestra.run.smithi070.stdout:12 writesame 0x43eb476 thru 0x43f5e72 data_size 0x1(0xa9fd bytes) 2024-09-11T06:17:13.467 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:13.467 INFO:teuthology.orchestra.run.smithi070.stdout:15 punch from 0x674efc2 to 0x675e880, (0xf8be bytes) 2024-09-11T06:17:13.468 INFO:teuthology.orchestra.run.smithi070.stdout:17 read 0x5dd0462 thru 0x5dd7897 (0x7436 bytes) 2024-09-11T06:17:13.468 INFO:teuthology.orchestra.run.smithi070.stdout:18 read 0x1d124e1 thru 0x1d1a0fb (0x7c1b bytes) 2024-09-11T06:17:13.468 INFO:teuthology.orchestra.run.smithi070.stdout:19 write 0x28291bb thru 0x282bbd3 (0x2a19 bytes) 2024-09-11T06:17:13.470 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:13.470 INFO:teuthology.orchestra.run.smithi070.stdout:21 write 0x3cda7b6 thru 0x3ce9cdc (0xf527 bytes) 2024-09-11T06:17:13.510 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:13.509+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:13.561 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:13.561 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:13.570 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:13.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:13.612+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:13.672 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:13.672 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:13.676 INFO:teuthology.orchestra.run.smithi070.stdout:22 read 0xa51f2c1 thru 0xa52a2e9 (0xb029 bytes) 2024-09-11T06:17:13.677 INFO:teuthology.orchestra.run.smithi070.stdout:23 write 0x90881fe thru 0x9090a17 (0x881a bytes) 2024-09-11T06:17:13.679 INFO:teuthology.orchestra.run.smithi070.stdout:24 read 0xd3da98 thru 0xd47e28 (0xa391 bytes) 2024-09-11T06:17:13.679 INFO:teuthology.orchestra.run.smithi070.stdout:25 read 0xb6b10a4 thru 0xb6b84d0 (0x742d bytes) 2024-09-11T06:17:13.679 INFO:teuthology.orchestra.run.smithi070.stdout:26 write 0x6e483e3 thru 0x6e551de (0xcdfc bytes) 2024-09-11T06:17:13.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:13.683 INFO:teuthology.orchestra.run.smithi070.stdout:27 read 0x9556ea1 thru 0x9563dbd (0xcf1d bytes) 2024-09-11T06:17:13.683 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:13.683 INFO:teuthology.orchestra.run.smithi070.stdout:29 writesame 0x426b222 thru 0x427a8b2 data_size 0x2f(0xf691 bytes) 2024-09-11T06:17:13.685 INFO:teuthology.orchestra.run.smithi070.stdout:31 write 0x4a49e18 thru 0x4a4db95 (0x3d7e bytes) 2024-09-11T06:17:13.695 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T06:17:13.700 INFO:teuthology.orchestra.run.smithi070.stdout:32 write 0xe010a73 thru 0xe01da88 (0xd016 bytes) 2024-09-11T06:17:13.705 INFO:teuthology.orchestra.run.smithi070.stdout:33 clone 1 order 20 su 131072 sc 6 2024-09-11T06:17:13.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T06:17:13.752 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:13.751+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:13.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:17:13.812 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:13.810+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:13.826 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:13.826 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:13.835 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:13.913 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:13.912+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:13.977 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:13.978 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:13.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:14.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:14.029+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:14.090 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:14.090 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:14.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:14.114 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:14.113+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:14.215 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:14.215+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:14.241 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:14.242 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:14.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:14.316 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:14.315+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:14.356 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:14.356 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:14.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:14.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:14.417+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:14.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:14.510 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:14.511 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:14.519 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:14.518+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:14.520 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:14.619 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:14.620 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:14.620 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:14.619+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:14.637 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:14.637 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:14.653 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:14.653 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:14.667 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:14.667 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:14.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:10 3.1c e27/24 3:3831950c:::rbd_directory:head v 27'1, mlcod=0'0)", 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.695814+0000", 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9706561950000001, 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00090999500000000003, 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695814+0000", 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695814+0000", 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695814+0000", 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8500000000000002e-07 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695821+0000", 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0960000000000003e-06 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695840+0000", 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8478000000000002e-05 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695851+0000", 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0922e-05 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695918+0000", 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7286000000000006e-05 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695944+0000", 2024-09-11T06:17:14.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6021999999999999e-05 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.696680+0000", 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00073585499999999999 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.696724+0000", 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4051000000000002e-05 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:12 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.702245+0000", 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9642251420000001, 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013439999999999999, 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 12 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702245+0000", 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702245+0000", 2024-09-11T06:17:14.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702247+0000", 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.216e-06 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702261+0000", 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3546e-05 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702280+0000", 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9504000000000002e-05 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702290+0000", 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8849999999999994e-06 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702347+0000", 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6410999999999999e-05 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702448+0000", 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101091 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.702600+0000", 2024-09-11T06:17:14.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000152504 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703226+0000", 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062616099999999997 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703482+0000", 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025560699999999998 2024-09-11T06:17:14.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703540+0000", 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7895e-05 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703589+0000", 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.918e-05 2024-09-11T06:17:14.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:12 3.f e27/24 ondisk, result = 0)", 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.703403+0000", 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.963067466, 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019487899999999999, 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703403+0000", 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703403+0000", 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703404+0000", 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6700000000000002e-07 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703408+0000", 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9249999999999997e-06 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703417+0000", 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1880000000000008e-06 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703422+0000", 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9359999999999998e-06 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703466+0000", 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4462000000000002e-05 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703475+0000", 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2269999999999999e-06 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.703598+0000", 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012227399999999999 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.712911+0000", 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9535596989999999, 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030478800000000001, 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.712911+0000", 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.712911+0000", 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.712912+0000", 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.268e-06 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.712919+0000", 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5730000000000002e-06 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.712932+0000", 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2659e-05 2024-09-11T06:17:14.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.712938+0000", 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8799999999999996e-06 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.712982+0000", 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4481000000000003e-05 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713059+0000", 2024-09-11T06:17:14.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6186000000000005e-05 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713215+0000", 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015674100000000001 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:17 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.713295+0000", 2024-09-11T06:17:14.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9531750190000001, 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018952300000000001, 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 17 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713295+0000", 2024-09-11T06:17:14.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713295+0000", 2024-09-11T06:17:14.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713296+0000", 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6400000000000002e-07 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713300+0000", 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0040000000000001e-06 2024-09-11T06:17:14.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713307+0000", 2024-09-11T06:17:14.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3799999999999996e-06 2024-09-11T06:17:14.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713320+0000", 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3125999999999999e-05 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713357+0000", 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6319999999999998e-05 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713406+0000", 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9651999999999998e-05 2024-09-11T06:17:14.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713485+0000", 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8376999999999999e-05 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:18 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [call,call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.713547+0000", 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9529236450000003, 2024-09-11T06:17:14.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173015, 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 18 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713547+0000", 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713547+0000", 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713547+0000", 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4499999999999997e-07 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713550+0000", 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9249999999999999e-06 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713556+0000", 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8490000000000002e-06 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713559+0000", 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4060000000000001e-06 2024-09-11T06:17:14.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713587+0000", 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8047000000000001e-05 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713631+0000", 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3608e-05 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713720+0000", 2024-09-11T06:17:14.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8634999999999994e-05 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:19 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.713769+0000", 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9527010630000001, 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017354600000000001, 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 19 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713769+0000", 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713769+0000", 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713770+0000", 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8100000000000003e-07 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713780+0000", 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0083e-05 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713786+0000", 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7019999999999998e-06 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713789+0000", 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.242e-06 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713820+0000", 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1309999999999997e-05 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713863+0000", 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2568000000000003e-05 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.713943+0000", 2024-09-11T06:17:14.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0060000000000003e-05 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:20 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.714282+0000", 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.952188139, 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030760199999999997, 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 20 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714282+0000", 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714282+0000", 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714283+0000", 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714286+0000", 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9890000000000001e-06 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714292+0000", 2024-09-11T06:17:14.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9920000000000004e-06 2024-09-11T06:17:14.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714295+0000", 2024-09-11T06:17:14.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-06 2024-09-11T06:17:14.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714329+0000", 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3451000000000002e-05 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714379+0000", 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0834999999999997e-05 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714590+0000", 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000210239 2024-09-11T06:17:14.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.714671+0000", 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9517991600000002, 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025807299999999999, 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21 2024-09-11T06:17:14.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714671+0000", 2024-09-11T06:17:14.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714671+0000", 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714672+0000", 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.75e-07 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714674+0000", 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.92e-06 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714680+0000", 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6690000000000003e-06 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714683+0000", 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2049999999999998e-06 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714717+0000", 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3970000000000002e-05 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714765+0000", 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7478000000000002e-05 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.714929+0000", 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164356 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:22 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.715004+0000", 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9514663940000001, 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163084, 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 22 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715004+0000", 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715004+0000", 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715004+0000", 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000005e-07 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715007+0000", 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.599e-06 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715013+0000", 2024-09-11T06:17:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2090000000000002e-06 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715020+0000", 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0520000000000004e-06 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715049+0000", 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8920000000000001e-05 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715091+0000", 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1987000000000003e-05 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715167+0000", 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5833000000000004e-05 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:24 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.715594+0000", 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9508759900000001, 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016879500000000001, 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 24 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715594+0000", 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715594+0000", 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715595+0000", 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1900000000000002e-07 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715599+0000", 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7919999999999999e-06 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715606+0000", 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0380000000000002e-06 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715609+0000", 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7230000000000002e-06 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715646+0000", 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6128999999999999e-05 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715692+0000", 2024-09-11T06:17:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6278e-05 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715763+0000", 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1216000000000004e-05 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25 3.f 3:f134c96f:::rbd_header.116d6cc70d0:head [watch watch cookie 139721594386528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.715906+0000", 2024-09-11T06:17:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.950564687, 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001005176, 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715906+0000", 2024-09-11T06:17:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715906+0000", 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715906+0000", 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715909+0000", 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2169999999999999e-06 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715918+0000", 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8000000000000004e-06 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715924+0000", 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5729999999999998e-06 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.715957+0000", 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2996000000000001e-05 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716003+0000", 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5908999999999997e-05 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716097+0000", 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4642000000000006e-05 2024-09-11T06:17:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716514+0000", 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000416666 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716830+0000", 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031590200000000001 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716862+0000", 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2053e-05 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716911+0000", 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8769e-05 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:25 3.f e27/24 ondisk, result = 0)", 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.716763+0000", 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9497075210000001, 2024-09-11T06:17:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015292600000000001, 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716763+0000", 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716763+0000", 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716764+0000", 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7800000000000001e-07 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716767+0000", 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6650000000000001e-06 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716776+0000", 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0129999999999999e-06 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716781+0000", 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8269999999999997e-06 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716820+0000", 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8732000000000001e-05 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716826+0000", 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7479999999999996e-06 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.716916+0000", 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9163e-05 2024-09-11T06:17:14.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:14.736 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:14.737 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:14.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:14.738 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T06:17:14.739 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:14.740 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:14.740 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:17:14.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T06:17:14.741 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:14.742 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:14.742 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:14.736+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:14.743 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:14.838 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:14.837+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:14.851 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:14.851 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:14.851 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:14.851 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:14.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:14.946 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:14.946+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:15.007 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:15.007 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:15.007 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:15.007 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:15.007 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:15.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:15.057 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:15.056+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:15.140 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:15.140+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:15.160 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:15.160 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:15.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:15.160 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:15.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.690277671, 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.033646662000000001, 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468221+0000", 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8980000000000001e-06 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468228+0000", 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6199999999999999e-06 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468240+0000", 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.203e-05 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468251+0000", 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1055e-05 2024-09-11T06:17:15.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468324+0000", 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2313999999999999e-05 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468333+0000", 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.268e-06 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.498835+0000", 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030502224000000001 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.498990+0000", 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015499700000000001 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.499128+0000", 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013830599999999999 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.499645+0000", 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051640400000000004 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501797+0000", 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021517260000000001 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501837+0000", 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0229999999999999e-05 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501865+0000", 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8589999999999999e-05 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:33 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525181+0000", 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.633315195000002, 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069277330000000002, 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 33 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525181+0000", 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525181+0000", 2024-09-11T06:17:15.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525182+0000", 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525187+0000", 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525196+0000", 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0250000000000008e-06 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525202+0000", 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7740000000000001e-06 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.526565+0000", 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013637639999999999 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.526615+0000", 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9718000000000001e-05 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.526703+0000", 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7947000000000003e-05 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528558+0000", 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001854585 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532044+0000", 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034860080000000001 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532080+0000", 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5880000000000002e-05 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532109+0000", 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9417999999999999e-05 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525213+0000", 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.633283828, 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070020999999999998, 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 34 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525213+0000", 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525213+0000", 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525213+0000", 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8999999999999997e-07 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525217+0000", 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8789999999999996e-06 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525223+0000", 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2870000000000001e-06 2024-09-11T06:17:15.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525228+0000", 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1939999999999997e-06 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527227+0000", 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019984009999999999 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527280+0000", 2024-09-11T06:17:15.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527376+0000", 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5863e-05 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528890+0000", 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001514409 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532155+0000", 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032650349999999999 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532188+0000", 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3139000000000002e-05 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532215+0000", 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6444e-05 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.633259412000001, 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070729950000000003, 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 35 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.75e-07 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525293+0000", 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5958000000000002e-05 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525302+0000", 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525310+0000", 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9910000000000002e-06 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527653+0000", 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023429869999999999 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527703+0000", 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0297000000000003e-05 2024-09-11T06:17:15.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527800+0000", 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7048999999999999e-05 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528893+0000", 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001093105 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532256+0000", 2024-09-11T06:17:15.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033627280000000002 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532286+0000", 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0035e-05 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532310+0000", 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3932000000000001e-05 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.633174705999998, 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070648619999999999, 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6000000000000003e-07 2024-09-11T06:17:15.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525328+0000", 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3850000000000001e-06 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525335+0000", 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1810000000000004e-06 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525340+0000", 2024-09-11T06:17:15.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2360000000000004e-06 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528201+0000", 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028612630000000002 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528257+0000", 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5121999999999998e-05 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528330+0000", 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2988e-05 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528918+0000", 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058871300000000004 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532338+0000", 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034194070000000002 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532365+0000", 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7203999999999999e-05 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532387+0000", 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1702999999999999e-05 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.633146841999999, 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097079330000000002, 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 37 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:15.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525354+0000", 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1819999999999999e-06 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525365+0000", 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0984e-05 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525371+0000", 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528586+0000", 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032157240000000001 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528635+0000", 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8426e-05 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528717+0000", 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2531e-05 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.529194+0000", 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047665199999999999 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.534996+0000", 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058021319999999998 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.535030+0000", 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3841999999999999e-05 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.535057+0000", 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7441e-05 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875468+0000", 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.283028595000001, 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057859490000000003, 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 114 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875468+0000", 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875468+0000", 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875468+0000", 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875472+0000", 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875478+0000", 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3820000000000001e-06 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875484+0000", 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1879999999999999e-06 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.879605+0000", 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041212219999999999 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.879651+0000", 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5255e-05 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.879727+0000", 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6655000000000004e-05 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880907+0000", 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001179617 2024-09-11T06:17:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881207+0000", 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029965299999999999 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881234+0000", 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7498e-05 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881254+0000", 2024-09-11T06:17:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9731000000000001e-05 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875491+0000", 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.283005309, 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061870889999999998, 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 115 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875491+0000", 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875491+0000", 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875491+0000", 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875541+0000", 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9991000000000003e-05 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875549+0000", 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0790000000000001e-06 2024-09-11T06:17:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875555+0000", 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6210000000000001e-06 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.879950+0000", 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043944700000000001 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880015+0000", 2024-09-11T06:17:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5279999999999998e-05 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880095+0000", 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9896999999999998e-05 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881263+0000", 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001168372 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881630+0000", 2024-09-11T06:17:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036727899999999998 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881657+0000", 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6647000000000001e-05 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881678+0000", 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1112e-05 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875565+0000", 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.282931769000001, 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069691620000000001, 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 116 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875565+0000", 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875565+0000", 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875565+0000", 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0800000000000005e-07 2024-09-11T06:17:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875569+0000", 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.653e-06 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875575+0000", 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.19e-06 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875580+0000", 2024-09-11T06:17:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8319999999999996e-06 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880597+0000", 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050170370000000002 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880638+0000", 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1597999999999997e-05 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880707+0000", 2024-09-11T06:17:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8516999999999995e-05 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881271+0000", 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056436599999999996 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882484+0000", 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001212313 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882511+0000", 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7449000000000001e-05 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882534+0000", 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699000000000001e-05 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.282907699999999, 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070818540000000003, 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875593+0000", 2024-09-11T06:17:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.54e-06 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875600+0000", 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.165e-06 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875605+0000", 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.702e-06 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880930+0000", 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053258730000000001 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880973+0000", 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3106999999999999e-05 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881055+0000", 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1613000000000006e-05 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881418+0000", 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000362553 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882579+0000", 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011616700000000001 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882633+0000", 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3494e-05 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882671+0000", 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725000000000002e-05 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.210001+0000", 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.948495176000002, 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056764210000000001, 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210001+0000", 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210001+0000", 2024-09-11T06:17:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210002+0000", 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210008+0000", 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210015+0000", 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4309999999999999e-06 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210019+0000", 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.213819+0000", 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037998789999999999 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.213866+0000", 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6356999999999997e-05 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.213942+0000", 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6700999999999996e-05 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215015+0000", 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010724969999999999 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215583+0000", 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056848300000000005 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215636+0000", 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2346000000000003e-05 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215678+0000", 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.189e-05 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.210027+0000", 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.948468965, 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061981500000000004, 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 139 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210027+0000", 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210027+0000", 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210028+0000", 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210034+0000", 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3300000000000004e-06 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210040+0000", 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1460000000000001e-06 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210045+0000", 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7319999999999998e-06 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.214671+0000", 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046259040000000001 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.214715+0000", 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3776000000000002e-05 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.214786+0000", 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600999999999994e-05 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216027+0000", 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012404339999999999 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216178+0000", 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151163 2024-09-11T06:17:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216205+0000", 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7523000000000001e-05 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216226+0000", 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0112999999999999e-05 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.210053+0000", 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.948443470000001, 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006459327, 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 140 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210053+0000", 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210053+0000", 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210053+0000", 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000002e-07 2024-09-11T06:17:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210099+0000", 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5685000000000001e-05 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210104+0000", 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8960000000000002e-06 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210115+0000", 2024-09-11T06:17:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0716999999999999e-05 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215046+0000", 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049314559999999999 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215093+0000", 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7196e-05 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215173+0000", 2024-09-11T06:17:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9864999999999995e-05 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216033+0000", 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085994100000000003 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216466+0000", 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000432724 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216491+0000", 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5497999999999999e-05 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216512+0000", 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0928e-05 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.210121+0000", 2024-09-11T06:17:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.948375024000001, 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066554450000000003, 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 141 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210121+0000", 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210121+0000", 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210122+0000", 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210125+0000", 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2210000000000002e-06 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210129+0000", 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6119999999999999e-06 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.210131+0000", 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6079999999999998e-06 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215703+0000", 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055721750000000004 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215745+0000", 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1853000000000001e-05 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.215815+0000", 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9562999999999998e-05 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216311+0000", 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049622900000000005 2024-09-11T06:17:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216735+0000", 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042431700000000001 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216760+0000", 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4295e-05 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.216777+0000", 2024-09-11T06:17:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7210999999999998e-05 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:144 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.941442725000002, 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007057191, 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217090+0000", 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5488999999999999e-05 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217094+0000", 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0419999999999996e-06 2024-09-11T06:17:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217097+0000", 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9380000000000001e-06 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217790+0000", 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069392200000000003 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217834+0000", 2024-09-11T06:17:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3198000000000002e-05 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217906+0000", 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2194999999999996e-05 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218629+0000", 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072349100000000004 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224059+0000", 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054295790000000003 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224089+0000", 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9886000000000002e-05 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224111+0000", 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2033000000000001e-05 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:145 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.941394606999999, 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070969580000000004, 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 145 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217140+0000", 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8330000000000001e-05 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217144+0000", 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217147+0000", 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218177+0000", 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010300210000000001 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218228+0000", 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0284999999999997e-05 2024-09-11T06:17:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218309+0000", 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0990999999999998e-05 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218747+0000", 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043851300000000002 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224139+0000", 2024-09-11T06:17:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053918730000000002 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224170+0000", 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0605000000000003e-05 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224199+0000", 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9190999999999999e-05 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675594+0000", 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.482901898000001, 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056644160000000002, 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 157 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675594+0000", 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675594+0000", 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675595+0000", 2024-09-11T06:17:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675597+0000", 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.849e-06 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675600+0000", 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2540000000000001e-06 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675603+0000", 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.915e-06 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678036+0000", 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002433078 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678082+0000", 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6165000000000003e-05 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678152+0000", 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9858999999999996e-05 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679057+0000", 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00090553599999999997 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.681171+0000", 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002113434 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.681221+0000", 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9959000000000001e-05 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.681259+0000", 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8161000000000003e-05 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.482887457, 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086769610000000004, 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 158 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-07 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675636+0000", 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6585999999999999e-05 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675640+0000", 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675644+0000", 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.155e-06 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678391+0000", 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027472210000000002 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678465+0000", 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3613000000000001e-05 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678587+0000", 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122021 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679562+0000", 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097518400000000003 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684201+0000", 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046387779999999997 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684249+0000", 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8554000000000003e-05 2024-09-11T06:17:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684286+0000", 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6529000000000002e-05 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.482846794, 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087271420000000002, 2024-09-11T06:17:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 159 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.65e-07 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675652+0000", 2024-09-11T06:17:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-06 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675655+0000", 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2899999999999998e-06 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675658+0000", 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6199999999999999e-06 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679082+0000", 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034247219999999998 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679158+0000", 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5807000000000001e-05 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679285+0000", 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012634500000000001 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679765+0000", 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048002899999999998 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684315+0000", 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045503439999999996 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684354+0000", 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8575999999999998e-05 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684377+0000", 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3144000000000001e-05 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:11.688942+0000", 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4695545380000001, 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063309810000000003, 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 9 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.688942+0000", 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.688942+0000", 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.688944+0000", 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-06 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.688951+0000", 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0940000000000002e-06 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.688967+0000", 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5645e-05 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.688978+0000", 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0961999999999999e-05 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.689039+0000", 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1265000000000004e-05 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.689049+0000", 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0315e-05 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.693564+0000", 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045150709999999998 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.693652+0000", 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7962999999999998e-05 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.693808+0000", 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015624500000000001 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.694537+0000", 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072909500000000003 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695209+0000", 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067145400000000004 2024-09-11T06:17:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695245+0000", 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6183999999999998e-05 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:11.695273+0000", 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7688e-05 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.277 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:15.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:15.279 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:15.278+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:15.379 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:15.379+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:15.382 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:15.382 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:15.383 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:15.383 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:15.391 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:15.480 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:15.480+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:15.535 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:15.536 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:15.536 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:15.536 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:15.536 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:15.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:15.586 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:15.585+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:15.682 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:15.681+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:15.688 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4263.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.910508+0000", 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.777644370999999, 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069084500000000004, 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910508+0000", 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910508+0000", 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910508+0000", 2024-09-11T06:17:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910512+0000", 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3749999999999996e-06 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910523+0000", 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910530+0000", 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4340000000000003e-06 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910572+0000", 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1357999999999999e-05 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910597+0000", 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5131999999999999e-05 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911143+0000", 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054650100000000002 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911199+0000", 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5306999999999997e-05 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:114 3.e 3:71ed46f3:::rbd_object_map.116d6cc70d0.0000000000000003:head [writefull 0~49] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97850262499999996, 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036205959999999998, 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 114 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709653+0000", 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.033e-06 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709668+0000", 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5432999999999999e-05 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709695+0000", 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6743000000000001e-05 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709708+0000", 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3224000000000001e-05 2024-09-11T06:17:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709781+0000", 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3203999999999999e-05 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709786+0000", 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5249999999999999e-06 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.711855+0000", 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020689440000000001 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.711945+0000", 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0247999999999994e-05 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.712027+0000", 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1848999999999995e-05 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.712788+0000", 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076103399999999995 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713172+0000", 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038437900000000001 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713225+0000", 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2729999999999998e-05 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713270+0000", 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5250000000000002e-05 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:114 3.e e30/24 ondisk, result = 0)", 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.713077+0000", 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97507533599999996, 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020107299999999999, 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713077+0000", 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713077+0000", 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713078+0000", 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.023e-06 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713083+0000", 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0300000000000001e-06 2024-09-11T06:17:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713097+0000", 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3842999999999999e-05 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713105+0000", 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8690000000000004e-06 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713158+0000", 2024-09-11T06:17:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3062000000000001e-05 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713166+0000", 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4829999999999999e-06 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713278+0000", 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011176299999999999 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:138 3.e 3:71ed46f3:::rbd_object_map.116d6cc70d0.0000000000000003:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.725539+0000", 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.96261346999999997, 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044071799999999999, 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 138 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725539+0000", 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725539+0000", 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725541+0000", 2024-09-11T06:17:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5639999999999999e-06 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725550+0000", 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5059999999999995e-06 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725567+0000", 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6957999999999999e-05 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725576+0000", 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725647+0000", 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1067000000000002e-05 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725740+0000", 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3317000000000001e-05 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.725979+0000", 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023889899999999999 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:145 3.2 e30/24 3:4550e1e5:::rbd_id.image_client.0-clone1:head v 30'1, mlcod=0'0)", 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.734774+0000", 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.95337817700000005, 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058486499999999995, 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.734774+0000", 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.734774+0000", 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.734774+0000", 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8099999999999999e-07 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.734778+0000", 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.25e-06 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.734790+0000", 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1552000000000001e-05 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.734798+0000", 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9559999999999997e-06 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.734837+0000", 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8701000000000001e-05 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.734850+0000", 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2945999999999999e-05 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.735330+0000", 2024-09-11T06:17:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048031899999999999 2024-09-11T06:17:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.735359+0000", 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8960000000000001e-05 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:146 3.3 e30/24 3:c5565208:::rbd_header.116dc3b5629f:head v 30'1, mlcod=0'0)", 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.735949+0000", 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.95220294999999999, 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060120400000000004, 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.735949+0000", 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.735949+0000", 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.735950+0000", 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9200000000000001e-07 2024-09-11T06:17:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.735955+0000", 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4049999999999999e-06 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.735964+0000", 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3340000000000008e-06 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.735970+0000", 2024-09-11T06:17:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1959999999999999e-06 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.736016+0000", 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6638999999999998e-05 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.736034+0000", 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7836999999999999e-05 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.736520+0000", 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048538999999999999 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.736550+0000", 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0811e-05 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:147 3.3 e30/24 3:c5565208:::rbd_header.116dc3b5629f:head v 30'2, mlcod=0'0)", 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.737085+0000", 2024-09-11T06:17:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.95106736800000002, 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048811599999999997, 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737085+0000", 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737085+0000", 2024-09-11T06:17:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737085+0000", 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7599999999999997e-07 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737091+0000", 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2460000000000003e-06 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737099+0000", 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6179999999999995e-06 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737106+0000", 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0600000000000002e-06 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737151+0000", 2024-09-11T06:17:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4988999999999999e-05 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737164+0000", 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2911000000000001e-05 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737546+0000", 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038216900000000002 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.737573+0000", 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6546999999999998e-05 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:161 3.3 e30/24 3:c5565208:::rbd_header.116dc3b5629f:head v 30'3, mlcod=30'1)", 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.752763+0000", 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.93538867800000003, 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066204800000000004, 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.752763+0000", 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.752763+0000", 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.752765+0000", 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4470000000000001e-06 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.752775+0000", 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0190000000000001e-05 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.752793+0000", 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.842e-05 2024-09-11T06:17:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.752803+0000", 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0420000000000008e-06 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.752864+0000", 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1378999999999996e-05 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.752887+0000", 2024-09-11T06:17:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3515000000000001e-05 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.753377+0000", 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048992000000000003 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.753425+0000", 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8134999999999999e-05 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:163 3.3 e30/24 3:c5565208:::rbd_header.116dc3b5629f:head v 30'4, mlcod=30'2)", 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.754547+0000", 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.93360552100000005, 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00063055200000000004, 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.754547+0000", 2024-09-11T06:17:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.754547+0000", 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.754547+0000", 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5700000000000001e-07 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.754558+0000", 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0248000000000001e-05 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.754571+0000", 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3414999999999999e-05 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.754589+0000", 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7986e-05 2024-09-11T06:17:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.754658+0000", 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8604999999999998e-05 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.754678+0000", 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0639999999999999e-05 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.755138+0000", 2024-09-11T06:17:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045929100000000002 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.755177+0000", 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9509999999999999e-05 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:15.732 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:15.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T06:17:15.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T06:17:15.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:15.782 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:15.781+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:15.880 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:15.880 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:15.880 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:15.880 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:15.882 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:15.882+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:15.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:15.983 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:15.982+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:15.993 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:15.993 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:15.993 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:16.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:16.061 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:16.073 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-11T06:17:15.706491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590470,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":174,"num_write":188,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235216,"kb_used_data":2320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739504,"statfs":{"total":773094113280,"available":772853252096,"internally_reserved":0,"allocated":2375680,"data_stored":2006959,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":97,"num_read_kb":74,"num_write":27,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.021738"},"pg_stats":[{"pgid":"3.1f","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.712738+0000","last_change":"2024-09-11T06:17:11.696404+0000","last_active":"2024-09-11T06:17:11.712738+0000","last_peered":"2024-09-11T06:17:11.712738+0000","last_clean":"2024-09-11T06:17:11.712738+0000","last_became_active":"2024-09-11T06:17:09.686692+0000","last_became_peered":"2024-09-11T06:17:09.686692+0000","last_unstale":"2024-09-11T06:17:11.712738+0000","last_undegraded":"2024-09-11T06:17:11.712738+0000","last_fullsized":"2024-09-11T06:17:11.712738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:25.023116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055675899999999999,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696223+0000","last_change":"2024-09-11T06:17:11.696223+0000","last_active":"2024-09-11T06:17:11.696223+0000","last_peered":"2024-09-11T06:17:11.696223+0000","last_clean":"2024-09-11T06:17:11.696223+0000","last_became_active":"2024-09-11T06:17:09.686913+0000","last_became_peered":"2024-09-11T06:17:09.686913+0000","last_unstale":"2024-09-11T06:17:11.696223+0000","last_undegraded":"2024-09-11T06:17:11.696223+0000","last_fullsized":"2024-09-11T06:17:11.696223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:59.587848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044755400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686608+0000","last_change":"2024-09-11T06:17:11.686608+0000","last_active":"2024-09-11T06:17:11.686608+0000","last_peered":"2024-09-11T06:17:11.686608+0000","last_clean":"2024-09-11T06:17:11.686608+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:17:11.686608+0000","last_undegraded":"2024-09-11T06:17:11.686608+0000","last_fullsized":"2024-09-11T06:17:11.686608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:58.978022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043939800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1c","version":"27'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696926+0000","last_change":"2024-09-11T06:17:11.693842+0000","last_active":"2024-09-11T06:17:11.696926+0000","last_peered":"2024-09-11T06:17:11.696926+0000","last_clean":"2024-09-11T06:17:11.696926+0000","last_became_active":"2024-09-11T06:17:09.680193+0000","last_became_peered":"2024-09-11T06:17:09.680193+0000","last_unstale":"2024-09-11T06:17:11.696926+0000","last_undegraded":"2024-09-11T06:17:11.696926+0000","last_fullsized":"2024-09-11T06:17:11.696926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:58:26.641802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050198799999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687868+0000","last_change":"2024-09-11T06:17:11.687868+0000","last_active":"2024-09-11T06:17:11.687868+0000","last_peered":"2024-09-11T06:17:11.687868+0000","last_clean":"2024-09-11T06:17:11.687868+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:17:11.687868+0000","last_undegraded":"2024-09-11T06:17:11.687868+0000","last_fullsized":"2024-09-11T06:17:11.687868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:24.551430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083693899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1a","version":"27'2","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.715410+0000","last_change":"2024-09-11T06:17:11.694349+0000","last_active":"2024-09-11T06:17:11.715410+0000","last_peered":"2024-09-11T06:17:11.715410+0000","last_clean":"2024-09-11T06:17:11.715410+0000","last_became_active":"2024-09-11T06:17:09.686937+0000","last_became_peered":"2024-09-11T06:17:09.686937+0000","last_unstale":"2024-09-11T06:17:11.715410+0000","last_undegraded":"2024-09-11T06:17:11.715410+0000","last_fullsized":"2024-09-11T06:17:11.715410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:02.892965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010284269999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687649+0000","last_change":"2024-09-11T06:17:11.687649+0000","last_active":"2024-09-11T06:17:11.687649+0000","last_peered":"2024-09-11T06:17:11.687649+0000","last_clean":"2024-09-11T06:17:11.687649+0000","last_became_active":"2024-09-11T06:17:09.680455+0000","last_became_peered":"2024-09-11T06:17:09.680455+0000","last_unstale":"2024-09-11T06:17:11.687649+0000","last_undegraded":"2024-09-11T06:17:11.687649+0000","last_fullsized":"2024-09-11T06:17:11.687649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:59.622237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063361600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696586+0000","last_change":"2024-09-11T06:17:11.696586+0000","last_active":"2024-09-11T06:17:11.696586+0000","last_peered":"2024-09-11T06:17:11.696586+0000","last_clean":"2024-09-11T06:17:11.696586+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:17:11.696586+0000","last_undegraded":"2024-09-11T06:17:11.696586+0000","last_fullsized":"2024-09-11T06:17:11.696586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:18.529864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068430699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696490+0000","last_change":"2024-09-11T06:17:11.696490+0000","last_active":"2024-09-11T06:17:11.696490+0000","last_peered":"2024-09-11T06:17:11.696490+0000","last_clean":"2024-09-11T06:17:11.696490+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:17:11.696490+0000","last_undegraded":"2024-09-11T06:17:11.696490+0000","last_fullsized":"2024-09-11T06:17:11.696490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:43.569991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061525900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687060+0000","last_change":"2024-09-11T06:17:11.687060+0000","last_active":"2024-09-11T06:17:11.687060+0000","last_peered":"2024-09-11T06:17:11.687060+0000","last_clean":"2024-09-11T06:17:11.687060+0000","last_became_active":"2024-09-11T06:17:09.686021+0000","last_became_peered":"2024-09-11T06:17:09.686021+0000","last_unstale":"2024-09-11T06:17:11.687060+0000","last_undegraded":"2024-09-11T06:17:11.687060+0000","last_fullsized":"2024-09-11T06:17:11.687060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:50.902096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055303299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.698114+0000","last_change":"2024-09-11T06:17:11.698114+0000","last_active":"2024-09-11T06:17:11.698114+0000","last_peered":"2024-09-11T06:17:11.698114+0000","last_clean":"2024-09-11T06:17:11.698114+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:17:11.698114+0000","last_undegraded":"2024-09-11T06:17:11.698114+0000","last_fullsized":"2024-09-11T06:17:11.698114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:02:59.082124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057854300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687074+0000","last_change":"2024-09-11T06:17:11.687074+0000","last_active":"2024-09-11T06:17:11.687074+0000","last_peered":"2024-09-11T06:17:11.687074+0000","last_clean":"2024-09-11T06:17:11.687074+0000","last_became_active":"2024-09-11T06:17:09.682654+0000","last_became_peered":"2024-09-11T06:17:09.682654+0000","last_unstale":"2024-09-11T06:17:11.687074+0000","last_undegraded":"2024-09-11T06:17:11.687074+0000","last_fullsized":"2024-09-11T06:17:11.687074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:20.848729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086341200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686323+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:11.686323+0000","last_peered":"2024-09-11T06:17:11.686323+0000","last_clean":"2024-09-11T06:17:11.686323+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:11.686323+0000","last_undegraded":"2024-09-11T06:17:11.686323+0000","last_fullsized":"2024-09-11T06:17:11.686323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687369+0000","last_change":"2024-09-11T06:17:11.687369+0000","last_active":"2024-09-11T06:17:11.687369+0000","last_peered":"2024-09-11T06:17:11.687369+0000","last_clean":"2024-09-11T06:17:11.687369+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:17:11.687369+0000","last_undegraded":"2024-09-11T06:17:11.687369+0000","last_fullsized":"2024-09-11T06:17:11.687369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:53.668373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037671699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686981+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:11.686981+0000","last_peered":"2024-09-11T06:17:11.686981+0000","last_clean":"2024-09-11T06:17:11.686981+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:11.686981+0000","last_undegraded":"2024-09-11T06:17:11.686981+0000","last_fullsized":"2024-09-11T06:17:11.686981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.688067+0000","last_change":"2024-09-11T06:17:11.688067+0000","last_active":"2024-09-11T06:17:11.688067+0000","last_peered":"2024-09-11T06:17:11.688067+0000","last_clean":"2024-09-11T06:17:11.688067+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:17:11.688067+0000","last_undegraded":"2024-09-11T06:17:11.688067+0000","last_fullsized":"2024-09-11T06:17:11.688067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:31.532453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090634000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686454+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:11.686454+0000","last_peered":"2024-09-11T06:17:11.686454+0000","last_clean":"2024-09-11T06:17:11.686454+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:11.686454+0000","last_undegraded":"2024-09-11T06:17:11.686454+0000","last_fullsized":"2024-09-11T06:17:11.686454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T06:17:10.948659+0000","last_change":"2024-09-11T06:17:09.687224+0000","last_active":"2024-09-11T06:17:10.948659+0000","last_peered":"2024-09-11T06:17:10.948659+0000","last_clean":"2024-09-11T06:17:10.948659+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:17:10.948659+0000","last_undegraded":"2024-09-11T06:17:10.948659+0000","last_fullsized":"2024-09-11T06:17:10.948659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:01:14.125307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.695634+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:11.695634+0000","last_peered":"2024-09-11T06:17:11.695634+0000","last_clean":"2024-09-11T06:17:11.695634+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:11.695634+0000","last_undegraded":"2024-09-11T06:17:11.695634+0000","last_fullsized":"2024-09-11T06:17:11.695634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686630+0000","last_change":"2024-09-11T06:17:11.686630+0000","last_active":"2024-09-11T06:17:11.686630+0000","last_peered":"2024-09-11T06:17:11.686630+0000","last_clean":"2024-09-11T06:17:11.686630+0000","last_became_active":"2024-09-11T06:17:09.680887+0000","last_became_peered":"2024-09-11T06:17:09.680887+0000","last_unstale":"2024-09-11T06:17:11.686630+0000","last_undegraded":"2024-09-11T06:17:11.686630+0000","last_fullsized":"2024-09-11T06:17:11.686630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:01:07.736778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037792000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.697859+0000","last_change":"2024-09-11T06:17:11.697859+0000","last_active":"2024-09-11T06:17:11.697859+0000","last_peered":"2024-09-11T06:17:11.697859+0000","last_clean":"2024-09-11T06:17:11.697859+0000","last_became_active":"2024-09-11T06:17:09.676881+0000","last_became_peered":"2024-09-11T06:17:09.676881+0000","last_unstale":"2024-09-11T06:17:11.697859+0000","last_undegraded":"2024-09-11T06:17:11.697859+0000","last_fullsized":"2024-09-11T06:17:11.697859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:46.402579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038778,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687559+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:11.687559+0000","last_peered":"2024-09-11T06:17:11.687559+0000","last_clean":"2024-09-11T06:17:11.687559+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:11.687559+0000","last_undegraded":"2024-09-11T06:17:11.687559+0000","last_fullsized":"2024-09-11T06:17:11.687559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696180+0000","last_change":"2024-09-11T06:17:11.696180+0000","last_active":"2024-09-11T06:17:11.696180+0000","last_peered":"2024-09-11T06:17:11.696180+0000","last_clean":"2024-09-11T06:17:11.696180+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:17:11.696180+0000","last_undegraded":"2024-09-11T06:17:11.696180+0000","last_fullsized":"2024-09-11T06:17:11.696180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:31:31.686261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042951600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T06:17:13.702490+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:13.702490+0000","last_peered":"2024-09-11T06:17:13.702490+0000","last_clean":"2024-09-11T06:17:13.702490+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:13.702490+0000","last_undegraded":"2024-09-11T06:17:13.702490+0000","last_fullsized":"2024-09-11T06:17:13.702490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T06:17:10.948580+0000","last_change":"2024-09-11T06:17:09.680262+0000","last_active":"2024-09-11T06:17:10.948580+0000","last_peered":"2024-09-11T06:17:10.948580+0000","last_clean":"2024-09-11T06:17:10.948580+0000","last_became_active":"2024-09-11T06:17:09.679986+0000","last_became_peered":"2024-09-11T06:17:09.679986+0000","last_unstale":"2024-09-11T06:17:10.948580+0000","last_undegraded":"2024-09-11T06:17:10.948580+0000","last_fullsized":"2024-09-11T06:17:10.948580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:04:05.616122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686094+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:11.686094+0000","last_peered":"2024-09-11T06:17:11.686094+0000","last_clean":"2024-09-11T06:17:11.686094+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:11.686094+0000","last_undegraded":"2024-09-11T06:17:11.686094+0000","last_fullsized":"2024-09-11T06:17:11.686094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.688135+0000","last_change":"2024-09-11T06:17:11.688135+0000","last_active":"2024-09-11T06:17:11.688135+0000","last_peered":"2024-09-11T06:17:11.688135+0000","last_clean":"2024-09-11T06:17:11.688135+0000","last_became_active":"2024-09-11T06:17:09.675683+0000","last_became_peered":"2024-09-11T06:17:09.675683+0000","last_unstale":"2024-09-11T06:17:11.688135+0000","last_undegraded":"2024-09-11T06:17:11.688135+0000","last_fullsized":"2024-09-11T06:17:11.688135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:40.286963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012130579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686615+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:11.686615+0000","last_peered":"2024-09-11T06:17:11.686615+0000","last_clean":"2024-09-11T06:17:11.686615+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:11.686615+0000","last_undegraded":"2024-09-11T06:17:11.686615+0000","last_fullsized":"2024-09-11T06:17:11.686615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.693191+0000","last_change":"2024-09-11T06:16:53.499469+0000","last_active":"2024-09-11T06:17:11.693191+0000","last_peered":"2024-09-11T06:17:11.693191+0000","last_clean":"2024-09-11T06:17:11.693191+0000","last_became_active":"2024-09-11T06:16:53.498584+0000","last_became_peered":"2024-09-11T06:16:53.498584+0000","last_unstale":"2024-09-11T06:17:11.693191+0000","last_undegraded":"2024-09-11T06:17:11.693191+0000","last_fullsized":"2024-09-11T06:17:11.693191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:54.729518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687357+0000","last_change":"2024-09-11T06:17:11.687357+0000","last_active":"2024-09-11T06:17:11.687357+0000","last_peered":"2024-09-11T06:17:11.687357+0000","last_clean":"2024-09-11T06:17:11.687357+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:17:11.687357+0000","last_undegraded":"2024-09-11T06:17:11.687357+0000","last_fullsized":"2024-09-11T06:17:11.687357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:04:54.758362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000447842,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687822+0000","last_change":"2024-09-11T06:17:11.687822+0000","last_active":"2024-09-11T06:17:11.687822+0000","last_peered":"2024-09-11T06:17:11.687822+0000","last_clean":"2024-09-11T06:17:11.687822+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:17:11.687822+0000","last_undegraded":"2024-09-11T06:17:11.687822+0000","last_fullsized":"2024-09-11T06:17:11.687822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:25.576489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065835799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.688223+0000","last_change":"2024-09-11T06:17:11.688223+0000","last_active":"2024-09-11T06:17:11.688223+0000","last_peered":"2024-09-11T06:17:11.688223+0000","last_clean":"2024-09-11T06:17:11.688223+0000","last_became_active":"2024-09-11T06:17:09.684600+0000","last_became_peered":"2024-09-11T06:17:09.684600+0000","last_unstale":"2024-09-11T06:17:11.688223+0000","last_undegraded":"2024-09-11T06:17:11.688223+0000","last_fullsized":"2024-09-11T06:17:11.688223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:12:44.688362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011423570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.b","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T06:17:13.702541+0000","last_change":"2024-09-11T06:17:11.706968+0000","last_active":"2024-09-11T06:17:13.702541+0000","last_peered":"2024-09-11T06:17:13.702541+0000","last_clean":"2024-09-11T06:17:13.702541+0000","last_became_active":"2024-09-11T06:17:09.681406+0000","last_became_peered":"2024-09-11T06:17:09.681406+0000","last_unstale":"2024-09-11T06:17:13.702541+0000","last_undegraded":"2024-09-11T06:17:13.702541+0000","last_fullsized":"2024-09-11T06:17:13.702541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:40.278324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001045058,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":48,"num_write":22,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.697872+0000","last_change":"2024-09-11T06:17:11.697872+0000","last_active":"2024-09-11T06:17:11.697872+0000","last_peered":"2024-09-11T06:17:11.697872+0000","last_clean":"2024-09-11T06:17:11.697872+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:17:11.697872+0000","last_undegraded":"2024-09-11T06:17:11.697872+0000","last_fullsized":"2024-09-11T06:17:11.697872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:42:10.598425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035767299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687174+0000","last_change":"2024-09-11T06:17:11.687174+0000","last_active":"2024-09-11T06:17:11.687174+0000","last_peered":"2024-09-11T06:17:11.687174+0000","last_clean":"2024-09-11T06:17:11.687174+0000","last_became_active":"2024-09-11T06:17:09.684618+0000","last_became_peered":"2024-09-11T06:17:09.684618+0000","last_unstale":"2024-09-11T06:17:11.687174+0000","last_undegraded":"2024-09-11T06:17:11.687174+0000","last_fullsized":"2024-09-11T06:17:11.687174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:36:19.278529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067139399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687235+0000","last_change":"2024-09-11T06:17:11.687235+0000","last_active":"2024-09-11T06:17:11.687235+0000","last_peered":"2024-09-11T06:17:11.687235+0000","last_clean":"2024-09-11T06:17:11.687235+0000","last_became_active":"2024-09-11T06:17:09.679886+0000","last_became_peered":"2024-09-11T06:17:09.679886+0000","last_unstale":"2024-09-11T06:17:11.687235+0000","last_undegraded":"2024-09-11T06:17:11.687235+0000","last_fullsized":"2024-09-11T06:17:11.687235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:46:53.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055427899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.f","version":"27'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.716864+0000","last_change":"2024-09-11T06:17:11.698134+0000","last_active":"2024-09-11T06:17:11.716864+0000","last_peered":"2024-09-11T06:17:11.716864+0000","last_clean":"2024-09-11T06:17:11.716864+0000","last_became_active":"2024-09-11T06:17:09.679342+0000","last_became_peered":"2024-09-11T06:17:09.679342+0000","last_unstale":"2024-09-11T06:17:11.716864+0000","last_undegraded":"2024-09-11T06:17:11.716864+0000","last_fullsized":"2024-09-11T06:17:11.716864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:47:01.034550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000507126,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.694074+0000","last_change":"2024-09-11T06:17:11.694074+0000","last_active":"2024-09-11T06:17:11.694074+0000","last_peered":"2024-09-11T06:17:11.694074+0000","last_clean":"2024-09-11T06:17:11.694074+0000","last_became_active":"2024-09-11T06:17:09.687700+0000","last_became_peered":"2024-09-11T06:17:09.687700+0000","last_unstale":"2024-09-11T06:17:11.694074+0000","last_undegraded":"2024-09-11T06:17:11.694074+0000","last_fullsized":"2024-09-11T06:17:11.694074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:27.772192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000629096,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687432+0000","last_change":"2024-09-11T06:17:11.687432+0000","last_active":"2024-09-11T06:17:11.687432+0000","last_peered":"2024-09-11T06:17:11.687432+0000","last_clean":"2024-09-11T06:17:11.687432+0000","last_became_active":"2024-09-11T06:17:09.683890+0000","last_became_peered":"2024-09-11T06:17:09.683890+0000","last_unstale":"2024-09-11T06:17:11.687432+0000","last_undegraded":"2024-09-11T06:17:11.687432+0000","last_fullsized":"2024-09-11T06:17:11.687432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:49:25.768949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076837599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T06:17:10.948578+0000","last_change":"2024-09-11T06:17:09.685820+0000","last_active":"2024-09-11T06:17:10.948578+0000","last_peered":"2024-09-11T06:17:10.948578+0000","last_clean":"2024-09-11T06:17:10.948578+0000","last_became_active":"2024-09-11T06:17:09.685538+0000","last_became_peered":"2024-09-11T06:17:09.685538+0000","last_unstale":"2024-09-11T06:17:10.948578+0000","last_undegraded":"2024-09-11T06:17:10.948578+0000","last_fullsized":"2024-09-11T06:17:10.948578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:43.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687422+0000","last_change":"2024-09-11T06:17:11.687422+0000","last_active":"2024-09-11T06:17:11.687422+0000","last_peered":"2024-09-11T06:17:11.687422+0000","last_clean":"2024-09-11T06:17:11.687422+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:17:11.687422+0000","last_undegraded":"2024-09-11T06:17:11.687422+0000","last_fullsized":"2024-09-11T06:17:11.687422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:07.952440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091740099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":97,"num_read_kb":74,"num_write":27,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":695313,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":98708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":274432,"data_stored":98727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":104911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":331776,"data_stored":689084,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":282624,"data_stored":104911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":98727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":311296,"data_stored":116578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":49,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:16.075 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:16.115 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:16.114+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:16.149 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:16.149 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:16.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:16.149 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:16.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.528106104999999, 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:17:16.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:17:16.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:17:16.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:17:16.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4263.0:1 2.3 e20/19 ondisk, result = 0)", 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.911246+0000", 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.236489851000002, 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000206794, 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911246+0000", 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911246+0000", 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911247+0000", 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9800000000000003e-07 2024-09-11T06:17:16.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911252+0000", 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911264+0000", 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.151e-05 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911271+0000", 2024-09-11T06:17:16.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9999999999999999e-06 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911322+0000", 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1180999999999997e-05 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911331+0000", 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8529999999999998e-06 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911453+0000", 2024-09-11T06:17:16.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121892 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.233670527000001, 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:16.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:16.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.987702+0000", 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.160033837, 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030655999999999999, 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987702+0000", 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987702+0000", 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987703+0000", 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0470000000000001e-06 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987709+0000", 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5690000000000001e-06 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987721+0000", 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1460999999999999e-05 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987728+0000", 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7270000000000001e-06 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987886+0000", 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158491 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.988008+0000", 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012226500000000001 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:00.626591+0000", 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.521145053, 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017394120000000001, 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626591+0000", 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626591+0000", 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626593+0000", 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3010000000000001e-06 2024-09-11T06:17:16.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626604+0000", 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0723999999999999e-05 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626619+0000", 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5716e-05 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626637+0000", 2024-09-11T06:17:16.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7326999999999999e-05 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626704+0000", 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7891000000000004e-05 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626829+0000", 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124466 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626952+0000", 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123041 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.627782+0000", 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083002200000000003 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.628259+0000", 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000477324 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.628298+0000", 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8878000000000003e-05 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.628330+0000", 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1721999999999999e-05 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:01.628325+0000", 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.519410361, 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001650742, 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628325+0000", 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628325+0000", 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628328+0000", 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3290000000000001e-06 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628337+0000", 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3000000000000007e-06 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628353+0000", 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6622000000000001e-05 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628362+0000", 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7450000000000001e-06 2024-09-11T06:17:16.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628416+0000", 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730999999999998e-05 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628486+0000", 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9987000000000006e-05 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628640+0000", 2024-09-11T06:17:16.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015440699999999999 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.629449+0000", 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080906800000000003 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.629878+0000", 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000428799 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.629925+0000", 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.629976+0000", 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1255999999999999e-05 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:140 3.1d 3:ba76cd85:::image_client.0-clone1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.726112+0000", 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.421623404, 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001853876, 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 140 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726112+0000", 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726112+0000", 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726114+0000", 2024-09-11T06:17:16.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.539e-06 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726120+0000", 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4649999999999999e-06 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726135+0000", 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4399999999999999e-05 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726146+0000", 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1171e-05 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726202+0000", 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6648999999999999e-05 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726208+0000", 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2279999999999998e-06 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.727859+0000", 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001650973 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.727966+0000", 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107451 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:353 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.740569+0000", 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.407166998, 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028086799999999998, 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 353 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740569+0000", 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740569+0000", 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740571+0000", 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740578+0000", 2024-09-11T06:17:16.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4569999999999999e-06 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740597+0000", 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8961e-05 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740607+0000", 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.815e-06 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740671+0000", 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4009000000000003e-05 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740752+0000", 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0932000000000004e-05 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740849+0000", 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7748e-05 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:354 3.14 3:2c43f392:::rbd_data.116d6cc70d0.0000000000000025:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.740628+0000", 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40710782699999998, 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020621100000000001, 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 354 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740628+0000", 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740628+0000", 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740628+0000", 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740633+0000", 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740640+0000", 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.593e-06 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740646+0000", 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:17:16.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740706+0000", 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0600000000000003e-05 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740834+0000", 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012785300000000001 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:356 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:3 [sparse-read 0~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.740997+0000", 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40673894599999999, 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028876200000000002, 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 356 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740997+0000", 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740997+0000", 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740998+0000", 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741008+0000", 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0618999999999999e-05 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741023+0000", 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5160999999999999e-05 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741031+0000", 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6580000000000002e-06 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741083+0000", 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1774999999999998e-05 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741168+0000", 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5661000000000005e-05 2024-09-11T06:17:16.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741285+0000", 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117019 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:357 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.741115+0000", 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40662095199999998, 2024-09-11T06:17:16.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036100699999999999, 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 357 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741115+0000", 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741115+0000", 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741115+0000", 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3900000000000004e-07 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741119+0000", 2024-09-11T06:17:16.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0130000000000004e-06 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741129+0000", 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9350000000000006e-06 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741137+0000", 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2749999999999998e-06 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741348+0000", 2024-09-11T06:17:16.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000210898 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741399+0000", 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1017999999999998e-05 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741476+0000", 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7028999999999997e-05 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:362 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.741655+0000", 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40608105900000002, 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000234801, 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 362 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741655+0000", 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741655+0000", 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741655+0000", 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9899999999999999e-07 2024-09-11T06:17:16.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741660+0000", 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2930000000000002e-06 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741672+0000", 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2177999999999999e-05 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741683+0000", 2024-09-11T06:17:16.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0929e-05 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741739+0000", 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5748000000000002e-05 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741802+0000", 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2960999999999996e-05 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741889+0000", 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7793000000000005e-05 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:365 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:3 [sparse-read 131072~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.741754+0000", 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40598171700000002, 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00033683900000000002, 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 365 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741754+0000", 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741754+0000", 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741754+0000", 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9400000000000005e-07 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741762+0000", 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9049999999999997e-06 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741775+0000", 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2187e-05 2024-09-11T06:17:16.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741787+0000", 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2627e-05 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741921+0000", 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133767 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741987+0000", 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6401000000000003e-05 2024-09-11T06:17:16.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742091+0000", 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103358 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:366 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.742107+0000", 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.405628769, 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020789100000000001, 2024-09-11T06:17:16.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 366 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742107+0000", 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742107+0000", 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742108+0000", 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9899999999999999e-07 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742113+0000", 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8760000000000004e-06 2024-09-11T06:17:16.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742126+0000", 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3045e-05 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742133+0000", 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.525e-06 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742173+0000", 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0101000000000001e-05 2024-09-11T06:17:16.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742241+0000", 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7779000000000003e-05 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742315+0000", 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3665999999999996e-05 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:368 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:3 [sparse-read 262144~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.742165+0000", 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40557064399999998, 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037775299999999999, 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 368 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742165+0000", 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742165+0000", 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742165+0000", 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2300000000000002e-07 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742167+0000", 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9479999999999998e-06 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742173+0000", 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.57e-06 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742176+0000", 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742354+0000", 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000178264 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742434+0000", 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0383999999999995e-05 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742543+0000", 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:369 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.742186+0000", 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.405549406, 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054665400000000004, 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 369 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742186+0000", 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742186+0000", 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742187+0000", 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0299999999999999e-07 2024-09-11T06:17:16.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742189+0000", 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1380000000000001e-06 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742193+0000", 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4510000000000002e-06 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742196+0000", 2024-09-11T06:17:16.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742574+0000", 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037726699999999998 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742663+0000", 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9393000000000003e-05 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742733+0000", 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9832000000000005e-05 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:371 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.742372+0000", 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.405363221, 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054636699999999997, 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 371 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742372+0000", 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742372+0000", 2024-09-11T06:17:16.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742373+0000", 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7400000000000002e-07 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742384+0000", 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0715e-05 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742392+0000", 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:17:16.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742398+0000", 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1510000000000001e-06 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742761+0000", 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036378300000000001 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742829+0000", 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7589999999999995e-05 2024-09-11T06:17:16.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742919+0000", 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9679000000000007e-05 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:373 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:3 [sparse-read 393216~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.742457+0000", 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40527812200000002, 2024-09-11T06:17:16.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067175799999999995, 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 373 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742457+0000", 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742457+0000", 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742458+0000", 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7700000000000005e-07 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742461+0000", 2024-09-11T06:17:16.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7319999999999998e-06 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742468+0000", 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7680000000000008e-06 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742474+0000", 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9959999999999999e-06 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742943+0000", 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000468531 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.743020+0000", 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6637000000000005e-05 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.743129+0000", 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109617 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:376 3.a 3:54256fac:::rbd_data.116d6cc70d0.0000000000000024:3 [sparse-read 524288~34842 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.742943+0000", 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.40479272900000002, 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052043399999999996, 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 376 2024-09-11T06:17:16.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742943+0000", 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742943+0000", 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742944+0000", 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9999999999999996e-07 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742948+0000", 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000003e-06 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742959+0000", 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0913e-05 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742966+0000", 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1180000000000003e-06 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.743159+0000", 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193449 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.743234+0000", 2024-09-11T06:17:16.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4630999999999997e-05 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.743463+0000", 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000229223 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:421 2.2 2:535385f0:::rbd_children:head [call rbd.get_children in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.768218+0000", 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.37951748899999999, 2024-09-11T06:17:16.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021274400000000001, 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 421 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.768218+0000", 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.768218+0000", 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.768220+0000", 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.477e-06 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.768226+0000", 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6540000000000002e-06 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.768239+0000", 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2921e-05 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.768246+0000", 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6839999999999999e-06 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.768306+0000", 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0608e-05 2024-09-11T06:17:16.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.768431+0000", 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012439999999999999 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:16.241 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:16.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:16.243 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:16.242+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:16.343 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:16.343+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:16.358 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:16.358 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:16.358 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:16.358 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:16.367 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:16.392 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:16.393 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:16.404 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-11T06:17:15.706491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590470,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":213,"num_read_kb":174,"num_write":188,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235216,"kb_used_data":2320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739504,"statfs":{"total":773094113280,"available":772853252096,"internally_reserved":0,"allocated":2375680,"data_stored":2006959,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":97,"num_read_kb":74,"num_write":27,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.021738"},"pg_stats":[{"pgid":"3.1f","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.712738+0000","last_change":"2024-09-11T06:17:11.696404+0000","last_active":"2024-09-11T06:17:11.712738+0000","last_peered":"2024-09-11T06:17:11.712738+0000","last_clean":"2024-09-11T06:17:11.712738+0000","last_became_active":"2024-09-11T06:17:09.686692+0000","last_became_peered":"2024-09-11T06:17:09.686692+0000","last_unstale":"2024-09-11T06:17:11.712738+0000","last_undegraded":"2024-09-11T06:17:11.712738+0000","last_fullsized":"2024-09-11T06:17:11.712738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:25.023116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055675899999999999,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696223+0000","last_change":"2024-09-11T06:17:11.696223+0000","last_active":"2024-09-11T06:17:11.696223+0000","last_peered":"2024-09-11T06:17:11.696223+0000","last_clean":"2024-09-11T06:17:11.696223+0000","last_became_active":"2024-09-11T06:17:09.686913+0000","last_became_peered":"2024-09-11T06:17:09.686913+0000","last_unstale":"2024-09-11T06:17:11.696223+0000","last_undegraded":"2024-09-11T06:17:11.696223+0000","last_fullsized":"2024-09-11T06:17:11.696223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:59.587848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044755400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686608+0000","last_change":"2024-09-11T06:17:11.686608+0000","last_active":"2024-09-11T06:17:11.686608+0000","last_peered":"2024-09-11T06:17:11.686608+0000","last_clean":"2024-09-11T06:17:11.686608+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:17:11.686608+0000","last_undegraded":"2024-09-11T06:17:11.686608+0000","last_fullsized":"2024-09-11T06:17:11.686608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:58.978022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043939800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1c","version":"27'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696926+0000","last_change":"2024-09-11T06:17:11.693842+0000","last_active":"2024-09-11T06:17:11.696926+0000","last_peered":"2024-09-11T06:17:11.696926+0000","last_clean":"2024-09-11T06:17:11.696926+0000","last_became_active":"2024-09-11T06:17:09.680193+0000","last_became_peered":"2024-09-11T06:17:09.680193+0000","last_unstale":"2024-09-11T06:17:11.696926+0000","last_undegraded":"2024-09-11T06:17:11.696926+0000","last_fullsized":"2024-09-11T06:17:11.696926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:58:26.641802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050198799999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687868+0000","last_change":"2024-09-11T06:17:11.687868+0000","last_active":"2024-09-11T06:17:11.687868+0000","last_peered":"2024-09-11T06:17:11.687868+0000","last_clean":"2024-09-11T06:17:11.687868+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:17:11.687868+0000","last_undegraded":"2024-09-11T06:17:11.687868+0000","last_fullsized":"2024-09-11T06:17:11.687868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:24.551430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083693899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1a","version":"27'2","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.715410+0000","last_change":"2024-09-11T06:17:11.694349+0000","last_active":"2024-09-11T06:17:11.715410+0000","last_peered":"2024-09-11T06:17:11.715410+0000","last_clean":"2024-09-11T06:17:11.715410+0000","last_became_active":"2024-09-11T06:17:09.686937+0000","last_became_peered":"2024-09-11T06:17:09.686937+0000","last_unstale":"2024-09-11T06:17:11.715410+0000","last_undegraded":"2024-09-11T06:17:11.715410+0000","last_fullsized":"2024-09-11T06:17:11.715410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:02.892965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010284269999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687649+0000","last_change":"2024-09-11T06:17:11.687649+0000","last_active":"2024-09-11T06:17:11.687649+0000","last_peered":"2024-09-11T06:17:11.687649+0000","last_clean":"2024-09-11T06:17:11.687649+0000","last_became_active":"2024-09-11T06:17:09.680455+0000","last_became_peered":"2024-09-11T06:17:09.680455+0000","last_unstale":"2024-09-11T06:17:11.687649+0000","last_undegraded":"2024-09-11T06:17:11.687649+0000","last_fullsized":"2024-09-11T06:17:11.687649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:59.622237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063361600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696586+0000","last_change":"2024-09-11T06:17:11.696586+0000","last_active":"2024-09-11T06:17:11.696586+0000","last_peered":"2024-09-11T06:17:11.696586+0000","last_clean":"2024-09-11T06:17:11.696586+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:17:11.696586+0000","last_undegraded":"2024-09-11T06:17:11.696586+0000","last_fullsized":"2024-09-11T06:17:11.696586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:18.529864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068430699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696490+0000","last_change":"2024-09-11T06:17:11.696490+0000","last_active":"2024-09-11T06:17:11.696490+0000","last_peered":"2024-09-11T06:17:11.696490+0000","last_clean":"2024-09-11T06:17:11.696490+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:17:11.696490+0000","last_undegraded":"2024-09-11T06:17:11.696490+0000","last_fullsized":"2024-09-11T06:17:11.696490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:43.569991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061525900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687060+0000","last_change":"2024-09-11T06:17:11.687060+0000","last_active":"2024-09-11T06:17:11.687060+0000","last_peered":"2024-09-11T06:17:11.687060+0000","last_clean":"2024-09-11T06:17:11.687060+0000","last_became_active":"2024-09-11T06:17:09.686021+0000","last_became_peered":"2024-09-11T06:17:09.686021+0000","last_unstale":"2024-09-11T06:17:11.687060+0000","last_undegraded":"2024-09-11T06:17:11.687060+0000","last_fullsized":"2024-09-11T06:17:11.687060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:50.902096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055303299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.698114+0000","last_change":"2024-09-11T06:17:11.698114+0000","last_active":"2024-09-11T06:17:11.698114+0000","last_peered":"2024-09-11T06:17:11.698114+0000","last_clean":"2024-09-11T06:17:11.698114+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:17:11.698114+0000","last_undegraded":"2024-09-11T06:17:11.698114+0000","last_fullsized":"2024-09-11T06:17:11.698114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:02:59.082124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057854300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687074+0000","last_change":"2024-09-11T06:17:11.687074+0000","last_active":"2024-09-11T06:17:11.687074+0000","last_peered":"2024-09-11T06:17:11.687074+0000","last_clean":"2024-09-11T06:17:11.687074+0000","last_became_active":"2024-09-11T06:17:09.682654+0000","last_became_peered":"2024-09-11T06:17:09.682654+0000","last_unstale":"2024-09-11T06:17:11.687074+0000","last_undegraded":"2024-09-11T06:17:11.687074+0000","last_fullsized":"2024-09-11T06:17:11.687074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:20.848729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086341200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686323+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:11.686323+0000","last_peered":"2024-09-11T06:17:11.686323+0000","last_clean":"2024-09-11T06:17:11.686323+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:11.686323+0000","last_undegraded":"2024-09-11T06:17:11.686323+0000","last_fullsized":"2024-09-11T06:17:11.686323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687369+0000","last_change":"2024-09-11T06:17:11.687369+0000","last_active":"2024-09-11T06:17:11.687369+0000","last_peered":"2024-09-11T06:17:11.687369+0000","last_clean":"2024-09-11T06:17:11.687369+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:17:11.687369+0000","last_undegraded":"2024-09-11T06:17:11.687369+0000","last_fullsized":"2024-09-11T06:17:11.687369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:53.668373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037671699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686981+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:11.686981+0000","last_peered":"2024-09-11T06:17:11.686981+0000","last_clean":"2024-09-11T06:17:11.686981+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:11.686981+0000","last_undegraded":"2024-09-11T06:17:11.686981+0000","last_fullsized":"2024-09-11T06:17:11.686981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.688067+0000","last_change":"2024-09-11T06:17:11.688067+0000","last_active":"2024-09-11T06:17:11.688067+0000","last_peered":"2024-09-11T06:17:11.688067+0000","last_clean":"2024-09-11T06:17:11.688067+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:17:11.688067+0000","last_undegraded":"2024-09-11T06:17:11.688067+0000","last_fullsized":"2024-09-11T06:17:11.688067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:31.532453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090634000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686454+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:11.686454+0000","last_peered":"2024-09-11T06:17:11.686454+0000","last_clean":"2024-09-11T06:17:11.686454+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:11.686454+0000","last_undegraded":"2024-09-11T06:17:11.686454+0000","last_fullsized":"2024-09-11T06:17:11.686454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T06:17:10.948659+0000","last_change":"2024-09-11T06:17:09.687224+0000","last_active":"2024-09-11T06:17:10.948659+0000","last_peered":"2024-09-11T06:17:10.948659+0000","last_clean":"2024-09-11T06:17:10.948659+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:17:10.948659+0000","last_undegraded":"2024-09-11T06:17:10.948659+0000","last_fullsized":"2024-09-11T06:17:10.948659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:01:14.125307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.695634+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:11.695634+0000","last_peered":"2024-09-11T06:17:11.695634+0000","last_clean":"2024-09-11T06:17:11.695634+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:11.695634+0000","last_undegraded":"2024-09-11T06:17:11.695634+0000","last_fullsized":"2024-09-11T06:17:11.695634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686630+0000","last_change":"2024-09-11T06:17:11.686630+0000","last_active":"2024-09-11T06:17:11.686630+0000","last_peered":"2024-09-11T06:17:11.686630+0000","last_clean":"2024-09-11T06:17:11.686630+0000","last_became_active":"2024-09-11T06:17:09.680887+0000","last_became_peered":"2024-09-11T06:17:09.680887+0000","last_unstale":"2024-09-11T06:17:11.686630+0000","last_undegraded":"2024-09-11T06:17:11.686630+0000","last_fullsized":"2024-09-11T06:17:11.686630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:01:07.736778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037792000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.697859+0000","last_change":"2024-09-11T06:17:11.697859+0000","last_active":"2024-09-11T06:17:11.697859+0000","last_peered":"2024-09-11T06:17:11.697859+0000","last_clean":"2024-09-11T06:17:11.697859+0000","last_became_active":"2024-09-11T06:17:09.676881+0000","last_became_peered":"2024-09-11T06:17:09.676881+0000","last_unstale":"2024-09-11T06:17:11.697859+0000","last_undegraded":"2024-09-11T06:17:11.697859+0000","last_fullsized":"2024-09-11T06:17:11.697859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:46.402579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038778,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687559+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:11.687559+0000","last_peered":"2024-09-11T06:17:11.687559+0000","last_clean":"2024-09-11T06:17:11.687559+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:11.687559+0000","last_undegraded":"2024-09-11T06:17:11.687559+0000","last_fullsized":"2024-09-11T06:17:11.687559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.696180+0000","last_change":"2024-09-11T06:17:11.696180+0000","last_active":"2024-09-11T06:17:11.696180+0000","last_peered":"2024-09-11T06:17:11.696180+0000","last_clean":"2024-09-11T06:17:11.696180+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:17:11.696180+0000","last_undegraded":"2024-09-11T06:17:11.696180+0000","last_fullsized":"2024-09-11T06:17:11.696180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:31:31.686261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042951600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T06:17:13.702490+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:13.702490+0000","last_peered":"2024-09-11T06:17:13.702490+0000","last_clean":"2024-09-11T06:17:13.702490+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:13.702490+0000","last_undegraded":"2024-09-11T06:17:13.702490+0000","last_fullsized":"2024-09-11T06:17:13.702490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T06:17:10.948580+0000","last_change":"2024-09-11T06:17:09.680262+0000","last_active":"2024-09-11T06:17:10.948580+0000","last_peered":"2024-09-11T06:17:10.948580+0000","last_clean":"2024-09-11T06:17:10.948580+0000","last_became_active":"2024-09-11T06:17:09.679986+0000","last_became_peered":"2024-09-11T06:17:09.679986+0000","last_unstale":"2024-09-11T06:17:10.948580+0000","last_undegraded":"2024-09-11T06:17:10.948580+0000","last_fullsized":"2024-09-11T06:17:10.948580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:04:05.616122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686094+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:11.686094+0000","last_peered":"2024-09-11T06:17:11.686094+0000","last_clean":"2024-09-11T06:17:11.686094+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:11.686094+0000","last_undegraded":"2024-09-11T06:17:11.686094+0000","last_fullsized":"2024-09-11T06:17:11.686094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.688135+0000","last_change":"2024-09-11T06:17:11.688135+0000","last_active":"2024-09-11T06:17:11.688135+0000","last_peered":"2024-09-11T06:17:11.688135+0000","last_clean":"2024-09-11T06:17:11.688135+0000","last_became_active":"2024-09-11T06:17:09.675683+0000","last_became_peered":"2024-09-11T06:17:09.675683+0000","last_unstale":"2024-09-11T06:17:11.688135+0000","last_undegraded":"2024-09-11T06:17:11.688135+0000","last_fullsized":"2024-09-11T06:17:11.688135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:40.286963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012130579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.686615+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:11.686615+0000","last_peered":"2024-09-11T06:17:11.686615+0000","last_clean":"2024-09-11T06:17:11.686615+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:11.686615+0000","last_undegraded":"2024-09-11T06:17:11.686615+0000","last_fullsized":"2024-09-11T06:17:11.686615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.693191+0000","last_change":"2024-09-11T06:16:53.499469+0000","last_active":"2024-09-11T06:17:11.693191+0000","last_peered":"2024-09-11T06:17:11.693191+0000","last_clean":"2024-09-11T06:17:11.693191+0000","last_became_active":"2024-09-11T06:16:53.498584+0000","last_became_peered":"2024-09-11T06:16:53.498584+0000","last_unstale":"2024-09-11T06:17:11.693191+0000","last_undegraded":"2024-09-11T06:17:11.693191+0000","last_fullsized":"2024-09-11T06:17:11.693191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:54.729518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687357+0000","last_change":"2024-09-11T06:17:11.687357+0000","last_active":"2024-09-11T06:17:11.687357+0000","last_peered":"2024-09-11T06:17:11.687357+0000","last_clean":"2024-09-11T06:17:11.687357+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:17:11.687357+0000","last_undegraded":"2024-09-11T06:17:11.687357+0000","last_fullsized":"2024-09-11T06:17:11.687357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:04:54.758362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000447842,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687822+0000","last_change":"2024-09-11T06:17:11.687822+0000","last_active":"2024-09-11T06:17:11.687822+0000","last_peered":"2024-09-11T06:17:11.687822+0000","last_clean":"2024-09-11T06:17:11.687822+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:17:11.687822+0000","last_undegraded":"2024-09-11T06:17:11.687822+0000","last_fullsized":"2024-09-11T06:17:11.687822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:25.576489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065835799999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.688223+0000","last_change":"2024-09-11T06:17:11.688223+0000","last_active":"2024-09-11T06:17:11.688223+0000","last_peered":"2024-09-11T06:17:11.688223+0000","last_clean":"2024-09-11T06:17:11.688223+0000","last_became_active":"2024-09-11T06:17:09.684600+0000","last_became_peered":"2024-09-11T06:17:09.684600+0000","last_unstale":"2024-09-11T06:17:11.688223+0000","last_undegraded":"2024-09-11T06:17:11.688223+0000","last_fullsized":"2024-09-11T06:17:11.688223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:12:44.688362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011423570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.b","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-11T06:17:13.702541+0000","last_change":"2024-09-11T06:17:11.706968+0000","last_active":"2024-09-11T06:17:13.702541+0000","last_peered":"2024-09-11T06:17:13.702541+0000","last_clean":"2024-09-11T06:17:13.702541+0000","last_became_active":"2024-09-11T06:17:09.681406+0000","last_became_peered":"2024-09-11T06:17:09.681406+0000","last_unstale":"2024-09-11T06:17:13.702541+0000","last_undegraded":"2024-09-11T06:17:13.702541+0000","last_fullsized":"2024-09-11T06:17:13.702541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:40.278324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001045058,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":48,"num_write":22,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.697872+0000","last_change":"2024-09-11T06:17:11.697872+0000","last_active":"2024-09-11T06:17:11.697872+0000","last_peered":"2024-09-11T06:17:11.697872+0000","last_clean":"2024-09-11T06:17:11.697872+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:17:11.697872+0000","last_undegraded":"2024-09-11T06:17:11.697872+0000","last_fullsized":"2024-09-11T06:17:11.697872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:42:10.598425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035767299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687174+0000","last_change":"2024-09-11T06:17:11.687174+0000","last_active":"2024-09-11T06:17:11.687174+0000","last_peered":"2024-09-11T06:17:11.687174+0000","last_clean":"2024-09-11T06:17:11.687174+0000","last_became_active":"2024-09-11T06:17:09.684618+0000","last_became_peered":"2024-09-11T06:17:09.684618+0000","last_unstale":"2024-09-11T06:17:11.687174+0000","last_undegraded":"2024-09-11T06:17:11.687174+0000","last_fullsized":"2024-09-11T06:17:11.687174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:36:19.278529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067139399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687235+0000","last_change":"2024-09-11T06:17:11.687235+0000","last_active":"2024-09-11T06:17:11.687235+0000","last_peered":"2024-09-11T06:17:11.687235+0000","last_clean":"2024-09-11T06:17:11.687235+0000","last_became_active":"2024-09-11T06:17:09.679886+0000","last_became_peered":"2024-09-11T06:17:09.679886+0000","last_unstale":"2024-09-11T06:17:11.687235+0000","last_undegraded":"2024-09-11T06:17:11.687235+0000","last_fullsized":"2024-09-11T06:17:11.687235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:46:53.421318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055427899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.f","version":"27'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.716864+0000","last_change":"2024-09-11T06:17:11.698134+0000","last_active":"2024-09-11T06:17:11.716864+0000","last_peered":"2024-09-11T06:17:11.716864+0000","last_clean":"2024-09-11T06:17:11.716864+0000","last_became_active":"2024-09-11T06:17:09.679342+0000","last_became_peered":"2024-09-11T06:17:09.679342+0000","last_unstale":"2024-09-11T06:17:11.716864+0000","last_undegraded":"2024-09-11T06:17:11.716864+0000","last_fullsized":"2024-09-11T06:17:11.716864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:47:01.034550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000507126,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.694074+0000","last_change":"2024-09-11T06:17:11.694074+0000","last_active":"2024-09-11T06:17:11.694074+0000","last_peered":"2024-09-11T06:17:11.694074+0000","last_clean":"2024-09-11T06:17:11.694074+0000","last_became_active":"2024-09-11T06:17:09.687700+0000","last_became_peered":"2024-09-11T06:17:09.687700+0000","last_unstale":"2024-09-11T06:17:11.694074+0000","last_undegraded":"2024-09-11T06:17:11.694074+0000","last_fullsized":"2024-09-11T06:17:11.694074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:27.772192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000629096,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687432+0000","last_change":"2024-09-11T06:17:11.687432+0000","last_active":"2024-09-11T06:17:11.687432+0000","last_peered":"2024-09-11T06:17:11.687432+0000","last_clean":"2024-09-11T06:17:11.687432+0000","last_became_active":"2024-09-11T06:17:09.683890+0000","last_became_peered":"2024-09-11T06:17:09.683890+0000","last_unstale":"2024-09-11T06:17:11.687432+0000","last_undegraded":"2024-09-11T06:17:11.687432+0000","last_fullsized":"2024-09-11T06:17:11.687432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:49:25.768949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076837599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T06:17:10.948578+0000","last_change":"2024-09-11T06:17:09.685820+0000","last_active":"2024-09-11T06:17:10.948578+0000","last_peered":"2024-09-11T06:17:10.948578+0000","last_clean":"2024-09-11T06:17:10.948578+0000","last_became_active":"2024-09-11T06:17:09.685538+0000","last_became_peered":"2024-09-11T06:17:09.685538+0000","last_unstale":"2024-09-11T06:17:10.948578+0000","last_undegraded":"2024-09-11T06:17:10.948578+0000","last_fullsized":"2024-09-11T06:17:10.948578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:43.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T06:17:11.687422+0000","last_change":"2024-09-11T06:17:11.687422+0000","last_active":"2024-09-11T06:17:11.687422+0000","last_peered":"2024-09-11T06:17:11.687422+0000","last_clean":"2024-09-11T06:17:11.687422+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:17:11.687422+0000","last_undegraded":"2024-09-11T06:17:11.687422+0000","last_fullsized":"2024-09-11T06:17:11.687422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:07.952440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091740099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":97,"num_read_kb":74,"num_write":27,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":695313,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":98708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":274432,"data_stored":98727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":104911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":331776,"data_stored":689084,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":282624,"data_stored":104911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":98727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":311296,"data_stored":116578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":49,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:16.406 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T06:17:16.407 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:17:16.407 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T06:17:16.407 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 1.000000 2024-09-11T06:17:16.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-11T06:17:16.452 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:16.451+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:16.512 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:16.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:16.512 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:16.512 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:16.513 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:16.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:16.546 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:16.545+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:16.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:16.646+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:141 3.2 3:4550e1e5:::rbd_id.image_client.0-clone1:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.728736+0000", 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.936261738, 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001445778, 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 141 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.728736+0000", 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.728736+0000", 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.728738+0000", 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2979999999999999e-06 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.728743+0000", 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2349999999999999e-06 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.728759+0000", 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6319000000000001e-05 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.728766+0000", 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.728818+0000", 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1891999999999997e-05 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.728822+0000", 2024-09-11T06:17:16.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.730119+0000", 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001296682 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.730182+0000", 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3083000000000006e-05 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:145 3.2 3:4550e1e5:::rbd_id.image_client.0-clone1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.734304+0000", 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.93069409, 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011985019999999999, 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 145 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.671 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734304+0000", 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734304+0000", 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734305+0000", 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4799999999999997e-07 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734315+0000", 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0217999999999999e-05 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734325+0000", 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0565e-05 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734331+0000", 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2290000000000002e-06 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734413+0000", 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2719000000000005e-05 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734499+0000", 2024-09-11T06:17:16.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5183000000000001e-05 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.734627+0000", 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012821600000000001 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735247+0000", 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00062010400000000001 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:16.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735440+0000", 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019324000000000001 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735476+0000", 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6199999999999999e-05 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735502+0000", 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6080000000000001e-05 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4461.0:145 3.2 e30/24 ondisk, result = 0)", 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.735377+0000", 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.9296211410000002, 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013151800000000001, 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735377+0000", 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735377+0000", 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735378+0000", 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9599999999999998e-07 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735381+0000", 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4589999999999998e-06 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735389+0000", 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7999999999999999e-06 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735397+0000", 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735432+0000", 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5128e-05 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735437+0000", 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6859999999999997e-06 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.735508+0000", 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1445000000000005e-05 2024-09-11T06:17:16.680 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:149 3.2 3:4550e1e5:::rbd_id.image_client.0-clone1:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.746149+0000", 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.918848887, 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00022577799999999999, 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.681 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 149 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746149+0000", 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746149+0000", 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746151+0000", 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6050000000000001e-06 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746156+0000", 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6640000000000003e-06 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746170+0000", 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3360000000000001e-05 2024-09-11T06:17:16.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746195+0000", 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5049e-05 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746250+0000", 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5189999999999998e-05 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746316+0000", 2024-09-11T06:17:16.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5549000000000005e-05 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746375+0000", 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9361000000000003e-05 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:150 3.2 3:4550e1e5:::rbd_id.image_client.0-clone1:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.746535+0000", 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.918462686, 2024-09-11T06:17:16.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00115964, 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 150 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746535+0000", 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746535+0000", 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746536+0000", 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4600000000000004e-07 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746540+0000", 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.788e-06 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746547+0000", 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6459999999999993e-06 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746560+0000", 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2989999999999999e-05 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746591+0000", 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0278e-05 2024-09-11T06:17:16.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.746643+0000", 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1993999999999997e-05 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.747695+0000", 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010521980000000001 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.689 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:285 3.19 3:9d7ea5eb:::rbd_data.116dc3b5629f.000000000000003d:head [zero 0~131072,write 131072~40157 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.733216+0000", 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.93178244899999996, 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039163119999999999, 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 285 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.690 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733216+0000", 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733216+0000", 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733218+0000", 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.695e-06 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733713+0000", 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049454999999999996 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733731+0000", 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8168e-05 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733741+0000", 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0244999999999999e-05 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733823+0000", 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1324999999999998e-05 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733961+0000", 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138362 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.734089+0000", 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128076 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735368+0000", 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012788159999999999 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737018+0000", 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016504060000000001 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737075+0000", 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6586999999999999e-05 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737132+0000", 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7082e-05 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4461.0:285 3.19 e31/24 ondisk, result = 0)", 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.735269+0000", 2024-09-11T06:17:16.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.92972922999999996, 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112965, 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735269+0000", 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735269+0000", 2024-09-11T06:17:16.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735270+0000", 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1629999999999999e-06 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735275+0000", 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8679999999999998e-06 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735287+0000", 2024-09-11T06:17:16.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2012e-05 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735294+0000", 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9709999999999998e-06 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735351+0000", 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7206000000000001e-05 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735360+0000", 2024-09-11T06:17:16.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735382+0000", 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1396999999999999e-05 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:393 3.1b 3:ded177d1:::rbd_data.116dc3b5629f.0000000000000094:head [zero 0~33278,write 33278~34842 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.750204+0000", 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.91479440599999995, 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001514636, 2024-09-11T06:17:16.699 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 393 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750204+0000", 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750204+0000", 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750205+0000", 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4309999999999999e-06 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750255+0000", 2024-09-11T06:17:16.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0135e-05 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750282+0000", 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6886e-05 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750296+0000", 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3628000000000001e-05 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750356+0000", 2024-09-11T06:17:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0495000000000003e-05 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750454+0000", 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7360000000000003e-05 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750540+0000", 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6385999999999996e-05 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751264+0000", 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072436699999999996 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751654+0000", 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039006099999999998 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751689+0000", 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4981000000000003e-05 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751718+0000", 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8906000000000001e-05 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4461.0:393 3.1b e31/24 ondisk, result = 0)", 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.751586+0000", 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.91341203599999998, 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014217799999999999, 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.705 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751586+0000", 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751586+0000", 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751587+0000", 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2200000000000002e-07 2024-09-11T06:17:16.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751592+0000", 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6630000000000001e-06 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751603+0000", 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1588e-05 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751608+0000", 2024-09-11T06:17:16.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3290000000000001e-06 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751646+0000", 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7319e-05 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751651+0000", 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2190000000000003e-06 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751728+0000", 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7138000000000006e-05 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:405 3.2 3:4550e1e5:::rbd_id.image_client.0-clone1:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.761418+0000", 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.90358044699999995, 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000185238, 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 405 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761418+0000", 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761418+0000", 2024-09-11T06:17:16.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761419+0000", 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0389999999999999e-06 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761424+0000", 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3319999999999999e-06 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761436+0000", 2024-09-11T06:17:16.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2499e-05 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761442+0000", 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9220000000000002e-06 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761490+0000", 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8103999999999999e-05 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761544+0000", 2024-09-11T06:17:16.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3381999999999998e-05 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761603+0000", 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8959999999999998e-05 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:406 3.2 3:4550e1e5:::rbd_id.image_client.0-clone1:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.761739+0000", 2024-09-11T06:17:16.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.90325881699999999, 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000200547, 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 406 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761739+0000", 2024-09-11T06:17:16.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761739+0000", 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761740+0000", 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8000000000000004e-07 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761744+0000", 2024-09-11T06:17:16.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.596e-06 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761759+0000", 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4925e-05 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761764+0000", 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.451e-06 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761799+0000", 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4897999999999997e-05 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761844+0000", 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4592999999999998e-05 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.761940+0000", 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6204000000000003e-05 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.718 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.718 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:16.718 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-11T06:17:16.719 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:16.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:17:16.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:16.770 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:16.769+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:16.848 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:16.848+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:16.864 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:16.864 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:16.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.864 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:468 3.18 3:184d3c88:::rbd_object_map.116dc3b5629f:head [call lock.lock in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:16.864 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.863269+0000", 2024-09-11T06:17:16.864 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00077416699999999998, 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00079419899999999999, 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 468 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:16.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863269+0000", 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863269+0000", 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863270+0000", 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.359e-06 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863276+0000", 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863288+0000", 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2379e-05 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863315+0000", 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6528000000000001e-05 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863364+0000", 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9251e-05 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863424+0000", 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0337999999999997e-05 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.863552+0000", 2024-09-11T06:17:16.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012745500000000001 2024-09-11T06:17:16.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.869 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:16.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:16.869 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-11T06:17:16.869 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-09-11T06:17:16.869 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:16.869 INFO:teuthology.orchestra.run.smithi070.stdout:34 write 0xed40535 thru 0xed4be33 (0xb8ff bytes) 2024-09-11T06:17:16.872 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:16.874 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:16.889 INFO:teuthology.orchestra.run.smithi070.stdout:36 trunc from 0xed4be34 to 0x1736f8c 2024-09-11T06:17:16.909 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:16.917 INFO:teuthology.orchestra.run.smithi070.stdout:37 trunc from 0x1736f8c to 0xadb58f0 2024-09-11T06:17:16.929 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:16.929 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:16.931 INFO:teuthology.orchestra.run.smithi070.stdout:38 write 0xdcac11d thru 0xdcb88b3 (0xc797 bytes) 2024-09-11T06:17:16.935 INFO:teuthology.orchestra.run.smithi070.stdout:39 writesame 0x987a888 thru 0x9882007 data_size 0x40(0x7780 bytes) 2024-09-11T06:17:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:42 punch from 0xacf6575 to 0xad041d2, (0xdc5d bytes) 2024-09-11T06:17:16.944 INFO:teuthology.orchestra.run.smithi070.stdout:43 writesame 0xe8ff7ff thru 0xe9092aa data_size 0x26(0x9aac bytes) 2024-09-11T06:17:16.949 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:16.949 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:16.949 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:16.949+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:16.958 INFO:teuthology.orchestra.run.smithi070.stdout:45 trunc from 0xe9092ab to 0x3331bdf 2024-09-11T06:17:16.967 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:16.968 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:16.981 INFO:teuthology.orchestra.run.smithi070.stdout:46 write 0x8ea3175 thru 0x8eaec7e (0xbb0a bytes) 2024-09-11T06:17:16.984 INFO:teuthology.orchestra.run.smithi070.stdout:47 write 0x3ba0024 thru 0x3bacac0 (0xca9d bytes) 2024-09-11T06:17:16.985 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:16.987 INFO:teuthology.orchestra.run.smithi070.stdout:49 read 0xe36975 thru 0xe3eb5a (0x81e6 bytes) 2024-09-11T06:17:16.987 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:16.987 INFO:teuthology.orchestra.run.smithi070.stdout:51 read 0x8df64e1 thru 0x8e032d6 (0xcdf6 bytes) 2024-09-11T06:17:16.987 INFO:teuthology.orchestra.run.smithi070.stdout:52 punch from 0x7b66e29 to 0x7b6e2c3, (0x749a bytes) 2024-09-11T06:17:16.988 INFO:teuthology.orchestra.run.smithi070.stdout:53 writesame 0x15fe70b thru 0x1604887 data_size 0x3b(0x617d bytes) 2024-09-11T06:17:17.001 INFO:teuthology.orchestra.run.smithi070.stdout:54 writesame 0xc98ef17 thru 0xc99df52 data_size 0x29(0xf03c bytes) 2024-09-11T06:17:17.001 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.001 INFO:teuthology.orchestra.run.smithi070.stdout:56 read 0x62ed8cc thru 0x62ed958 (0x8d bytes) 2024-09-11T06:17:17.001 INFO:teuthology.orchestra.run.smithi070.stdout:57 writesame 0x4bfb9 thru 0x4c75d data_size 0x1(0x7a5 bytes) 2024-09-11T06:17:17.004 INFO:teuthology.orchestra.run.smithi070.stdout:59 write 0x41796c8 thru 0x417a297 (0xbd0 bytes) 2024-09-11T06:17:17.005 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:17.005 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:17.007 INFO:teuthology.orchestra.run.smithi070.stdout:60 read 0x8e57ecf thru 0x8e615a6 (0x96d8 bytes) 2024-09-11T06:17:17.007 INFO:teuthology.orchestra.run.smithi070.stdout:61 write 0xa303183 thru 0xa30e7a8 (0xb626 bytes) 2024-09-11T06:17:17.010 INFO:teuthology.orchestra.run.smithi070.stdout:62 punch from 0x69dffc1 to 0x69e94c8, (0x9507 bytes) 2024-09-11T06:17:17.013 INFO:teuthology.orchestra.run.smithi070.stdout:63 trunc from 0xc99df53 to 0xa2c84a3 2024-09-11T06:17:17.020 INFO:teuthology.orchestra.run.smithi070.stdout:64 punch from 0x16289e1 to 0x163339b, (0xa9ba bytes) 2024-09-11T06:17:17.020 INFO:teuthology.orchestra.run.smithi070.stdout:65 writesame 0x6e0bcd0 thru 0x6e10fda data_size 0x1(0x530b bytes) 2024-09-11T06:17:17.023 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:17.023 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:17.025 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:17.025 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:17.032 INFO:teuthology.orchestra.run.smithi070.stdout:66 writesame 0x93e7467 thru 0x93e9a3e data_size 0xe(0x25d8 bytes) 2024-09-11T06:17:17.035 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:17.041 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:17.041 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:17.044 INFO:teuthology.orchestra.run.smithi070.stdout:67 trunc from 0xa2c84a3 to 0x27685c1 2024-09-11T06:17:17.069 INFO:teuthology.orchestra.run.smithi070.stdout:68 write 0x8521a65 thru 0x8529e57 (0x83f3 bytes) 2024-09-11T06:17:17.072 INFO:teuthology.orchestra.run.smithi070.stdout:69 read 0x7be2938 thru 0x7be898f (0x6058 bytes) 2024-09-11T06:17:17.072 INFO:teuthology.orchestra.run.smithi070.stdout:70 read 0x3dc819 thru 0x3e433f (0x7b27 bytes) 2024-09-11T06:17:17.072 INFO:teuthology.orchestra.run.smithi070.stdout:71 write 0x424d5dd thru 0x424d87b (0x29f bytes) 2024-09-11T06:17:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:72 read 0x9d5eb1 thru 0x9dd623 (0x7773 bytes) 2024-09-11T06:17:17.078 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:17.078+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:17.087 INFO:teuthology.orchestra.run.smithi070.stdout:73 write 0xeaf8adb thru 0xeafb0b3 (0x25d9 bytes) 2024-09-11T06:17:17.090 INFO:teuthology.orchestra.run.smithi070.stdout:74 read 0xe4879d6 thru 0xe492a6d (0xb098 bytes) 2024-09-11T06:17:17.090 INFO:teuthology.orchestra.run.smithi070.stdout:75 read 0x10dd596 thru 0x10e0f30 (0x399b bytes) 2024-09-11T06:17:17.091 INFO:teuthology.orchestra.run.smithi070.stdout:76 write 0xbde4bf6 thru 0xbdecf34 (0x833f bytes) 2024-09-11T06:17:17.093 INFO:teuthology.orchestra.run.smithi070.stdout:78 writesame 0x5de666d thru 0x5df626a data_size 0x5(0xfbfe bytes) 2024-09-11T06:17:17.102 INFO:teuthology.orchestra.run.smithi070.stdout:79 read 0x1cc6301 thru 0x1cc7454 (0x1154 bytes) 2024-09-11T06:17:17.102 INFO:teuthology.orchestra.run.smithi070.stdout:80 write 0x73872a9 thru 0x7395933 (0xe68b bytes) 2024-09-11T06:17:17.106 INFO:teuthology.orchestra.run.smithi070.stdout:81 punch from 0xba8a28f to 0xba8aeca, (0xc3b bytes) 2024-09-11T06:17:17.108 INFO:teuthology.orchestra.run.smithi070.stdout:82 trunc from 0xeafb0b4 to 0xd4f15ca 2024-09-11T06:17:17.117 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.123 INFO:teuthology.orchestra.run.smithi070.stdout:84 write 0xe2353fa thru 0xe237ff7 (0x2bfe bytes) 2024-09-11T06:17:17.127 INFO:teuthology.orchestra.run.smithi070.stdout:85 read 0x57ec050 thru 0x57f53ed (0x939e bytes) 2024-09-11T06:17:17.129 INFO:teuthology.orchestra.run.smithi070.stdout:86 trunc from 0xe237ff8 to 0xce32410 2024-09-11T06:17:17.141 INFO:teuthology.orchestra.run.smithi070.stdout:87 read 0xb93168e thru 0xb93f986 (0xe2f9 bytes) 2024-09-11T06:17:17.142 INFO:teuthology.orchestra.run.smithi070.stdout:89 writesame 0xb80c6c thru 0xb8c911 data_size 0x9(0xbca6 bytes) 2024-09-11T06:17:17.146 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:17.146 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:17.146 INFO:teuthology.orchestra.run.smithi070.stdout:90 writesame 0x5db7081 thru 0x5dc117e data_size 0x3(0xa0fe bytes) 2024-09-11T06:17:17.151 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:17.151+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:17.156 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:17.157 INFO:teuthology.orchestra.run.smithi070.stdout:92 read 0x2b7dd8d thru 0x2b893aa (0xb61e bytes) 2024-09-11T06:17:17.157 INFO:teuthology.orchestra.run.smithi070.stdout:94 write 0xac2d3a8 thru 0xac30aa6 (0x36ff bytes) 2024-09-11T06:17:17.160 INFO:teuthology.orchestra.run.smithi070.stdout:96 writesame 0x99fd6f4 thru 0x9a0a1ee data_size 0x1(0xcafb bytes) 2024-09-11T06:17:17.182 INFO:teuthology.orchestra.run.smithi070.stdout:97 read 0x8ce33f0 thru 0x8ce6b0a (0x371b bytes) 2024-09-11T06:17:17.189 INFO:teuthology.orchestra.run.smithi070.stdout:98 writesame 0xe4a88df thru 0xe4af4f0 data_size 0x6a(0x6c12 bytes) 2024-09-11T06:17:17.189 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.190 INFO:teuthology.orchestra.run.smithi070.stdout:103 write 0x241ea8e thru 0x242c2ec (0xd85f bytes) 2024-09-11T06:17:17.198 INFO:teuthology.orchestra.run.smithi070.stdout:104 write 0x25c44ef thru 0x25c52e2 (0xdf4 bytes) 2024-09-11T06:17:17.200 INFO:teuthology.orchestra.run.smithi070.stdout:105 write 0xd8395d7 thru 0xd84292a (0x9354 bytes) 2024-09-11T06:17:17.207 INFO:teuthology.orchestra.run.smithi070.stdout:106 read 0x13ce10c thru 0x13d6c45 (0x8b3a bytes) 2024-09-11T06:17:17.207 INFO:teuthology.orchestra.run.smithi070.stdout:107 write 0x9cb4e94 thru 0x9cc069f (0xb80c bytes) 2024-09-11T06:17:17.215 INFO:teuthology.orchestra.run.smithi070.stdout:109 read 0xb036dcb thru 0xb03e870 (0x7aa6 bytes) 2024-09-11T06:17:17.215 INFO:teuthology.orchestra.run.smithi070.stdout:110 read 0x3e14f6e thru 0x3e197dc (0x486f bytes) 2024-09-11T06:17:17.215 INFO:teuthology.orchestra.run.smithi070.stdout:111 writesame 0x38d4d91 thru 0x38df2ea data_size 0xa6(0xa55a bytes) 2024-09-11T06:17:17.219 INFO:teuthology.orchestra.run.smithi070.stdout:112 read 0xe33a65b thru 0xe3447e8 (0xa18e bytes) 2024-09-11T06:17:17.221 INFO:teuthology.orchestra.run.smithi070.stdout:113 trunc from 0xe4af4f1 to 0xc9b9e78 2024-09-11T06:17:17.240 INFO:teuthology.orchestra.run.smithi070.stdout:114 write 0xe6558bf thru 0xe660b7b (0xb2bd bytes) 2024-09-11T06:17:17.244 INFO:teuthology.orchestra.run.smithi070.stdout:116 writesame 0x9754804 thru 0x976283c data_size 0x1(0xe039 bytes) 2024-09-11T06:17:17.252 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:17.251+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:17.267 INFO:teuthology.orchestra.run.smithi070.stdout:117 write 0x56aa210 thru 0x56b44e1 (0xa2d2 bytes) 2024-09-11T06:17:17.272 INFO:teuthology.orchestra.run.smithi070.stdout:118 writesame 0x2d4787f thru 0x2d519be data_size 0x50(0xa140 bytes) 2024-09-11T06:17:17.274 INFO:teuthology.orchestra.run.smithi070.stdout:119 write 0xddc6671 thru 0xddcea47 (0x83d7 bytes) 2024-09-11T06:17:17.278 INFO:teuthology.orchestra.run.smithi070.stdout:120 write 0x5e30608 thru 0x5e34431 (0x3e2a bytes) 2024-09-11T06:17:17.281 INFO:teuthology.orchestra.run.smithi070.stdout:122 read 0x7f880b7 thru 0x7f943ed (0xc337 bytes) 2024-09-11T06:17:17.281 INFO:teuthology.orchestra.run.smithi070.stdout:123 writesame 0xb8d7394 thru 0xb8da812 data_size 0x1(0x347f bytes) 2024-09-11T06:17:17.289 INFO:teuthology.orchestra.run.smithi070.stdout:126 punch from 0xdc52171 to 0xdc5cfe0, (0xae6f bytes) 2024-09-11T06:17:17.289 INFO:teuthology.orchestra.run.smithi070.stdout:127 writesame 0x63e6bbf thru 0x63f347b data_size 0xd(0xc8bd bytes) 2024-09-11T06:17:17.294 INFO:teuthology.orchestra.run.smithi070.stdout:128 writesame 0xa0183ab thru 0xa026353 data_size 0x1(0xdfa9 bytes) 2024-09-11T06:17:17.309 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:17.309 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:17.316 INFO:teuthology.orchestra.run.smithi070.stdout:129 writesame 0x5d5e56e thru 0x5d665af data_size 0x1(0x8042 bytes) 2024-09-11T06:17:17.318 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:17.329 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.329 INFO:teuthology.orchestra.run.smithi070.stdout:131 write 0x4475582 thru 0x447a0db (0x4b5a bytes) 2024-09-11T06:17:17.332 INFO:teuthology.orchestra.run.smithi070.stdout:132 punch from 0x8a9d4fe to 0x8a9de01, (0x903 bytes) 2024-09-11T06:17:17.333 INFO:teuthology.orchestra.run.smithi070.stdout:133 write 0x4d675c6 thru 0x4d6ef07 (0x7942 bytes) 2024-09-11T06:17:17.335 INFO:teuthology.orchestra.run.smithi070.stdout:136 read 0xdd4c375 thru 0xdd4efcd (0x2c59 bytes) 2024-09-11T06:17:17.335 INFO:teuthology.orchestra.run.smithi070.stdout:137 write 0x876e0fb thru 0x87765f1 (0x84f7 bytes) 2024-09-11T06:17:17.337 INFO:teuthology.orchestra.run.smithi070.stdout:138 read 0x5a92837 thru 0x5a965d7 (0x3da1 bytes) 2024-09-11T06:17:17.337 INFO:teuthology.orchestra.run.smithi070.stdout:139 write 0x531124d thru 0x53154a2 (0x4256 bytes) 2024-09-11T06:17:17.339 INFO:teuthology.orchestra.run.smithi070.stdout:140 read 0x17e7468 thru 0x17ef10c (0x7ca5 bytes) 2024-09-11T06:17:17.340 INFO:teuthology.orchestra.run.smithi070.stdout:142 write 0x5a88f05 thru 0x5a89f43 (0x103f bytes) 2024-09-11T06:17:17.343 INFO:teuthology.orchestra.run.smithi070.stdout:143 read 0x33176d2 thru 0x331a64f (0x2f7e bytes) 2024-09-11T06:17:17.343 INFO:teuthology.orchestra.run.smithi070.stdout:144 read 0x1f6aea1 thru 0x1f749c1 (0x9b21 bytes) 2024-09-11T06:17:17.343 INFO:teuthology.orchestra.run.smithi070.stdout:145 write 0x692199b thru 0x692a964 (0x8fca bytes) 2024-09-11T06:17:17.346 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.346 INFO:teuthology.orchestra.run.smithi070.stdout:148 write 0x979a1f9 thru 0x979e0b5 (0x3ebd bytes) 2024-09-11T06:17:17.349 INFO:teuthology.orchestra.run.smithi070.stdout:149 read 0x8bf1852 thru 0x8bfcd2b (0xb4da bytes) 2024-09-11T06:17:17.349 INFO:teuthology.orchestra.run.smithi070.stdout:150 read 0x16f162c thru 0x16fa02e (0x8a03 bytes) 2024-09-11T06:17:17.349 INFO:teuthology.orchestra.run.smithi070.stdout:151 read 0xadcd3fd thru 0xadd2550 (0x5154 bytes) 2024-09-11T06:17:17.350 INFO:teuthology.orchestra.run.smithi070.stdout:152 write 0x627b13a thru 0x627c7b0 (0x1677 bytes) 2024-09-11T06:17:17.350 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.350 INFO:teuthology.orchestra.run.smithi070.stdout:155 write 0x7dd21c2 thru 0x7dd5d98 (0x3bd7 bytes) 2024-09-11T06:17:17.356 INFO:teuthology.orchestra.run.smithi070.stdout:156 trunc from 0xe660b7c to 0xba7a7c3 2024-09-11T06:17:17.359 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:17.359+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:17.371 INFO:teuthology.orchestra.run.smithi070.stdout:157 write 0xbb085d0 thru 0xbb0907f (0xab0 bytes) 2024-09-11T06:17:17.374 INFO:teuthology.orchestra.run.smithi070.stdout:158 write 0x395333 thru 0x3965cb (0x1299 bytes) 2024-09-11T06:17:17.378 INFO:teuthology.orchestra.run.smithi070.stdout:159 read 0xa75e42e thru 0xa76cd21 (0xe8f4 bytes) 2024-09-11T06:17:17.378 INFO:teuthology.orchestra.run.smithi070.stdout:160 read 0x147515d thru 0x1483198 (0xe03c bytes) 2024-09-11T06:17:17.385 INFO:teuthology.orchestra.run.smithi070.stdout:162 write 0xce755f2 thru 0xce82c81 (0xd690 bytes) 2024-09-11T06:17:17.391 INFO:teuthology.orchestra.run.smithi070.stdout:163 punch from 0x83cfc15 to 0x83d3234, (0x361f bytes) 2024-09-11T06:17:17.391 INFO:teuthology.orchestra.run.smithi070.stdout:164 punch from 0x23ed5da to 0x23f159e, (0x3fc4 bytes) 2024-09-11T06:17:17.391 INFO:teuthology.orchestra.run.smithi070.stdout:165 trunc from 0xce82c82 to 0xc12b4a7 2024-09-11T06:17:17.403 INFO:teuthology.orchestra.run.smithi070.stdout:166 trunc from 0xc12b4a7 to 0x902cc1a 2024-09-11T06:17:17.417 INFO:teuthology.orchestra.run.smithi070.stdout:168 punch from 0x73591ea to 0x7362189, (0x8f9f bytes) 2024-09-11T06:17:17.417 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.417 INFO:teuthology.orchestra.run.smithi070.stdout:170 read 0xca147b thru 0xcab664 (0xa1ea bytes) 2024-09-11T06:17:17.418 INFO:teuthology.orchestra.run.smithi070.stdout:174 read 0x6d89e39 thru 0x6d92f9e (0x9166 bytes) 2024-09-11T06:17:17.418 INFO:teuthology.orchestra.run.smithi070.stdout:175 read 0x5d96dba thru 0x5da197d (0xabc4 bytes) 2024-09-11T06:17:17.418 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.422 INFO:teuthology.orchestra.run.smithi070.stdout:180 write 0x9605973 thru 0x9612068 (0xc6f6 bytes) 2024-09-11T06:17:17.427 INFO:teuthology.orchestra.run.smithi070.stdout:181 read 0x44a4006 thru 0x44a5bd2 (0x1bcd bytes) 2024-09-11T06:17:17.427 INFO:teuthology.orchestra.run.smithi070.stdout:182 read 0x4fa8688 thru 0x4fae0b9 (0x5a32 bytes) 2024-09-11T06:17:17.427 INFO:teuthology.orchestra.run.smithi070.stdout:185 read 0x19c0f17 thru 0x19c8153 (0x723d bytes) 2024-09-11T06:17:17.438 INFO:teuthology.orchestra.run.smithi070.stdout:188 write 0xe42cb75 thru 0xe433845 (0x6cd1 bytes) 2024-09-11T06:17:17.454 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:17.453+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:17.456 INFO:teuthology.orchestra.run.smithi070.stdout:190 trunc from 0xe433846 to 0x115d374 2024-09-11T06:17:17.476 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:17.476 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:17.482 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:17.483 INFO:teuthology.orchestra.run.smithi070.stdout:193 write 0x4181ff1 thru 0x418e3fb (0xc40b bytes) 2024-09-11T06:17:17.489 INFO:teuthology.orchestra.run.smithi070.stdout:194 trunc from 0x418e3fc to 0x102222b 2024-09-11T06:17:17.501 INFO:teuthology.orchestra.run.smithi070.stdout:195 read 0xfa193c thru 0xfa1a44 (0x109 bytes) 2024-09-11T06:17:17.509 INFO:teuthology.orchestra.run.smithi070.stdout:196 write 0x383e1a0 thru 0x384b261 (0xd0c2 bytes) 2024-09-11T06:17:17.519 INFO:teuthology.orchestra.run.smithi070.stdout:197 writesame 0x496c535 thru 0x49758ed data_size 0x1(0x93b9 bytes) 2024-09-11T06:17:17.519 INFO:teuthology.orchestra.run.smithi070.stdout:198 read 0x254ec14 thru 0x255927f (0xa66c bytes) 2024-09-11T06:17:17.519 INFO:teuthology.orchestra.run.smithi070.stdout:199 punch from 0xda87c to 0xe6e30, (0xc5b4 bytes) 2024-09-11T06:17:17.520 INFO:teuthology.orchestra.run.smithi070.stdout:201 punch from 0x1387525 to 0x139511c, (0xdbf7 bytes) 2024-09-11T06:17:17.522 INFO:teuthology.orchestra.run.smithi070.stdout:203 trunc from 0x49758ee to 0x75b9f5f 2024-09-11T06:17:17.527 INFO:teuthology.orchestra.run.smithi070.stdout:205 writesame 0x6d640c thru 0x6dfc50 data_size 0x1(0x9845 bytes) 2024-09-11T06:17:17.547 INFO:teuthology.orchestra.run.smithi070.stdout:206 read 0x720c163 thru 0x720de02 (0x1ca0 bytes) 2024-09-11T06:17:17.547 INFO:teuthology.orchestra.run.smithi070.stdout:207 punch from 0xe2a10e to 0xe30048, (0x5f3a bytes) 2024-09-11T06:17:17.547 INFO:teuthology.orchestra.run.smithi070.stdout:208 writesame 0x4ae4184 thru 0x4ae77e7 data_size 0x4(0x3664 bytes) 2024-09-11T06:17:17.555 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:17.555+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:17.564 INFO:teuthology.orchestra.run.smithi070.stdout:210 writesame 0xd384c63 thru 0xd38969e data_size 0x2(0x4a3c bytes) 2024-09-11T06:17:17.564 INFO:teuthology.orchestra.run.smithi070.stdout:211 read 0x1bb31e9 thru 0x1bb5cc9 (0x2ae1 bytes) 2024-09-11T06:17:17.564 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.564 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.564 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.564 INFO:teuthology.orchestra.run.smithi070.stdout:216 punch from 0xd212255 to 0xd220b02, (0xe8ad bytes) 2024-09-11T06:17:17.564 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.564 INFO:teuthology.orchestra.run.smithi070.stdout:218 punch from 0xbd829aa to 0xbd88a68, (0x60be bytes) 2024-09-11T06:17:17.565 INFO:teuthology.orchestra.run.smithi070.stdout:219 read 0xbdbe5fe thru 0xbdc92a5 (0xaca8 bytes) 2024-09-11T06:17:17.577 INFO:teuthology.orchestra.run.smithi070.stdout:220 trunc from 0xd38969f to 0x1a5a1d9 2024-09-11T06:17:17.586 INFO:teuthology.orchestra.run.smithi070.stdout:221 write 0x11d0541 thru 0x11db71f (0xb1df bytes) 2024-09-11T06:17:17.591 INFO:teuthology.orchestra.run.smithi070.stdout:222 read 0x5cf3f8 thru 0x5da09b (0xaca4 bytes) 2024-09-11T06:17:17.610 INFO:teuthology.orchestra.run.smithi070.stdout:223 write 0xd02f2d3 thru 0xd03014e (0xe7c bytes) 2024-09-11T06:17:17.613 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.613 INFO:teuthology.orchestra.run.smithi070.stdout:228 write 0x7b84665 thru 0x7b926f8 (0xe094 bytes) 2024-09-11T06:17:17.616 INFO:teuthology.orchestra.run.smithi070.stdout:230 punch from 0xa6ca4e4 to 0xa6d8321, (0xde3d bytes) 2024-09-11T06:17:17.616 INFO:teuthology.orchestra.run.smithi070.stdout:231 writesame 0x6d8a370 thru 0x6d8d04a data_size 0x1(0x2cdb bytes) 2024-09-11T06:17:17.622 INFO:teuthology.orchestra.run.smithi070.stdout:233 write 0x507eef8 thru 0x5082de3 (0x3eec bytes) 2024-09-11T06:17:17.632 INFO:teuthology.orchestra.run.smithi070.stdout:234 writesame 0xd9beca8 thru 0xd9c6b89 data_size 0x6d(0x7ee2 bytes) 2024-09-11T06:17:17.632 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.632 INFO:teuthology.orchestra.run.smithi070.stdout:236 read 0x6a983f8 thru 0x6aa778c (0xf395 bytes) 2024-09-11T06:17:17.633 INFO:teuthology.orchestra.run.smithi070.stdout:237 write 0xbf35eec thru 0xbf37163 (0x1278 bytes) 2024-09-11T06:17:17.634 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:17.634 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:17.635 INFO:teuthology.orchestra.run.smithi070.stdout:238 write 0xef04a1 thru 0xef900a (0x8b6a bytes) 2024-09-11T06:17:17.638 INFO:teuthology.orchestra.run.smithi070.stdout:239 punch from 0x6a55a08 to 0x6a5d3e7, (0x79df bytes) 2024-09-11T06:17:17.638 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.638 INFO:teuthology.orchestra.run.smithi070.stdout:241 punch from 0x39b6825 to 0x39ba034, (0x380f bytes) 2024-09-11T06:17:17.644 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:17.652 INFO:teuthology.orchestra.run.smithi070.stdout:242 trunc from 0xd9c6b8a to 0x17fa127 2024-09-11T06:17:17.683 INFO:teuthology.orchestra.run.smithi070.stdout:243 write 0xe337560 thru 0xe33b83a (0x42db bytes) 2024-09-11T06:17:17.686 INFO:teuthology.orchestra.run.smithi070.stdout:245 read 0x678b35 thru 0x67add3 (0x229f bytes) 2024-09-11T06:17:17.686 INFO:teuthology.orchestra.run.smithi070.stdout:246 writesame 0x22ce200 thru 0x22dd02b data_size 0x6(0xee2c bytes) 2024-09-11T06:17:17.687 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:17.687+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:17.692 INFO:teuthology.orchestra.run.smithi070.stdout:248 punch from 0xb215da5 to 0xb218865, (0x2ac0 bytes) 2024-09-11T06:17:17.693 INFO:teuthology.orchestra.run.smithi070.stdout:249 trunc from 0xe33b83b to 0xd4b810a 2024-09-11T06:17:17.703 INFO:teuthology.orchestra.run.smithi070.stdout:251 read 0x3eaa88e thru 0x3eb5ec4 (0xb637 bytes) 2024-09-11T06:17:17.710 INFO:teuthology.orchestra.run.smithi070.stdout:252 writesame 0xe91def3 thru 0xe92733a data_size 0x68(0x9448 bytes) 2024-09-11T06:17:17.710 INFO:teuthology.orchestra.run.smithi070.stdout:253 write 0xff7bd2 thru 0xffdcb3 (0x60e2 bytes) 2024-09-11T06:17:17.714 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:17:17.715 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.715 INFO:teuthology.orchestra.run.smithi070.stdout:255 write 0xa76ce8c thru 0xa77bb31 (0xeca6 bytes) 2024-09-11T06:17:17.722 INFO:teuthology.orchestra.run.smithi070.stdout:256 write 0xd974e6e thru 0xd974f49 (0xdc bytes) 2024-09-11T06:17:17.725 INFO:teuthology.orchestra.run.smithi070.stdout:258 writesame 0x535a444 thru 0x53663ee data_size 0x1(0xbfab bytes) 2024-09-11T06:17:17.740 INFO:teuthology.orchestra.run.smithi070.stdout:260 read 0x4494632 thru 0x449532c (0xcfb bytes) 2024-09-11T06:17:17.742 INFO:teuthology.orchestra.run.smithi070.stdout:262 trunc from 0xe92733b to 0xd3b2e9e 2024-09-11T06:17:17.756 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:17.756 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:17.757 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:17.756+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:17.757 INFO:teuthology.orchestra.run.smithi070.stdout:263 writesame 0xd6158ca thru 0xd61aa6a data_size 0x1(0x51a1 bytes) 2024-09-11T06:17:17.757 INFO:teuthology.orchestra.run.smithi070.stdout:264 trunc from 0xd61aa6b to 0xe0f70c4 2024-09-11T06:17:17.762 INFO:teuthology.orchestra.run.smithi070.stdout:265 punch from 0x69e514 to 0x6a661e, (0x810a bytes) 2024-09-11T06:17:17.765 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:17.767 INFO:teuthology.orchestra.run.smithi070.stdout:266 writesame 0xe31d62d thru 0xe324500 data_size 0x52(0x6ed4 bytes) 2024-09-11T06:17:17.767 INFO:teuthology.orchestra.run.smithi070.stdout:267 write 0x55014c thru 0x55d62a (0xd4df bytes) 2024-09-11T06:17:17.783 INFO:teuthology.orchestra.run.smithi070.stdout:268 trunc from 0xe324501 to 0x2f536bf 2024-09-11T06:17:17.798 INFO:teuthology.orchestra.run.smithi070.stdout:269 trunc from 0x2f536bf to 0x70e874a 2024-09-11T06:17:17.804 INFO:teuthology.orchestra.run.smithi070.stdout:270 read 0x449dec8 thru 0x44ad057 (0xf190 bytes) 2024-09-11T06:17:17.809 INFO:teuthology.orchestra.run.smithi070.stdout:271 trunc from 0x70e874a to 0xb060da0 2024-09-11T06:17:17.820 INFO:teuthology.orchestra.run.smithi070.stdout:274 write 0xb9bd8f3 thru 0xb9c50ef (0x77fd bytes) 2024-09-11T06:17:17.828 INFO:teuthology.orchestra.run.smithi070.stdout:275 punch from 0x17224fe to 0x172fe6d, (0xd96f bytes) 2024-09-11T06:17:17.828 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.828 INFO:teuthology.orchestra.run.smithi070.stdout:277 punch from 0x7050a0d to 0x7057723, (0x6d16 bytes) 2024-09-11T06:17:17.828 INFO:teuthology.orchestra.run.smithi070.stdout:278 read 0x44569f0 thru 0x4459b05 (0x3116 bytes) 2024-09-11T06:17:17.828 INFO:teuthology.orchestra.run.smithi070.stdout:279 punch from 0x11218f2 to 0x1126e37, (0x5545 bytes) 2024-09-11T06:17:17.828 INFO:teuthology.orchestra.run.smithi070.stdout:282 write 0x2c0ec67 thru 0x2c1a0bc (0xb456 bytes) 2024-09-11T06:17:17.831 INFO:teuthology.orchestra.run.smithi070.stdout:284 read 0x2d7e81e thru 0x2d7ee18 (0x5fb bytes) 2024-09-11T06:17:17.840 INFO:teuthology.orchestra.run.smithi070.stdout:285 write 0xe1ac6b9 thru 0xe1b1e5d (0x57a5 bytes) 2024-09-11T06:17:17.844 INFO:teuthology.orchestra.run.smithi070.stdout:286 writesame 0x29d8d2d thru 0x29e1fc7 data_size 0x1(0x929b bytes) 2024-09-11T06:17:17.857 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:17.857+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:17.862 INFO:teuthology.orchestra.run.smithi070.stdout:287 read 0x7d1ca8 thru 0x7da778 (0x8ad1 bytes) 2024-09-11T06:17:17.862 INFO:teuthology.orchestra.run.smithi070.stdout:289 write 0x163f15f thru 0x1646563 (0x7405 bytes) 2024-09-11T06:17:17.884 INFO:teuthology.orchestra.run.smithi070.stdout:291 trunc from 0xe1b1e5e to 0x1a64a9c 2024-09-11T06:17:17.904 INFO:teuthology.orchestra.run.smithi070.stdout:292 write 0x2835c3b thru 0x283b8ae (0x5c74 bytes) 2024-09-11T06:17:17.915 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:17.915 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:17.923 INFO:teuthology.orchestra.run.smithi070.stdout:294 write 0xb2f3482 thru 0xb2f7858 (0x43d7 bytes) 2024-09-11T06:17:17.925 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:17.926 INFO:teuthology.orchestra.run.smithi070.stdout:295 read 0x6cf75fe thru 0x6d011a3 (0x9ba6 bytes) 2024-09-11T06:17:17.926 INFO:teuthology.orchestra.run.smithi070.stdout:296 write 0x437a9e9 thru 0x43815d9 (0x6bf1 bytes) 2024-09-11T06:17:17.934 INFO:teuthology.orchestra.run.smithi070.stdout:298 writesame 0x93e04d4 thru 0x93ed7b4 data_size 0x3d(0xd2e1 bytes) 2024-09-11T06:17:17.939 INFO:teuthology.orchestra.run.smithi070.stdout:299 read 0x608a9e9 thru 0x608d410 (0x2a28 bytes) 2024-09-11T06:17:17.939 INFO:teuthology.orchestra.run.smithi070.stdout:300 write 0x2cd4e43 thru 0x2ce2a36 (0xdbf4 bytes) 2024-09-11T06:17:17.946 INFO:teuthology.orchestra.run.smithi070.stdout:301 read 0x5c8e01c thru 0x5c9c4a7 (0xe48c bytes) 2024-09-11T06:17:17.946 INFO:teuthology.orchestra.run.smithi070.stdout:303 writesame 0x22677d3 thru 0x2276490 data_size 0x7e(0xecbe bytes) 2024-09-11T06:17:17.949 INFO:teuthology.orchestra.run.smithi070.stdout:305 read 0xae637be thru 0xae68394 (0x4bd7 bytes) 2024-09-11T06:17:17.955 INFO:teuthology.orchestra.run.smithi070.stdout:306 writesame 0xb4a1732 thru 0xb4af0fb data_size 0x3d(0xd9ca bytes) 2024-09-11T06:17:17.955 INFO:teuthology.orchestra.run.smithi070.stdout:308 read 0x92f3cf8 thru 0x92fe4b7 (0xa7c0 bytes) 2024-09-11T06:17:17.955 INFO:teuthology.orchestra.run.smithi070.stdout:309 write 0x1fedb4f thru 0x1ff465a (0x6b0c bytes) 2024-09-11T06:17:17.958 INFO:teuthology.orchestra.run.smithi070.stdout:312 punch from 0x3b7b50e to 0x3b81a26, (0x6518 bytes) 2024-09-11T06:17:17.958 INFO:teuthology.orchestra.run.smithi070.stdout:313 read 0xa344143 thru 0xa352a34 (0xe8f2 bytes) 2024-09-11T06:17:17.958 INFO:teuthology.orchestra.run.smithi070.stdout:316 write 0x80503fb thru 0x805a90b (0xa511 bytes) 2024-09-11T06:17:17.958 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:17.957+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:17.962 INFO:teuthology.orchestra.run.smithi070.stdout:317 read 0x1154cc5 thru 0x116380e (0xeb4a bytes) 2024-09-11T06:17:17.962 INFO:teuthology.orchestra.run.smithi070.stdout:318 write 0x9958bde thru 0x9962518 (0x993b bytes) 2024-09-11T06:17:17.969 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.970 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.970 INFO:teuthology.orchestra.run.smithi070.stdout:323 read 0x4789fa1 thru 0x4792a6c (0x8acc bytes) 2024-09-11T06:17:17.970 INFO:teuthology.orchestra.run.smithi070.stdout:325 read 0x8bdbd74 thru 0x8be8dd3 (0xd060 bytes) 2024-09-11T06:17:17.970 INFO:teuthology.orchestra.run.smithi070.stdout:326 read 0xb1d2980 thru 0xb1d756c (0x4bed bytes) 2024-09-11T06:17:17.970 INFO:teuthology.orchestra.run.smithi070.stdout:327 write 0x73318d3 thru 0x7333f61 (0x268f bytes) 2024-09-11T06:17:17.972 INFO:teuthology.orchestra.run.smithi070.stdout:328 writesame 0x3dcaddd thru 0x3dd19b5 data_size 0x1(0x6bd9 bytes) 2024-09-11T06:17:17.990 INFO:teuthology.orchestra.run.smithi070.stdout:329 trunc from 0xb4af0fc to 0xe0e0ccd 2024-09-11T06:17:17.996 INFO:teuthology.orchestra.run.smithi070.stdout:330 read 0xc8f2874 thru 0xc8f5cdd (0x346a bytes) 2024-09-11T06:17:17.996 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:17.996 INFO:teuthology.orchestra.run.smithi070.stdout:332 read 0xab1b9c4 thru 0xab26d43 (0xb380 bytes) 2024-09-11T06:17:17.996 INFO:teuthology.orchestra.run.smithi070.stdout:333 writesame 0xc1fc506 thru 0xc2042f9 data_size 0x6(0x7df4 bytes) 2024-09-11T06:17:18.010 INFO:teuthology.orchestra.run.smithi070.stdout:334 trunc from 0xe0e0ccd to 0x621fab2 2024-09-11T06:17:18.020 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.033 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:18.033 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:18.035 INFO:teuthology.orchestra.run.smithi070.stdout:338 writesame 0xde203cf thru 0xde2bfe0 data_size 0x85(0xbc12 bytes) 2024-09-11T06:17:18.037 INFO:teuthology.orchestra.run.smithi070.stdout:341 trunc from 0xde2bfe1 to 0xc845893 2024-09-11T06:17:18.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:18.043 INFO:teuthology.orchestra.run.smithi070.stdout:343 write 0xc05bbe2 thru 0xc0617f2 (0x5c11 bytes) 2024-09-11T06:17:18.045 INFO:teuthology.orchestra.run.smithi070.stdout:344 write 0x743fd7f thru 0x7445f56 (0x61d8 bytes) 2024-09-11T06:17:18.049 INFO:teuthology.orchestra.run.smithi070.stdout:345 write 0x189312b thru 0x18a20fb (0xefd1 bytes) 2024-09-11T06:17:18.053 INFO:teuthology.orchestra.run.smithi070.stdout:346 read 0x239936e thru 0x239ceb4 (0x3b47 bytes) 2024-09-11T06:17:18.053 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.053 INFO:teuthology.orchestra.run.smithi070.stdout:349 read 0x13381af thru 0x133820f (0x61 bytes) 2024-09-11T06:17:18.053 INFO:teuthology.orchestra.run.smithi070.stdout:350 writesame 0x4af3fbc thru 0x4af9d56 data_size 0x1(0x5d9b bytes) 2024-09-11T06:17:18.059 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:18.059+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:18.065 INFO:teuthology.orchestra.run.smithi070.stdout:351 read 0x47fabb7 thru 0x48011ac (0x65f6 bytes) 2024-09-11T06:17:18.074 INFO:teuthology.orchestra.run.smithi070.stdout:352 write 0xecb2f23 thru 0xecbe048 (0xb126 bytes) 2024-09-11T06:17:18.077 INFO:teuthology.orchestra.run.smithi070.stdout:354 write 0x242c206 thru 0x242d86d (0x1668 bytes) 2024-09-11T06:17:18.080 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.080 INFO:teuthology.orchestra.run.smithi070.stdout:356 read 0x677b348 thru 0x67892c4 (0xdf7d bytes) 2024-09-11T06:17:18.080 INFO:teuthology.orchestra.run.smithi070.stdout:357 read 0xd9c3136 thru 0xd9cfcda (0xcba5 bytes) 2024-09-11T06:17:18.080 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.080 INFO:teuthology.orchestra.run.smithi070.stdout:359 write 0x20027e1 thru 0x200f74a (0xcf6a bytes) 2024-09-11T06:17:18.083 INFO:teuthology.orchestra.run.smithi070.stdout:360 write 0x7667e46 thru 0x766d843 (0x59fe bytes) 2024-09-11T06:17:18.084 INFO:teuthology.orchestra.run.smithi070.stdout:361 writesame 0x4969acf thru 0x4976878 data_size 0x41(0xcdaa bytes) 2024-09-11T06:17:18.086 INFO:teuthology.orchestra.run.smithi070.stdout:362 punch from 0x8a5db33 to 0x8a6b5f9, (0xdac6 bytes) 2024-09-11T06:17:18.086 INFO:teuthology.orchestra.run.smithi070.stdout:363 write 0xd1bf485 thru 0xd1c5359 (0x5ed5 bytes) 2024-09-11T06:17:18.090 INFO:teuthology.orchestra.run.smithi070.stdout:364 punch from 0x58edc4e to 0x58fcd68, (0xf11a bytes) 2024-09-11T06:17:18.090 INFO:teuthology.orchestra.run.smithi070.stdout:365 read 0x6aa6d1b thru 0x6aa8a3b (0x1d21 bytes) 2024-09-11T06:17:18.090 INFO:teuthology.orchestra.run.smithi070.stdout:366 punch from 0xac97d4 to 0xacacae, (0x14da bytes) 2024-09-11T06:17:18.090 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.090 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.090 INFO:teuthology.orchestra.run.smithi070.stdout:371 read 0x7142ac6 thru 0x7144999 (0x1ed4 bytes) 2024-09-11T06:17:18.090 INFO:teuthology.orchestra.run.smithi070.stdout:372 writesame 0x609a29 thru 0x60adbb data_size 0x1(0x1393 bytes) 2024-09-11T06:17:18.092 INFO:teuthology.orchestra.run.smithi070.stdout:375 read 0x411f9da thru 0x412eae1 (0xf108 bytes) 2024-09-11T06:17:18.092 INFO:teuthology.orchestra.run.smithi070.stdout:376 punch from 0x9a2ebd5 to 0x9a34d01, (0x612c bytes) 2024-09-11T06:17:18.092 INFO:teuthology.orchestra.run.smithi070.stdout:378 write 0xbb849b6 thru 0xbb8d281 (0x88cc bytes) 2024-09-11T06:17:18.095 INFO:teuthology.orchestra.run.smithi070.stdout:379 write 0x4004074 thru 0x4008e09 (0x4d96 bytes) 2024-09-11T06:17:18.096 INFO:teuthology.orchestra.run.smithi070.stdout:381 write 0xc0038ee thru 0xc008530 (0x4c43 bytes) 2024-09-11T06:17:18.099 INFO:teuthology.orchestra.run.smithi070.stdout:382 writesame 0xf998b0 thru 0xf9c565 data_size 0x1(0x2cb6 bytes) 2024-09-11T06:17:18.105 INFO:teuthology.orchestra.run.smithi070.stdout:383 write 0x1213ac8 thru 0x1222805 (0xed3e bytes) 2024-09-11T06:17:18.108 INFO:teuthology.orchestra.run.smithi070.stdout:384 read 0x1a119f4 thru 0x1a19b7c (0x8189 bytes) 2024-09-11T06:17:18.109 INFO:teuthology.orchestra.run.smithi070.stdout:385 read 0xb43f564 thru 0xb44eef4 (0xf991 bytes) 2024-09-11T06:17:18.109 INFO:teuthology.orchestra.run.smithi070.stdout:388 writesame 0xe226bdf thru 0xe22bbe0 data_size 0x31(0x5002 bytes) 2024-09-11T06:17:18.112 INFO:teuthology.orchestra.run.smithi070.stdout:389 write 0x47fef28 thru 0x48036aa (0x4783 bytes) 2024-09-11T06:17:18.116 INFO:teuthology.orchestra.run.smithi070.stdout:390 write 0x136a67b thru 0x1373d5c (0x96e2 bytes) 2024-09-11T06:17:18.119 INFO:teuthology.orchestra.run.smithi070.stdout:391 read 0x1941e0b thru 0x1951243 (0xf439 bytes) 2024-09-11T06:17:18.119 INFO:teuthology.orchestra.run.smithi070.stdout:392 read 0x7705d3c thru 0x7712e1f (0xd0e4 bytes) 2024-09-11T06:17:18.119 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.120 INFO:teuthology.orchestra.run.smithi070.stdout:395 write 0x30ab841 thru 0x30b589c (0xa05c bytes) 2024-09-11T06:17:18.123 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.123 INFO:teuthology.orchestra.run.smithi070.stdout:398 write 0x6d169b0 thru 0x6d1d27d (0x68ce bytes) 2024-09-11T06:17:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:399 write 0x114ba6f thru 0x114f6aa (0x3c3c bytes) 2024-09-11T06:17:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:400 writesame 0x1b9ddda thru 0x1ba9371 data_size 0x95(0xb598 bytes) 2024-09-11T06:17:18.130 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.130 INFO:teuthology.orchestra.run.smithi070.stdout:402 writesame 0x1ae9658 thru 0x1af3c94 data_size 0x1(0xa63d bytes) 2024-09-11T06:17:18.151 INFO:teuthology.orchestra.run.smithi070.stdout:404 writesame 0x952ba51 thru 0x952eec6 data_size 0x22(0x3476 bytes) 2024-09-11T06:17:18.155 INFO:teuthology.orchestra.run.smithi070.stdout:405 write 0x51d67bd thru 0x51dfeb7 (0x96fb bytes) 2024-09-11T06:17:18.157 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:18.157 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:18.158 INFO:teuthology.orchestra.run.smithi070.stdout:406 write 0x370dbb6 thru 0x3716953 (0x8d9e bytes) 2024-09-11T06:17:18.160 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:18.159+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:18.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:407 trunc from 0xecbe049 to 0x53ce93 2024-09-11T06:17:18.214 INFO:teuthology.orchestra.run.smithi070.stdout:408 read 0x2e8b58 thru 0x2f2bb8 (0xa061 bytes) 2024-09-11T06:17:18.214 INFO:teuthology.orchestra.run.smithi070.stdout:409 read 0x3d8ea2 thru 0x3dbdac (0x2f0b bytes) 2024-09-11T06:17:18.234 INFO:teuthology.orchestra.run.smithi070.stdout:410 writesame 0xb665f23 thru 0xb675219 data_size 0x3(0xf2f7 bytes) 2024-09-11T06:17:18.234 INFO:teuthology.orchestra.run.smithi070.stdout:411 punch from 0x261d6e to 0x271a14, (0xfca6 bytes) 2024-09-11T06:17:18.234 INFO:teuthology.orchestra.run.smithi070.stdout:415 read 0x511aeb2 thru 0x512277a (0x78c9 bytes) 2024-09-11T06:17:18.234 INFO:teuthology.orchestra.run.smithi070.stdout:416 read 0x6f139b4 thru 0x6f1db23 (0xa170 bytes) 2024-09-11T06:17:18.234 INFO:teuthology.orchestra.run.smithi070.stdout:417 read 0x10b4ad2 thru 0x10c035a (0xb889 bytes) 2024-09-11T06:17:18.234 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.234 INFO:teuthology.orchestra.run.smithi070.stdout:420 read 0x5049c6 thru 0x50ea07 (0xa042 bytes) 2024-09-11T06:17:18.234 INFO:teuthology.orchestra.run.smithi070.stdout:421 write 0x6926a83 thru 0x69366b1 (0xfc2f bytes) 2024-09-11T06:17:18.241 INFO:teuthology.orchestra.run.smithi070.stdout:425 trunc from 0xb67521a to 0x74103da 2024-09-11T06:17:18.247 INFO:teuthology.orchestra.run.smithi070.stdout:426 read 0x58b5c5 thru 0x597bf4 (0xc630 bytes) 2024-09-11T06:17:18.259 INFO:teuthology.orchestra.run.smithi070.stdout:427 writesame 0xc3f002e thru 0xc3f65fe data_size 0x1(0x65d1 bytes) 2024-09-11T06:17:18.259 INFO:teuthology.orchestra.run.smithi070.stdout:428 read 0x1ab4245 thru 0x1ac1cd6 (0xda92 bytes) 2024-09-11T06:17:18.259 INFO:teuthology.orchestra.run.smithi070.stdout:430 read 0x6411fa0 thru 0x641baca (0x9b2b bytes) 2024-09-11T06:17:18.261 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:18.261+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:18.269 INFO:teuthology.orchestra.run.smithi070.stdout:431 trunc from 0xc3f65ff to 0x3f27ea7 2024-09-11T06:17:18.296 INFO:teuthology.orchestra.run.smithi070.stdout:434 write 0xc2b4eb4 thru 0xc2bd350 (0x849d bytes) 2024-09-11T06:17:18.298 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:18.298 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:18.299 INFO:teuthology.orchestra.run.smithi070.stdout:435 read 0x23ba495 thru 0x23ca404 (0xff70 bytes) 2024-09-11T06:17:18.299 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.299 INFO:teuthology.orchestra.run.smithi070.stdout:439 writesame 0x60bee7f thru 0x60c8976 data_size 0xc(0x9af8 bytes) 2024-09-11T06:17:18.303 INFO:teuthology.orchestra.run.smithi070.stdout:441 punch from 0xb4e3da to 0xb51165, (0x2d8b bytes) 2024-09-11T06:17:18.304 INFO:teuthology.orchestra.run.smithi070.stdout:443 write 0x185edb6 thru 0x1866f64 (0x81af bytes) 2024-09-11T06:17:18.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:18.321 INFO:teuthology.orchestra.run.smithi070.stdout:444 trunc from 0xc2bd351 to 0x4d12c10 2024-09-11T06:17:18.332 INFO:teuthology.orchestra.run.smithi070.stdout:446 trunc from 0x4d12c10 to 0x60924c8 2024-09-11T06:17:18.337 INFO:teuthology.orchestra.run.smithi070.stdout:447 write 0x5463a67 thru 0x5469f40 (0x64da bytes) 2024-09-11T06:17:18.340 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.340 INFO:teuthology.orchestra.run.smithi070.stdout:451 read 0x27cf697 thru 0x27d30e9 (0x3a53 bytes) 2024-09-11T06:17:18.340 INFO:teuthology.orchestra.run.smithi070.stdout:453 read 0xb5473b thru 0xb5f2a1 (0xab67 bytes) 2024-09-11T06:17:18.347 INFO:teuthology.orchestra.run.smithi070.stdout:455 write 0x721da4f thru 0x7223ca6 (0x6258 bytes) 2024-09-11T06:17:18.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:18.362+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:18.364 INFO:teuthology.orchestra.run.smithi070.stdout:457 write 0xd5f42d8 thru 0xd5f547e (0x11a7 bytes) 2024-09-11T06:17:18.371 INFO:teuthology.orchestra.run.smithi070.stdout:458 trunc from 0xd5f547f to 0xa113e0c 2024-09-11T06:17:18.383 INFO:teuthology.orchestra.run.smithi070.stdout:459 read 0x2cac30a thru 0x2cb4e5d (0x8b54 bytes) 2024-09-11T06:17:18.383 INFO:teuthology.orchestra.run.smithi070.stdout:461 read 0x151f48f thru 0x1529fd8 (0xab4a bytes) 2024-09-11T06:17:18.390 INFO:teuthology.orchestra.run.smithi070.stdout:463 writesame 0xaf62640 thru 0xaf6c084 data_size 0x1(0x9a45 bytes) 2024-09-11T06:17:18.393 INFO:teuthology.orchestra.run.smithi070.stdout:465 trunc from 0xaf6c085 to 0xcc89ccf 2024-09-11T06:17:18.398 INFO:teuthology.orchestra.run.smithi070.stdout:466 read 0x4947874 thru 0x494c701 (0x4e8e bytes) 2024-09-11T06:17:18.398 INFO:teuthology.orchestra.run.smithi070.stdout:467 read 0x53dfd96 thru 0x53e53b8 (0x5623 bytes) 2024-09-11T06:17:18.398 INFO:teuthology.orchestra.run.smithi070.stdout:468 write 0xc75787b thru 0xc763615 (0xbd9b bytes) 2024-09-11T06:17:18.402 INFO:teuthology.orchestra.run.smithi070.stdout:469 punch from 0x582ed6e to 0x583399f, (0x4c31 bytes) 2024-09-11T06:17:18.409 INFO:teuthology.orchestra.run.smithi070.stdout:470 write 0xde0f2ef thru 0xde133f5 (0x4107 bytes) 2024-09-11T06:17:18.412 INFO:teuthology.orchestra.run.smithi070.stdout:471 read 0x37ebe64 thru 0x37f6179 (0xa316 bytes) 2024-09-11T06:17:18.412 INFO:teuthology.orchestra.run.smithi070.stdout:476 read 0x8eb4ec1 thru 0x8eb77fe (0x293e bytes) 2024-09-11T06:17:18.412 INFO:teuthology.orchestra.run.smithi070.stdout:477 read 0x7aeebb6 thru 0x7afa505 (0xb950 bytes) 2024-09-11T06:17:18.412 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.413 INFO:teuthology.orchestra.run.smithi070.stdout:481 punch from 0x1caa20 to 0x1d8887, (0xde67 bytes) 2024-09-11T06:17:18.413 INFO:teuthology.orchestra.run.smithi070.stdout:482 read 0x394d831 thru 0x39508b0 (0x3080 bytes) 2024-09-11T06:17:18.413 INFO:teuthology.orchestra.run.smithi070.stdout:483 writesame 0xd259b6 thru 0xd335c3 data_size 0x1(0xdc0e bytes) 2024-09-11T06:17:18.437 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:18.437 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:18.439 INFO:teuthology.orchestra.run.smithi070.stdout:484 punch from 0x49ffcb9 to 0x4a05113, (0x545a bytes) 2024-09-11T06:17:18.440 INFO:teuthology.orchestra.run.smithi070.stdout:485 write 0x8c75791 thru 0x8c829e0 (0xd250 bytes) 2024-09-11T06:17:18.444 INFO:teuthology.orchestra.run.smithi070.stdout:487 read 0x13014fd thru 0x130d878 (0xc37c bytes) 2024-09-11T06:17:18.444 INFO:teuthology.orchestra.run.smithi070.stdout:488 read 0x4ae849c thru 0x4af6854 (0xe3b9 bytes) 2024-09-11T06:17:18.444 INFO:teuthology.orchestra.run.smithi070.stdout:490 read 0x92c3305 thru 0x92d1840 (0xe53c bytes) 2024-09-11T06:17:18.444 INFO:teuthology.orchestra.run.smithi070.stdout:492 read 0x830da7b thru 0x830e2ce (0x854 bytes) 2024-09-11T06:17:18.445 INFO:teuthology.orchestra.run.smithi070.stdout:494 write 0xc6fad03 thru 0xc70a111 (0xf40f bytes) 2024-09-11T06:17:18.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:18.449 INFO:teuthology.orchestra.run.smithi070.stdout:495 read 0x9f23e1 thru 0x9fa50b (0x812b bytes) 2024-09-11T06:17:18.449 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.449 INFO:teuthology.orchestra.run.smithi070.stdout:498 write 0x4f44541 thru 0x4f52954 (0xe414 bytes) 2024-09-11T06:17:18.451 INFO:teuthology.orchestra.run.smithi070.stdout:499 read 0x9637962 thru 0x9638405 (0xaa4 bytes) 2024-09-11T06:17:18.458 INFO:teuthology.orchestra.run.smithi070.stdout:500 trunc from 0xde133f6 to 0x7df58d2 2024-09-11T06:17:18.463 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:18.462+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:18.471 INFO:teuthology.orchestra.run.smithi070.stdout:501 trunc from 0x7df58d2 to 0x92f2a9a 2024-09-11T06:17:18.476 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.476 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.476 INFO:teuthology.orchestra.run.smithi070.stdout:504 punch from 0x648cfc6 to 0x649767c, (0xa6b6 bytes) 2024-09-11T06:17:18.487 INFO:teuthology.orchestra.run.smithi070.stdout:505 trunc from 0x92f2a9a to 0x5445ad 2024-09-11T06:17:18.512 INFO:teuthology.orchestra.run.smithi070.stdout:506 write 0x815f561 thru 0x8160237 (0xcd7 bytes) 2024-09-11T06:17:18.526 INFO:teuthology.orchestra.run.smithi070.stdout:507 write 0xc03e666 thru 0xc040de7 (0x2782 bytes) 2024-09-11T06:17:18.536 INFO:teuthology.orchestra.run.smithi070.stdout:508 writesame 0xc8da006 thru 0xc8e6912 data_size 0x1(0xc90d bytes) 2024-09-11T06:17:18.536 INFO:teuthology.orchestra.run.smithi070.stdout:509 read 0x6c0daab thru 0x6c1b344 (0xd89a bytes) 2024-09-11T06:17:18.537 INFO:teuthology.orchestra.run.smithi070.stdout:510 punch from 0x7902f5f to 0x790713e, (0x41df bytes) 2024-09-11T06:17:18.537 INFO:teuthology.orchestra.run.smithi070.stdout:512 punch from 0x62cfdc9 to 0x62d7bc2, (0x7df9 bytes) 2024-09-11T06:17:18.537 INFO:teuthology.orchestra.run.smithi070.stdout:516 writesame 0x33c2674 thru 0x33c294e data_size 0x1(0x2db bytes) 2024-09-11T06:17:18.539 INFO:teuthology.orchestra.run.smithi070.stdout:519 write 0x9917ab7 thru 0x9927300 (0xf84a bytes) 2024-09-11T06:17:18.546 INFO:teuthology.orchestra.run.smithi070.stdout:520 read 0x61e1faf thru 0x61ec28b (0xa2dd bytes) 2024-09-11T06:17:18.546 INFO:teuthology.orchestra.run.smithi070.stdout:522 write 0x2a02580 thru 0x2a11a3e (0xf4bf bytes) 2024-09-11T06:17:18.550 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.550 INFO:teuthology.orchestra.run.smithi070.stdout:525 write 0x18b6a6a thru 0x18c23d5 (0xb96c bytes) 2024-09-11T06:17:18.555 INFO:teuthology.orchestra.run.smithi070.stdout:526 write 0xbe60202 thru 0xbe6ac8e (0xaa8d bytes) 2024-09-11T06:17:18.558 INFO:teuthology.orchestra.run.smithi070.stdout:527 read 0x69a071b thru 0x69a4f38 (0x481e bytes) 2024-09-11T06:17:18.558 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.558 INFO:teuthology.orchestra.run.smithi070.stdout:530 write 0x6937754 thru 0x69405c1 (0x8e6e bytes) 2024-09-11T06:17:18.564 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:18.563+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:18.564 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:18.565 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:18.565 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.565 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.565 INFO:teuthology.orchestra.run.smithi070.stdout:534 write 0x461d3e7 thru 0x46206e8 (0x3302 bytes) 2024-09-11T06:17:18.574 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:18.574 INFO:teuthology.orchestra.run.smithi070.stdout:536 writesame 0x437ce2e thru 0x4384847 data_size 0x1(0x7a1a bytes) 2024-09-11T06:17:18.585 INFO:teuthology.orchestra.run.smithi070.stdout:537 read 0x55a5af6 thru 0x55b0e6a (0xb375 bytes) 2024-09-11T06:17:18.585 INFO:teuthology.orchestra.run.smithi070.stdout:539 punch from 0x34c5081 to 0x34ccd24, (0x7ca3 bytes) 2024-09-11T06:17:18.586 INFO:teuthology.orchestra.run.smithi070.stdout:540 read 0x7362070 thru 0x736a390 (0x8321 bytes) 2024-09-11T06:17:18.586 INFO:teuthology.orchestra.run.smithi070.stdout:542 trunc from 0xc8e6913 to 0xc88937c 2024-09-11T06:17:18.591 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.591 INFO:teuthology.orchestra.run.smithi070.stdout:545 read 0xbcb152c thru 0xbcb4e58 (0x392d bytes) 2024-09-11T06:17:18.601 INFO:teuthology.orchestra.run.smithi070.stdout:546 trunc from 0xc88937c to 0x363d3c3 2024-09-11T06:17:18.616 INFO:teuthology.orchestra.run.smithi070.stdout:548 read 0x2fc594 thru 0x2ff127 (0x2b94 bytes) 2024-09-11T06:17:18.628 INFO:teuthology.orchestra.run.smithi070.stdout:549 write 0x875a0b3 thru 0x8766217 (0xc165 bytes) 2024-09-11T06:17:18.633 INFO:teuthology.orchestra.run.smithi070.stdout:550 read 0x4f02350 thru 0x4f05b91 (0x3842 bytes) 2024-09-11T06:17:18.633 INFO:teuthology.orchestra.run.smithi070.stdout:551 punch from 0x2167dcd to 0x2172cf2, (0xaf25 bytes) 2024-09-11T06:17:18.633 INFO:teuthology.orchestra.run.smithi070.stdout:552 read 0x6c2ea60 thru 0x6c39532 (0xaad3 bytes) 2024-09-11T06:17:18.634 INFO:teuthology.orchestra.run.smithi070.stdout:553 writesame 0x3ac950c thru 0x3accd9c data_size 0x3(0x3891 bytes) 2024-09-11T06:17:18.639 INFO:teuthology.orchestra.run.smithi070.stdout:555 read 0x40a1c65 thru 0x40aeb8d (0xcf29 bytes) 2024-09-11T06:17:18.639 INFO:teuthology.orchestra.run.smithi070.stdout:556 read 0x57a6025 thru 0x57b0474 (0xa450 bytes) 2024-09-11T06:17:18.639 INFO:teuthology.orchestra.run.smithi070.stdout:557 read 0x2de33ac thru 0x2de6e31 (0x3a86 bytes) 2024-09-11T06:17:18.639 INFO:teuthology.orchestra.run.smithi070.stdout:558 writesame 0x75714bf thru 0x75737d6 data_size 0x4(0x2318 bytes) 2024-09-11T06:17:18.642 INFO:teuthology.orchestra.run.smithi070.stdout:559 punch from 0x3b241cc to 0x3b2b7b7, (0x75eb bytes) 2024-09-11T06:17:18.642 INFO:teuthology.orchestra.run.smithi070.stdout:560 write 0x54da501 thru 0x54e2525 (0x8025 bytes) 2024-09-11T06:17:18.646 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.646 INFO:teuthology.orchestra.run.smithi070.stdout:562 read 0x642523b thru 0x642e278 (0x903e bytes) 2024-09-11T06:17:18.653 INFO:teuthology.orchestra.run.smithi070.stdout:563 write 0xa05ab63 thru 0xa05ac23 (0xc1 bytes) 2024-09-11T06:17:18.656 INFO:teuthology.orchestra.run.smithi070.stdout:565 read 0x4ad5c71 thru 0x4ae23fc (0xc78c bytes) 2024-09-11T06:17:18.656 INFO:teuthology.orchestra.run.smithi070.stdout:566 writesame 0x335d2fe thru 0x33649a1 data_size 0x6(0x76a4 bytes) 2024-09-11T06:17:18.665 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:18.664+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:18.670 INFO:teuthology.orchestra.run.smithi070.stdout:567 write 0xc03abb5 thru 0xc047cab (0xd0f7 bytes) 2024-09-11T06:17:18.678 INFO:teuthology.orchestra.run.smithi070.stdout:570 punch from 0xac9c740 to 0xaca748d, (0xad4d bytes) 2024-09-11T06:17:18.678 INFO:teuthology.orchestra.run.smithi070.stdout:571 write 0xdd7e1b thru 0xdde8e4 (0x6aca bytes) 2024-09-11T06:17:18.682 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.682 INFO:teuthology.orchestra.run.smithi070.stdout:573 read 0x8d7866b thru 0x8d7b629 (0x2fbf bytes) 2024-09-11T06:17:18.682 INFO:teuthology.orchestra.run.smithi070.stdout:574 read 0x7258b9f thru 0x725c22b (0x368d bytes) 2024-09-11T06:17:18.682 INFO:teuthology.orchestra.run.smithi070.stdout:576 read 0x31a8381 thru 0x31aadce (0x2a4e bytes) 2024-09-11T06:17:18.686 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:18.686 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:18.688 INFO:teuthology.orchestra.run.smithi070.stdout:577 write 0xd0c42e3 thru 0xd0cddec (0x9b0a bytes) 2024-09-11T06:17:18.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:18.706 INFO:teuthology.orchestra.run.smithi070.stdout:578 trunc from 0xd0cdded to 0x12f21b7 2024-09-11T06:17:18.728 INFO:teuthology.orchestra.run.smithi070.stdout:579 trunc from 0x12f21b7 to 0x850db81 2024-09-11T06:17:18.734 INFO:teuthology.orchestra.run.smithi070.stdout:580 punch from 0x22bbc10 to 0x22c4691, (0x8a81 bytes) 2024-09-11T06:17:18.739 INFO:teuthology.orchestra.run.smithi070.stdout:581 write 0x874fac1 thru 0x875b8d7 (0xbe17 bytes) 2024-09-11T06:17:18.746 INFO:teuthology.orchestra.run.smithi070.stdout:582 write 0x87eb757 thru 0x87fb360 (0xfc0a bytes) 2024-09-11T06:17:18.761 INFO:teuthology.orchestra.run.smithi070.stdout:584 write 0xe341280 thru 0xe346d10 (0x5a91 bytes) 2024-09-11T06:17:18.765 INFO:teuthology.orchestra.run.smithi070.stdout:585 punch from 0x831c2a7 to 0x832319d, (0x6ef6 bytes) 2024-09-11T06:17:18.765 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.765 INFO:teuthology.orchestra.run.smithi070.stdout:587 read 0xdbb477b thru 0xdbb6f24 (0x27aa bytes) 2024-09-11T06:17:18.765 INFO:teuthology.orchestra.run.smithi070.stdout:588 read 0x91bb7ed thru 0x91ca012 (0xe826 bytes) 2024-09-11T06:17:18.765 INFO:teuthology.orchestra.run.smithi070.stdout:589 write 0x1dea216 thru 0x1deb823 (0x160e bytes) 2024-09-11T06:17:18.766 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:18.765+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:18.767 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.767 INFO:teuthology.orchestra.run.smithi070.stdout:591 punch from 0xa06c0e7 to 0xa077dad, (0xbcc6 bytes) 2024-09-11T06:17:18.768 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.779 INFO:teuthology.orchestra.run.smithi070.stdout:597 trunc from 0xe346d11 to 0x48290df 2024-09-11T06:17:18.799 INFO:teuthology.orchestra.run.smithi070.stdout:598 write 0x99627b2 thru 0x997100d (0xe85c bytes) 2024-09-11T06:17:18.809 INFO:teuthology.orchestra.run.smithi070.stdout:599 writesame 0xa984bd8 thru 0xa991807 data_size 0xb0(0xcc30 bytes) 2024-09-11T06:17:18.819 INFO:teuthology.orchestra.run.smithi070.stdout:600 write 0xec7d90b thru 0xec85362 (0x7a58 bytes) 2024-09-11T06:17:18.823 INFO:teuthology.orchestra.run.smithi070.stdout:601 writesame 0x3ce7c68 thru 0x3cf76a7 data_size 0x20(0xfa40 bytes) 2024-09-11T06:17:18.826 INFO:teuthology.orchestra.run.smithi070.stdout:603 read 0x3e6142e thru 0x3e6d03b (0xbc0e bytes) 2024-09-11T06:17:18.827 INFO:teuthology.orchestra.run.smithi070.stdout:604 read 0x2490193 thru 0x2492082 (0x1ef0 bytes) 2024-09-11T06:17:18.827 INFO:teuthology.orchestra.run.smithi070.stdout:605 writesame 0xcafdea8 thru 0xcb03ac2 data_size 0x13(0x5c1b bytes) 2024-09-11T06:17:18.827 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:18.828 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:18.831 INFO:teuthology.orchestra.run.smithi070.stdout:607 write 0x5bced8 thru 0x5c9801 (0xc92a bytes) 2024-09-11T06:17:18.834 INFO:teuthology.orchestra.run.smithi070.stdout:608 writesame 0xa95db4a thru 0xa95eb59 data_size 0x8(0x1010 bytes) 2024-09-11T06:17:18.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:18.838 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.838 INFO:teuthology.orchestra.run.smithi070.stdout:610 writesame 0xdd8285a thru 0xdd9262e data_size 0x1(0xfdd5 bytes) 2024-09-11T06:17:18.867 INFO:teuthology.orchestra.run.smithi070.stdout:611 write 0x650987c thru 0x650f21d (0x59a2 bytes) 2024-09-11T06:17:18.868 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:18.866+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:18.870 INFO:teuthology.orchestra.run.smithi070.stdout:612 write 0xb362b7f thru 0xb36b0ef (0x8571 bytes) 2024-09-11T06:17:18.873 INFO:teuthology.orchestra.run.smithi070.stdout:616 write 0xd24a404 thru 0xd24c9e5 (0x25e2 bytes) 2024-09-11T06:17:18.876 INFO:teuthology.orchestra.run.smithi070.stdout:620 write 0x67a5923 thru 0x67b1a8a (0xc168 bytes) 2024-09-11T06:17:18.878 INFO:teuthology.orchestra.run.smithi070.stdout:622 read 0xe74efd8 thru 0xe75deca (0xeef3 bytes) 2024-09-11T06:17:18.895 INFO:teuthology.orchestra.run.smithi070.stdout:626 trunc from 0xec85363 to 0x12226ce 2024-09-11T06:17:18.906 INFO:teuthology.orchestra.run.smithi070.stdout:627 read 0x9fb413 thru 0xa07e03 (0xc9f1 bytes) 2024-09-11T06:17:18.907 INFO:teuthology.orchestra.run.smithi070.stdout:630 read 0xbace0a thru 0xbb4d54 (0x7f4b bytes) 2024-09-11T06:17:18.907 INFO:teuthology.orchestra.run.smithi070.stdout:631 read 0xe33d52 thru 0xe381b4 (0x4463 bytes) 2024-09-11T06:17:18.907 INFO:teuthology.orchestra.run.smithi070.stdout:632 punch from 0x1a32c3 to 0x1affe8, (0xcd25 bytes) 2024-09-11T06:17:18.913 INFO:teuthology.orchestra.run.smithi070.stdout:633 trunc from 0x12226ce to 0x6817e03 2024-09-11T06:17:18.918 INFO:teuthology.orchestra.run.smithi070.stdout:634 writesame 0x18ae520 thru 0x18b7e24 data_size 0x1(0x9905 bytes) 2024-09-11T06:17:18.938 INFO:teuthology.orchestra.run.smithi070.stdout:635 read 0x2d97195 thru 0x2da6059 (0xeec5 bytes) 2024-09-11T06:17:18.938 INFO:teuthology.orchestra.run.smithi070.stdout:636 read 0x4da256c thru 0x4dadc53 (0xb6e8 bytes) 2024-09-11T06:17:18.938 INFO:teuthology.orchestra.run.smithi070.stdout:638 write 0x56bd096 thru 0x56cb9dd (0xe948 bytes) 2024-09-11T06:17:18.944 INFO:teuthology.orchestra.run.smithi070.stdout:640 read 0x67471b0 thru 0x67544a6 (0xd2f7 bytes) 2024-09-11T06:17:18.944 INFO:teuthology.orchestra.run.smithi070.stdout:642 punch from 0x6811f08 to 0x6817e03, (0x5efb bytes) 2024-09-11T06:17:18.945 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.945 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.954 INFO:teuthology.orchestra.run.smithi070.stdout:645 write 0xab7a73b thru 0xab7af4c (0x812 bytes) 2024-09-11T06:17:18.957 INFO:teuthology.orchestra.run.smithi070.stdout:646 punch from 0x137e2a1 to 0x138230a, (0x4069 bytes) 2024-09-11T06:17:18.958 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.958 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.958 INFO:teuthology.orchestra.run.smithi070.stdout:649 read 0x851a98e thru 0x85215a5 (0x6c18 bytes) 2024-09-11T06:17:18.958 INFO:teuthology.orchestra.run.smithi070.stdout:651 punch from 0x723d047 to 0x7240fbe, (0x3f77 bytes) 2024-09-11T06:17:18.958 INFO:teuthology.orchestra.run.smithi070.stdout:652 write 0x333536b thru 0x3336c4b (0x18e1 bytes) 2024-09-11T06:17:18.960 INFO:teuthology.orchestra.run.smithi070.stdout:653 punch from 0x996859e to 0x99763a6, (0xde08 bytes) 2024-09-11T06:17:18.960 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.960 INFO:teuthology.orchestra.run.smithi070.stdout:655 write 0x6a8639d thru 0x6a8ed43 (0x89a7 bytes) 2024-09-11T06:17:18.963 INFO:teuthology.orchestra.run.smithi070.stdout:657 read 0x4e2884c thru 0x4e3438f (0xbb44 bytes) 2024-09-11T06:17:18.963 INFO:teuthology.orchestra.run.smithi070.stdout:658 read 0x4bb5e2f thru 0x4bbb1fb (0x53cd bytes) 2024-09-11T06:17:18.964 INFO:teuthology.orchestra.run.smithi070.stdout:660 read 0x4ecda23 thru 0x4ed2bda (0x51b8 bytes) 2024-09-11T06:17:18.964 INFO:teuthology.orchestra.run.smithi070.stdout:662 read 0x547634b thru 0x547ea8c (0x8742 bytes) 2024-09-11T06:17:18.964 INFO:teuthology.orchestra.run.smithi070.stdout:664 read 0x12c0e80 thru 0x12c3b54 (0x2cd5 bytes) 2024-09-11T06:17:18.964 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.964 INFO:teuthology.orchestra.run.smithi070.stdout:667 write 0xa5537df thru 0xa55c6af (0x8ed1 bytes) 2024-09-11T06:17:18.968 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:18.967+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:18.973 INFO:teuthology.orchestra.run.smithi070.stdout:669 write 0xc239fd0 thru 0xc242ca4 (0x8cd5 bytes) 2024-09-11T06:17:18.979 INFO:teuthology.orchestra.run.smithi070.stdout:670 writesame 0x6a8cc3f thru 0x6a8ff3f data_size 0x1(0x3301 bytes) 2024-09-11T06:17:18.983 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:18.983 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:18.984 INFO:teuthology.orchestra.run.smithi070.stdout:672 write 0xb719e6d thru 0xb71d77f (0x3913 bytes) 2024-09-11T06:17:18.988 INFO:teuthology.orchestra.run.smithi070.stdout:673 writesame 0xa72bbf4 thru 0xa72feca data_size 0x1(0x42d7 bytes) 2024-09-11T06:17:18.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:674 read 0x8c4ee25 thru 0x8c504ce (0x16aa bytes) 2024-09-11T06:17:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:675 punch from 0x796d9d6 to 0x79763ab, (0x89d5 bytes) 2024-09-11T06:17:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:677 read 0x7a353a3 thru 0x7a4081c (0xb47a bytes) 2024-09-11T06:17:18.998 INFO:teuthology.orchestra.run.smithi070.stdout:680 write 0x8fdaf1d thru 0x8fdf516 (0x45fa bytes) 2024-09-11T06:17:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:681 read 0x1965a50 thru 0x196d251 (0x7802 bytes) 2024-09-11T06:17:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:682 writesame 0x169a417 thru 0x16a6b3b data_size 0x1(0xc725 bytes) 2024-09-11T06:17:19.015 INFO:teuthology.orchestra.run.smithi070.stdout:683 write 0xb02ea7c thru 0xb03347a (0x49ff bytes) 2024-09-11T06:17:19.018 INFO:teuthology.orchestra.run.smithi070.stdout:684 write 0x36cd271 thru 0x36d7641 (0xa3d1 bytes) 2024-09-11T06:17:19.022 INFO:teuthology.orchestra.run.smithi070.stdout:685 punch from 0xe063b2 to 0xe0cc32, (0x6880 bytes) 2024-09-11T06:17:19.022 INFO:teuthology.orchestra.run.smithi070.stdout:686 punch from 0x8ac5ab to 0x8bc0cc, (0xfb21 bytes) 2024-09-11T06:17:19.022 INFO:teuthology.orchestra.run.smithi070.stdout:687 write 0xb4334b3 thru 0xb440959 (0xd4a7 bytes) 2024-09-11T06:17:19.028 INFO:teuthology.orchestra.run.smithi070.stdout:688 read 0xb11d04d thru 0xb12c48a (0xf43e bytes) 2024-09-11T06:17:19.028 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.028 INFO:teuthology.orchestra.run.smithi070.stdout:691 write 0x41d1587 thru 0x41dc008 (0xaa82 bytes) 2024-09-11T06:17:19.032 INFO:teuthology.orchestra.run.smithi070.stdout:692 write 0xdd0936 thru 0xde08dd (0xffa8 bytes) 2024-09-11T06:17:19.041 INFO:teuthology.orchestra.run.smithi070.stdout:694 write 0xd756aab thru 0xd75e297 (0x77ed bytes) 2024-09-11T06:17:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:697 read 0x7dc3491 thru 0x7dca778 (0x72e8 bytes) 2024-09-11T06:17:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:699 punch from 0x6fceabe to 0x6fd6a27, (0x7f69 bytes) 2024-09-11T06:17:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:700 punch from 0x6ef1542 to 0x6ef3d44, (0x2802 bytes) 2024-09-11T06:17:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:701 writesame 0x6f66696 thru 0x6f75aa7 data_size 0x7(0xf412 bytes) 2024-09-11T06:17:19.052 INFO:teuthology.orchestra.run.smithi070.stdout:702 writesame 0xc4e9a1b thru 0xc4ed3b5 data_size 0x1(0x399b bytes) 2024-09-11T06:17:19.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:19.061 INFO:teuthology.orchestra.run.smithi070.stdout:704 read 0x3740f63 thru 0x374a629 (0x96c7 bytes) 2024-09-11T06:17:19.068 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:19.067+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:19.075 INFO:teuthology.orchestra.run.smithi070.stdout:705 trunc from 0xd75e298 to 0x19c2002 2024-09-11T06:17:19.098 INFO:teuthology.orchestra.run.smithi070.stdout:706 write 0x32ffd76 thru 0x32fff57 (0x1e2 bytes) 2024-09-11T06:17:19.115 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:19.115 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:19.115 INFO:teuthology.orchestra.run.smithi070.stdout:708 write 0xa728567 thru 0xa733828 (0xb2c2 bytes) 2024-09-11T06:17:19.119 INFO:teuthology.orchestra.run.smithi070.stdout:709 trunc from 0xa733829 to 0xb63d809 2024-09-11T06:17:19.125 INFO:teuthology.orchestra.run.smithi070.stdout:710 punch from 0x6c3b4c3 to 0x6c40f3f, (0x5a7c bytes) 2024-09-11T06:17:19.125 INFO:teuthology.orchestra.run.smithi070.stdout:711 write 0x5c0ed8 thru 0x5d022e (0xf357 bytes) 2024-09-11T06:17:19.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:19.132 INFO:teuthology.orchestra.run.smithi070.stdout:712 trunc from 0xb63d809 to 0x7d0f539 2024-09-11T06:17:19.141 INFO:teuthology.orchestra.run.smithi070.stdout:713 write 0x78f07f1 thru 0x78f5117 (0x4927 bytes) 2024-09-11T06:17:19.153 INFO:teuthology.orchestra.run.smithi070.stdout:714 trunc from 0x7d0f539 to 0x1a69936 2024-09-11T06:17:19.165 INFO:teuthology.orchestra.run.smithi070.stdout:715 read 0x4ae3f thru 0x54516 (0x96d8 bytes) 2024-09-11T06:17:19.169 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:19.168+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:19.182 INFO:teuthology.orchestra.run.smithi070.stdout:716 write 0xa39dd8e thru 0xa39e4a6 (0x719 bytes) 2024-09-11T06:17:19.185 INFO:teuthology.orchestra.run.smithi070.stdout:717 writesame 0x6db7d4a thru 0x6dbf0b7 data_size 0x4b(0x736e bytes) 2024-09-11T06:17:19.192 INFO:teuthology.orchestra.run.smithi070.stdout:720 trunc from 0xa39e4a7 to 0x72d4065 2024-09-11T06:17:19.202 INFO:teuthology.orchestra.run.smithi070.stdout:721 read 0x7194aa8 thru 0x719a1e0 (0x5739 bytes) 2024-09-11T06:17:19.205 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:19.206 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:19.215 INFO:teuthology.orchestra.run.smithi070.stdout:722 write 0xd4c13e3 thru 0xd4cfb6d (0xe78b bytes) 2024-09-11T06:17:19.223 INFO:teuthology.orchestra.run.smithi070.stdout:723 trunc from 0xd4cfb6e to 0x9e5252c 2024-09-11T06:17:19.225 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:19.226 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:19.233 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.233 INFO:teuthology.orchestra.run.smithi070.stdout:726 punch from 0x21f98bb to 0x21fa598, (0xcdd bytes) 2024-09-11T06:17:19.236 INFO:teuthology.orchestra.run.smithi070.stdout:727 trunc from 0x9e5252c to 0xc782f2e 2024-09-11T06:17:19.241 INFO:teuthology.orchestra.run.smithi070.stdout:728 trunc from 0xc782f2e to 0xc09221a 2024-09-11T06:17:19.244 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:19.244 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:19.246 INFO:teuthology.orchestra.run.smithi070.stdout:730 write 0xbedb444 thru 0xbee07f7 (0x53b4 bytes) 2024-09-11T06:17:19.250 INFO:teuthology.orchestra.run.smithi070.stdout:732 read 0x3448fc6 thru 0x34519c6 (0x8a01 bytes) 2024-09-11T06:17:19.250 INFO:teuthology.orchestra.run.smithi070.stdout:734 write 0x4c3fa1c thru 0x4c4e444 (0xea29 bytes) 2024-09-11T06:17:19.254 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.254 INFO:teuthology.orchestra.run.smithi070.stdout:736 punch from 0xba549c8 to 0xba611e6, (0xc81e bytes) 2024-09-11T06:17:19.254 INFO:teuthology.orchestra.run.smithi070.stdout:738 punch from 0x6a91506 to 0x6a940b0, (0x2baa bytes) 2024-09-11T06:17:19.254 INFO:teuthology.orchestra.run.smithi070.stdout:740 writesame 0xa052d9d thru 0xa053348 data_size 0x16(0x5ac bytes) 2024-09-11T06:17:19.256 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:114 3.e 3:71ed46f3:::rbd_object_map.116d6cc70d0.0000000000000003:head [writefull 0~49] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5443944140000001, 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036205959999999998, 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 114 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709653+0000", 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.033e-06 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709668+0000", 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5432999999999999e-05 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709695+0000", 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6743000000000001e-05 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709708+0000", 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3224000000000001e-05 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709781+0000", 2024-09-11T06:17:19.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3203999999999999e-05 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709786+0000", 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5249999999999999e-06 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.711855+0000", 2024-09-11T06:17:19.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020689440000000001 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.711945+0000", 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0247999999999994e-05 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.712027+0000", 2024-09-11T06:17:19.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1848999999999995e-05 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.712788+0000", 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076103399999999995 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713172+0000", 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038437900000000001 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713225+0000", 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2729999999999998e-05 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713270+0000", 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5250000000000002e-05 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:336 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 917504~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738569+0000", 2024-09-11T06:17:19.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5154750589999999, 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013747709999999999, 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 336 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738569+0000", 2024-09-11T06:17:19.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738569+0000", 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738569+0000", 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738573+0000", 2024-09-11T06:17:19.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2990000000000001e-06 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738579+0000", 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7070000000000003e-06 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738585+0000", 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3329999999999996e-06 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739808+0000", 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00122324 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739862+0000", 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3779000000000001e-05 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739944+0000", 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1860999999999994e-05 2024-09-11T06:17:19.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:337 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1703936~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738592+0000", 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5154516620000003, 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001498561, 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 337 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738592+0000", 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738592+0000", 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738593+0000", 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2300000000000002e-07 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738594+0000", 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738600+0000", 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:17:19.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738614+0000", 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.384e-05 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739969+0000", 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013548270000000001 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740020+0000", 2024-09-11T06:17:19.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1592999999999999e-05 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740091+0000", 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0588999999999998e-05 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:338 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 262144~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738646+0000", 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5153974510000001, 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00163277, 2024-09-11T06:17:19.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 338 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738646+0000", 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738646+0000", 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738647+0000", 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3099999999999997e-07 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738650+0000", 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0429999999999999e-06 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738656+0000", 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1539999999999999e-06 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738662+0000", 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740120+0000", 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001457931 2024-09-11T06:17:19.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740181+0000", 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1099000000000006e-05 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740279+0000", 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7901999999999999e-05 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:339 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1048576~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738686+0000", 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5153574810000001, 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018299729999999999, 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 339 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738686+0000", 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738686+0000", 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738687+0000", 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738689+0000", 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.356e-06 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738696+0000", 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2469999999999997e-06 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738700+0000", 2024-09-11T06:17:19.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740328+0000", 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001627636 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740410+0000", 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2060999999999999e-05 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740516+0000", 2024-09-11T06:17:19.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106514 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:341 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1835008~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5153351119999998, 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020185530000000002, 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 341 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738720+0000", 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0738e-05 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738726+0000", 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4339999999999997e-06 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738732+0000", 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4809999999999997e-06 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740558+0000", 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018259719999999999 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740621+0000", 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3230000000000003e-05 2024-09-11T06:17:19.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740727+0000", 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106319 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:342 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5152173869999999, 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002047924, 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 342 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738827+0000", 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738831+0000", 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3390000000000001e-06 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738838+0000", 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738843+0000", 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4489999999999998e-06 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740768+0000", 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001924533 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740812+0000", 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4325e-05 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740874+0000", 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2544000000000003e-05 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:346 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 393216~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739613+0000", 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5144306890000001, 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015016669999999999, 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 346 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739613+0000", 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739613+0000", 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739614+0000", 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4799999999999997e-07 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739618+0000", 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8380000000000004e-06 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739629+0000", 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1062e-05 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739636+0000", 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740930+0000", 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012943340000000001 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741007+0000", 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6485999999999999e-05 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741115+0000", 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107939 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:347 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1179648~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739659+0000", 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5143850370000003, 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016682139999999999, 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 347 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739659+0000", 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739659+0000", 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739660+0000", 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739663+0000", 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.988e-06 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739671+0000", 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8279999999999992e-06 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739678+0000", 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2060000000000004e-06 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741156+0000", 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001478933 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741232+0000", 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5328999999999997e-05 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741327+0000", 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5233000000000001e-05 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:348 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1966080~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5143573340000001, 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018858169999999999, 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 348 2024-09-11T06:17:19.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3499999999999996e-07 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739690+0000", 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0079999999999998e-06 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739697+0000", 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0330000000000003e-06 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739703+0000", 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2090000000000002e-06 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741373+0000", 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016699760000000001 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741456+0000", 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2781999999999994e-05 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741572+0000", 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011627400000000001 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:349 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 524288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5142083180000001, 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019399529999999999, 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739837+0000", 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.17e-06 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739842+0000", 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.809e-06 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739853+0000", 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569000000000001e-05 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739872+0000", 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8525999999999998e-05 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741611+0000", 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017397090000000001 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741674+0000", 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2652999999999998e-05 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741776+0000", 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101517 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:350 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1310720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.51413771, 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002086142, 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 350 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:19.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739907+0000", 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-07 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739910+0000", 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1200000000000002e-06 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739918+0000", 2024-09-11T06:17:19.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3180000000000007e-06 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739932+0000", 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3436e-05 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741807+0000", 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018748689999999999 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741882+0000", 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5042000000000004e-05 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741992+0000", 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011073699999999999 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:351 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.51410278, 2024-09-11T06:17:19.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022443649999999999, 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 351 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739942+0000", 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739944+0000", 2024-09-11T06:17:19.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739950+0000", 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.314e-06 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739956+0000", 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5999999999999997e-06 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742021+0000", 2024-09-11T06:17:19.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020649409999999998 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742097+0000", 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6322000000000006e-05 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742185+0000", 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8244000000000004e-05 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:360 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1441792~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.741256+0000", 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5127881560000001, 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012939410000000001, 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 360 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741256+0000", 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741256+0000", 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741256+0000", 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741259+0000", 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2329999999999998e-06 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741266+0000", 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2559999999999999e-06 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741271+0000", 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0640000000000001e-06 2024-09-11T06:17:19.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742397+0000", 2024-09-11T06:17:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001126628 2024-09-11T06:17:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742466+0000", 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8324000000000005e-05 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742550+0000", 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3931000000000007e-05 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:361 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 2228224~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.741278+0000", 2024-09-11T06:17:19.320 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5127659859999998, 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014590849999999999, 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 361 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741278+0000", 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741278+0000", 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741278+0000", 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741287+0000", 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:17:19.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741294+0000", 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4429999999999997e-06 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741299+0000", 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.164e-06 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742576+0000", 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001277128 2024-09-11T06:17:19.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742643+0000", 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7076999999999995e-05 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742737+0000", 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3616000000000006e-05 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.324 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:484 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.3629283819999998, 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798467, 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 484 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891119+0000", 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.01e-06 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891132+0000", 2024-09-11T06:17:19.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3009e-05 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891157+0000", 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5709000000000001e-05 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891171+0000", 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3672999999999999e-05 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891253+0000", 2024-09-11T06:17:19.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2111e-05 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891382+0000", 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012871000000000001 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.892914+0000", 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001532245 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "pg_update_log_missing(3.14 epoch 32/24 rep_tid 5 entries 32'1 (0'0) error 3:2de41705:::rbd_data.116dc3b5629f.0000000000000043:head by client.4461.0:493 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.891775+0000", 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.3622686119999998, 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014141410000000001, 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891775+0000", 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891775+0000", 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891776+0000", 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5899999999999998e-07 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891782+0000", 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.46e-06 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891796+0000", 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4477e-05 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891810+0000", 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3823e-05 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891885+0000", 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4956000000000005e-05 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893189+0000", 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001304166 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:508 3.e 3:72eb80ea:::rbd_data.116dc3b5629f.0000000000000070:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.897467+0000", 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.356577202, 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014797670000000001, 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 508 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897467+0000", 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897467+0000", 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897468+0000", 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.049e-06 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897472+0000", 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897485+0000", 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2115e-05 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897492+0000", 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897545+0000", 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2899000000000003e-05 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897663+0000", 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118176 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898946+0000", 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001283501 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:542 3.16 3:69d2ec7d:::rbd_data.116dc3b5629f.00000000000000d9:head [set-alloc-hint object_size 1048576 write_size 1048576,write 835869~51095] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:19.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.933854+0000", 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.320189547, 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014456670000000001, 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 542 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.933854+0000", 2024-09-11T06:17:19.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.933854+0000", 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.933855+0000", 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7699999999999992e-07 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.933890+0000", 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4567999999999998e-05 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.933906+0000", 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6424000000000001e-05 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.933914+0000", 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6399999999999997e-06 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.933965+0000", 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0770999999999999e-05 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.934053+0000", 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8275000000000004e-05 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.934146+0000", 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3173999999999999e-05 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.934967+0000", 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082101799999999996 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.935201+0000", 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023386300000000001 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.935259+0000", 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8072999999999998e-05 2024-09-11T06:17:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.935300+0000", 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0883999999999997e-05 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:545 3.16 3:6b229986:::rbd_data.116dc3b5629f.0000000000000097:head [set-alloc-hint object_size 1048576 write_size 1048576,write 501896~22392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:19.342 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.937254+0000", 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.3167894389999999, 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001446875, 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 545 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937254+0000", 2024-09-11T06:17:19.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937254+0000", 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937255+0000", 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2099999999999995e-07 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937274+0000", 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8926000000000001e-05 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937284+0000", 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5300000000000002e-06 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937289+0000", 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937334+0000", 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5102999999999998e-05 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937455+0000", 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012142900000000001 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.937595+0000", 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000139992 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.938187+0000", 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059214300000000005 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.938623+0000", 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043585899999999998 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.938657+0000", 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4254000000000001e-05 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.938701+0000", 2024-09-11T06:17:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3921000000000002e-05 2024-09-11T06:17:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.348 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:19.349 INFO:teuthology.orchestra.run.smithi070.stdout:741 read 0x11c25d6 thru 0x11c2c69 (0x694 bytes) 2024-09-11T06:17:19.349 INFO:teuthology.orchestra.run.smithi070.stdout:742 read 0x4e2f1c2 thru 0x4e347f5 (0x5634 bytes) 2024-09-11T06:17:19.349 INFO:teuthology.orchestra.run.smithi070.stdout:743 writesame 0x2447f1e thru 0x244e49e data_size 0x1(0x6581 bytes) 2024-09-11T06:17:19.349 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:19.349 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:19.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:19.351 INFO:teuthology.orchestra.run.smithi070.stdout:744 read 0xa4c6d18 thru 0xa4cc5d9 (0x58c2 bytes) 2024-09-11T06:17:19.351 INFO:teuthology.orchestra.run.smithi070.stdout:745 trunc from 0xc09221a to 0x33835b6 2024-09-11T06:17:19.351 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:19.352 INFO:teuthology.orchestra.run.smithi070.stdout:746 read 0x84e53f thru 0x85b289 (0xcd4b bytes) 2024-09-11T06:17:19.352 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.352 INFO:teuthology.orchestra.run.smithi070.stdout:748 writesame 0x69b3f61 thru 0x69b421b data_size 0x3(0x2bb bytes) 2024-09-11T06:17:19.352 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:19.353 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:19.353 INFO:teuthology.orchestra.run.smithi070.stdout:750 write 0xa7554cf thru 0xa75a0ad (0x4bdf bytes) 2024-09-11T06:17:19.353 INFO:teuthology.orchestra.run.smithi070.stdout:751 writesame 0x33f4fb0 thru 0x3400fa6 data_size 0x1(0xbff7 bytes) 2024-09-11T06:17:19.353 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:19.354 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:19.354 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:19.354 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:19.355 INFO:teuthology.orchestra.run.smithi070.stdout:753 punch from 0x37610a3 to 0x3767ed8, (0x6e35 bytes) 2024-09-11T06:17:19.355 INFO:teuthology.orchestra.run.smithi070.stdout:755 punch from 0x3762879 to 0x3769ca0, (0x7427 bytes) 2024-09-11T06:17:19.355 INFO:teuthology.orchestra.run.smithi070.stdout:756 write 0xd6d684b thru 0xd6e4be3 (0xe399 bytes) 2024-09-11T06:17:19.356 INFO:teuthology.orchestra.run.smithi070.stdout:757 writesame 0x2b69d32 thru 0x2b707a5 data_size 0x12(0x6a74 bytes) 2024-09-11T06:17:19.356 INFO:teuthology.orchestra.run.smithi070.stdout:758 read 0xb68447b thru 0xb6882ca (0x3e50 bytes) 2024-09-11T06:17:19.356 INFO:teuthology.orchestra.run.smithi070.stdout:761 write 0xa30f86d thru 0xa3154e6 (0x5c7a bytes) 2024-09-11T06:17:19.356 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:19.354+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:19.357 INFO:teuthology.orchestra.run.smithi070.stdout:762 punch from 0x3443719 to 0x3445a89, (0x2370 bytes) 2024-09-11T06:17:19.357 INFO:teuthology.orchestra.run.smithi070.stdout:763 write 0x8f6c2a5 thru 0x8f7459e (0x82fa bytes) 2024-09-11T06:17:19.375 INFO:teuthology.orchestra.run.smithi070.stdout:764 trunc from 0xd6e4be4 to 0x169d56f 2024-09-11T06:17:19.389 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.391 INFO:teuthology.orchestra.run.smithi070.stdout:766 trunc from 0x169d56f to 0x35212cc 2024-09-11T06:17:19.409 INFO:teuthology.orchestra.run.smithi070.stdout:767 write 0x94f4b66 thru 0x94fa802 (0x5c9d bytes) 2024-09-11T06:17:19.412 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.420 INFO:teuthology.orchestra.run.smithi070.stdout:769 write 0xb22840c thru 0xb235115 (0xcd0a bytes) 2024-09-11T06:17:19.424 INFO:teuthology.orchestra.run.smithi070.stdout:770 read 0x51e554 thru 0x52ae25 (0xc8d2 bytes) 2024-09-11T06:17:19.431 INFO:teuthology.orchestra.run.smithi070.stdout:772 writesame 0xc501036 thru 0xc50cc44 data_size 0x1(0xbc0f bytes) 2024-09-11T06:17:19.431 INFO:teuthology.orchestra.run.smithi070.stdout:773 write 0x9027017 thru 0x9030eb6 (0x9ea0 bytes) 2024-09-11T06:17:19.434 INFO:teuthology.orchestra.run.smithi070.stdout:774 write 0x623c154 thru 0x6247656 (0xb503 bytes) 2024-09-11T06:17:19.439 INFO:teuthology.orchestra.run.smithi070.stdout:775 writesame 0x6ce0046 thru 0x6cea42f data_size 0x1(0xa3ea bytes) 2024-09-11T06:17:19.454 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:19.453+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:19.460 INFO:teuthology.orchestra.run.smithi070.stdout:777 read 0x5f7c95 thru 0x5ff540 (0x78ac bytes) 2024-09-11T06:17:19.460 INFO:teuthology.orchestra.run.smithi070.stdout:778 read 0x8403c0d thru 0x8406df1 (0x31e5 bytes) 2024-09-11T06:17:19.460 INFO:teuthology.orchestra.run.smithi070.stdout:779 punch from 0x1933eb2 to 0x1936d01, (0x2e4f bytes) 2024-09-11T06:17:19.460 INFO:teuthology.orchestra.run.smithi070.stdout:783 punch from 0x1317bf6 to 0x1325d61, (0xe16b bytes) 2024-09-11T06:17:19.460 INFO:teuthology.orchestra.run.smithi070.stdout:784 read 0x34b4c48 thru 0x34b5ae5 (0xe9e bytes) 2024-09-11T06:17:19.466 INFO:teuthology.orchestra.run.smithi070.stdout:787 writesame 0xd1b2d34 thru 0xd1b42b8 data_size 0x1(0x1585 bytes) 2024-09-11T06:17:19.466 INFO:teuthology.orchestra.run.smithi070.stdout:788 read 0x605f597 thru 0x6068649 (0x90b3 bytes) 2024-09-11T06:17:19.466 INFO:teuthology.orchestra.run.smithi070.stdout:789 write 0x6a1ac9f thru 0x6a26dda (0xc13c bytes) 2024-09-11T06:17:19.473 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.473 INFO:teuthology.orchestra.run.smithi070.stdout:792 write 0x964c8af thru 0x9650fda (0x472c bytes) 2024-09-11T06:17:19.473 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:19.474 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:19.474 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:19.474 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:19.475 INFO:teuthology.orchestra.run.smithi070.stdout:793 write 0x2c9fa69 thru 0x2ca02a2 (0x83a bytes) 2024-09-11T06:17:19.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:19.485 INFO:teuthology.orchestra.run.smithi070.stdout:794 trunc from 0xd1b42b9 to 0x9734908 2024-09-11T06:17:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:796 write 0x1105280 thru 0x11056c6 (0x447 bytes) 2024-09-11T06:17:19.498 INFO:teuthology.orchestra.run.smithi070.stdout:797 read 0x5e13267 thru 0x5e1c568 (0x9302 bytes) 2024-09-11T06:17:19.509 INFO:teuthology.orchestra.run.smithi070.stdout:799 writesame 0xd33fc40 thru 0xd340606 data_size 0x1(0x9c7 bytes) 2024-09-11T06:17:19.509 INFO:teuthology.orchestra.run.smithi070.stdout:800 punch from 0x9f9d025 to 0x9f9eb96, (0x1b71 bytes) 2024-09-11T06:17:19.509 INFO:teuthology.orchestra.run.smithi070.stdout:801 read 0x500db6e thru 0x5017470 (0x9903 bytes) 2024-09-11T06:17:19.509 INFO:teuthology.orchestra.run.smithi070.stdout:804 writesame 0x912b455 thru 0x9137d77 data_size 0x1f(0xc923 bytes) 2024-09-11T06:17:19.510 INFO:teuthology.orchestra.run.smithi070.stdout:805 write 0x2af9e70 thru 0x2aff60e (0x579f bytes) 2024-09-11T06:17:19.513 INFO:teuthology.orchestra.run.smithi070.stdout:806 writesame 0x1f03ff7 thru 0x1f0b855 data_size 0x1(0x785f bytes) 2024-09-11T06:17:19.527 INFO:teuthology.orchestra.run.smithi070.stdout:807 read 0xb8162b3 thru 0xb825989 (0xf6d7 bytes) 2024-09-11T06:17:19.527 INFO:teuthology.orchestra.run.smithi070.stdout:808 write 0xbc0db6e thru 0xbc0fbff (0x2092 bytes) 2024-09-11T06:17:19.530 INFO:teuthology.orchestra.run.smithi070.stdout:809 write 0x5a89d0c thru 0x5a94c09 (0xaefe bytes) 2024-09-11T06:17:19.533 INFO:teuthology.orchestra.run.smithi070.stdout:810 read 0xf79bec thru 0xf88380 (0xe795 bytes) 2024-09-11T06:17:19.534 INFO:teuthology.orchestra.run.smithi070.stdout:811 punch from 0x265b351 to 0x2663b60, (0x880f bytes) 2024-09-11T06:17:19.534 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.534 INFO:teuthology.orchestra.run.smithi070.stdout:813 read 0xc51405c thru 0xc5196f2 (0x5697 bytes) 2024-09-11T06:17:19.534 INFO:teuthology.orchestra.run.smithi070.stdout:814 read 0x5091f7f thru 0x509397d (0x19ff bytes) 2024-09-11T06:17:19.534 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.534 INFO:teuthology.orchestra.run.smithi070.stdout:816 read 0x81418d7 thru 0x81472b3 (0x59dd bytes) 2024-09-11T06:17:19.535 INFO:teuthology.orchestra.run.smithi070.stdout:817 read 0x1495923 thru 0x14a14f5 (0xbbd3 bytes) 2024-09-11T06:17:19.535 INFO:teuthology.orchestra.run.smithi070.stdout:819 read 0x87d819f thru 0x87dbe3f (0x3ca1 bytes) 2024-09-11T06:17:19.535 INFO:teuthology.orchestra.run.smithi070.stdout:820 read 0x4fa1a41 thru 0x4faa775 (0x8d35 bytes) 2024-09-11T06:17:19.535 INFO:teuthology.orchestra.run.smithi070.stdout:823 write 0x255eeb thru 0x2586c2 (0x27d8 bytes) 2024-09-11T06:17:19.535 INFO:teuthology.orchestra.run.smithi070.stdout:824 writesame 0x7052e78 thru 0x705becb data_size 0x6(0x9054 bytes) 2024-09-11T06:17:19.540 INFO:teuthology.orchestra.run.smithi070.stdout:826 writesame 0x96e9324 thru 0x96e9b16 data_size 0xb(0x7f3 bytes) 2024-09-11T06:17:19.543 INFO:teuthology.orchestra.run.smithi070.stdout:827 read 0x91175b2 thru 0x9118e87 (0x18d6 bytes) 2024-09-11T06:17:19.551 INFO:teuthology.orchestra.run.smithi070.stdout:830 writesame 0xebdf635 thru 0xebe4af4 data_size 0x18(0x54c0 bytes) 2024-09-11T06:17:19.551 INFO:teuthology.orchestra.run.smithi070.stdout:831 read 0x44b21fa thru 0x44c0f9c (0xeda3 bytes) 2024-09-11T06:17:19.551 INFO:teuthology.orchestra.run.smithi070.stdout:832 punch from 0xeb675e3 to 0xeb7521e, (0xdc3b bytes) 2024-09-11T06:17:19.551 INFO:teuthology.orchestra.run.smithi070.stdout:835 write 0xbde6cb8 thru 0xbdeee3f (0x8188 bytes) 2024-09-11T06:17:19.555 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:19.555+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:19.556 INFO:teuthology.orchestra.run.smithi070.stdout:836 trunc from 0xebe4af5 to 0xcfec6c7 2024-09-11T06:17:19.561 INFO:teuthology.orchestra.run.smithi070.stdout:837 read 0x5d7aba4 thru 0x5d7f3c1 (0x481e bytes) 2024-09-11T06:17:19.561 INFO:teuthology.orchestra.run.smithi070.stdout:839 write 0xaed73cb thru 0xaee5182 (0xddb8 bytes) 2024-09-11T06:17:19.565 INFO:teuthology.orchestra.run.smithi070.stdout:843 write 0x887faa9 thru 0x888a5b1 (0xab09 bytes) 2024-09-11T06:17:19.568 INFO:teuthology.orchestra.run.smithi070.stdout:844 write 0xce0b1e1 thru 0xce19a9a (0xe8ba bytes) 2024-09-11T06:17:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:846 read 0xbb732f8 thru 0xbb7d7e3 (0xa4ec bytes) 2024-09-11T06:17:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:847 punch from 0x8f39e74 to 0x8f46202, (0xc38e bytes) 2024-09-11T06:17:19.572 INFO:teuthology.orchestra.run.smithi070.stdout:848 punch from 0xb5e1eeb to 0xb5e819a, (0x62af bytes) 2024-09-11T06:17:19.572 INFO:teuthology.orchestra.run.smithi070.stdout:851 writesame 0xb22e6bb thru 0xb23c3e9 data_size 0x1(0xdd2f bytes) 2024-09-11T06:17:19.595 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:19.595 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:19.595 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:19.595 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:19.595 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:19.600 INFO:teuthology.orchestra.run.smithi070.stdout:852 write 0x50498eb thru 0x50590e1 (0xf7f7 bytes) 2024-09-11T06:17:19.603 INFO:teuthology.orchestra.run.smithi070.stdout:853 punch from 0x5a8b4c5 to 0x5a95247, (0x9d82 bytes) 2024-09-11T06:17:19.603 INFO:teuthology.orchestra.run.smithi070.stdout:854 read 0x2989a78 thru 0x298baff (0x2088 bytes) 2024-09-11T06:17:19.603 INFO:teuthology.orchestra.run.smithi070.stdout:855 write 0xd255f5 thru 0xd2cdb7 (0x77c3 bytes) 2024-09-11T06:17:19.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:19.605 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.605 INFO:teuthology.orchestra.run.smithi070.stdout:861 read 0x57fbf67 thru 0x58080d2 (0xc16c bytes) 2024-09-11T06:17:19.605 INFO:teuthology.orchestra.run.smithi070.stdout:862 write 0xc44da7e thru 0xc457a82 (0xa005 bytes) 2024-09-11T06:17:19.607 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.608 INFO:teuthology.orchestra.run.smithi070.stdout:864 write 0xa79da44 thru 0xa7abf12 (0xe4cf bytes) 2024-09-11T06:17:19.612 INFO:teuthology.orchestra.run.smithi070.stdout:866 write 0x8d6af24 thru 0x8d7071d (0x57fa bytes) 2024-09-11T06:17:19.614 INFO:teuthology.orchestra.run.smithi070.stdout:867 write 0xac3a106 thru 0xac3ea50 (0x494b bytes) 2024-09-11T06:17:19.625 INFO:teuthology.orchestra.run.smithi070.stdout:869 writesame 0xec41d47 thru 0xec45390 data_size 0x1(0x364a bytes) 2024-09-11T06:17:19.625 INFO:teuthology.orchestra.run.smithi070.stdout:870 write 0x4183f56 thru 0x4185832 (0x18dd bytes) 2024-09-11T06:17:19.628 INFO:teuthology.orchestra.run.smithi070.stdout:871 writesame 0x5dadb3d thru 0x5daf255 data_size 0x1b(0x1719 bytes) 2024-09-11T06:17:19.631 INFO:teuthology.orchestra.run.smithi070.stdout:872 write 0x24d7ec8 thru 0x24e11ca (0x9303 bytes) 2024-09-11T06:17:19.638 INFO:teuthology.orchestra.run.smithi070.stdout:873 writesame 0xccf0c79 thru 0xccf66c7 data_size 0x1(0x5a4f bytes) 2024-09-11T06:17:19.638 INFO:teuthology.orchestra.run.smithi070.stdout:875 write 0x2985c97 thru 0x2994766 (0xead0 bytes) 2024-09-11T06:17:19.641 INFO:teuthology.orchestra.run.smithi070.stdout:876 write 0x608c06b thru 0x60948d9 (0x886f bytes) 2024-09-11T06:17:19.644 INFO:teuthology.orchestra.run.smithi070.stdout:877 read 0x48efe46 thru 0x48fa900 (0xaabb bytes) 2024-09-11T06:17:19.644 INFO:teuthology.orchestra.run.smithi070.stdout:878 writesame 0xdd2ce1f thru 0xdd3c9fb data_size 0x3d(0xfbdd bytes) 2024-09-11T06:17:19.648 INFO:teuthology.orchestra.run.smithi070.stdout:879 read 0x50eb4e thru 0x50f7dc (0xc8f bytes) 2024-09-11T06:17:19.649 INFO:teuthology.orchestra.run.smithi070.stdout:880 writesame 0x1f2f67c thru 0x1f32163 data_size 0x4(0x2ae8 bytes) 2024-09-11T06:17:19.656 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:19.655+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:19.659 INFO:teuthology.orchestra.run.smithi070.stdout:883 trunc from 0xec45391 to 0x9afc1ed 2024-09-11T06:17:19.675 INFO:teuthology.orchestra.run.smithi070.stdout:885 read 0x2cc59bc thru 0x2ccae1b (0x5460 bytes) 2024-09-11T06:17:19.675 INFO:teuthology.orchestra.run.smithi070.stdout:888 write 0x503b9d5 thru 0x504aaaf (0xf0db bytes) 2024-09-11T06:17:19.680 INFO:teuthology.orchestra.run.smithi070.stdout:889 writesame 0x3a2d5e7 thru 0x3a3938b data_size 0x1(0xbda5 bytes) 2024-09-11T06:17:19.706 INFO:teuthology.orchestra.run.smithi070.stdout:890 read 0x2396b58 thru 0x23a46a5 (0xdb4e bytes) 2024-09-11T06:17:19.707 INFO:teuthology.orchestra.run.smithi070.stdout:892 punch from 0x3d022fa to 0x3d0ef89, (0xcc8f bytes) 2024-09-11T06:17:19.707 INFO:teuthology.orchestra.run.smithi070.stdout:893 read 0x951b0c1 thru 0x9524294 (0x91d4 bytes) 2024-09-11T06:17:19.707 INFO:teuthology.orchestra.run.smithi070.stdout:895 punch from 0x1b767ff to 0x1b78279, (0x1a7a bytes) 2024-09-11T06:17:19.707 INFO:teuthology.orchestra.run.smithi070.stdout:898 write 0x2890f7 thru 0x28c8dd (0x37e7 bytes) 2024-09-11T06:17:19.718 INFO:teuthology.orchestra.run.smithi070.stdout:899 write 0xc432f15 thru 0xc441347 (0xe433 bytes) 2024-09-11T06:17:19.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:17:19.730 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.108597345, 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:17:19.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.814161767000002, 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.739 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:17:19.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-11T06:17:19.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:00.626591+0000", 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.101636292999999, 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017394120000000001, 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 5 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626591+0000", 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626591+0000", 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626593+0000", 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3010000000000001e-06 2024-09-11T06:17:19.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626604+0000", 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0723999999999999e-05 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626619+0000", 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5716e-05 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626637+0000", 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7326999999999999e-05 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626704+0000", 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7891000000000004e-05 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626829+0000", 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124466 2024-09-11T06:17:19.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.626952+0000", 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123041 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.627782+0000", 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00083002200000000003 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.628259+0000", 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000477324 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.628298+0000", 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8878000000000003e-05 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:00.628330+0000", 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1721999999999999e-05 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:01.628325+0000", 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.099901600999999, 2024-09-11T06:17:19.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001650742, 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628325+0000", 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628325+0000", 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628328+0000", 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3290000000000001e-06 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628337+0000", 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3000000000000007e-06 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628353+0000", 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6622000000000001e-05 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628362+0000", 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7450000000000001e-06 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628416+0000", 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730999999999998e-05 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628486+0000", 2024-09-11T06:17:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9987000000000006e-05 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.628640+0000", 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015440699999999999 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.629449+0000", 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080906800000000003 2024-09-11T06:17:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.629878+0000", 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000428799 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.629925+0000", 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:01.629976+0000", 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1255999999999999e-05 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:140 3.1d 3:ba76cd85:::image_client.0-clone1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.726112+0000", 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0021146439999997, 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001853876, 2024-09-11T06:17:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 140 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726112+0000", 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726112+0000", 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726114+0000", 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.539e-06 2024-09-11T06:17:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726120+0000", 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4649999999999999e-06 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726135+0000", 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4399999999999999e-05 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726146+0000", 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1171e-05 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726202+0000", 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6648999999999999e-05 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.726208+0000", 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2279999999999998e-06 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.727859+0000", 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001650973 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.727966+0000", 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107451 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:482 3.a 3:56403c30:::rbd_data.116dc3b5629f.00000000000000ec:head [set-alloc-hint object_size 1048576 write_size 1048576,write 525621~47359] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.870890+0000", 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.857336493, 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017107800000000001, 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 482 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.870890+0000", 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.870890+0000", 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.870893+0000", 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2850000000000001e-06 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.870944+0000", 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1563000000000001e-05 2024-09-11T06:17:19.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.870963+0000", 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8414e-05 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.870972+0000", 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3540000000000006e-06 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.871037+0000", 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5130999999999997e-05 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.871169+0000", 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132228 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.871320+0000", 2024-09-11T06:17:19.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150438 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.872371+0000", 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010513370000000001 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.872534+0000", 2024-09-11T06:17:19.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016305200000000001 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.872570+0000", 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6334000000000001e-05 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.872601+0000", 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0644e-05 2024-09-11T06:17:19.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:493 3.14 3:2de41705:::rbd_data.116dc3b5629f.0000000000000043:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.891165+0000", 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.837062033, 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022206420000000001, 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 493 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891165+0000", 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891165+0000", 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891167+0000", 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9690000000000001e-06 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891178+0000", 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1164e-05 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891195+0000", 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7016000000000001e-05 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891204+0000", 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0939999999999997e-06 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891277+0000", 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2761000000000004e-05 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.891385+0000", 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108341 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893385+0000", 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020002969999999998 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:509 3.13 3:ccffe624:::rbd_data.116dc3b5629f.0000000000000071:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.897609+0000", 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.8306179030000003, 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018275839999999999, 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:19.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 509 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897609+0000", 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897609+0000", 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897610+0000", 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4789999999999999e-06 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897616+0000", 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8669999999999999e-06 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897630+0000", 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3696999999999999e-05 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897638+0000", 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6690000000000006e-06 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897696+0000", 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8362000000000001e-05 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.897793+0000", 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6769999999999997e-05 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.899437+0000", 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016437400000000001 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:512 3.a 3:56403c30:::rbd_data.116dc3b5629f.00000000000000ec:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.898422+0000", 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.829804701, 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001577324, 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 512 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898422+0000", 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898422+0000", 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898423+0000", 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7400000000000002e-07 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898429+0000", 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9490000000000001e-06 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898449+0000", 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0457000000000001e-05 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898457+0000", 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4120000000000004e-06 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898505+0000", 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7929999999999997e-05 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898588+0000", 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3540000000000003e-05 2024-09-11T06:17:19.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898696+0000", 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107345 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.899329+0000", 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00063294899999999995 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.899907+0000", 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057832499999999998 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.899957+0000", 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0426000000000001e-05 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.899999+0000", 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2116999999999997e-05 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2333 3.11 3:8a085081:::rbd_data.116dc3b5629f.000000000000001d:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.378014+0000", 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.35021317099999999, 2024-09-11T06:17:19.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021341049999999999, 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2333 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378014+0000", 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378014+0000", 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378017+0000", 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1659999999999998e-06 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378034+0000", 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7561e-05 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378063+0000", 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8354999999999999e-05 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378075+0000", 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2077e-05 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378152+0000", 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6840000000000003e-05 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378248+0000", 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6146999999999999e-05 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378363+0000", 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115207 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379347+0000", 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098393099999999995 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.380060+0000", 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071334299999999996 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.380118+0000", 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7241999999999998e-05 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.380148+0000", 2024-09-11T06:17:19.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0236e-05 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:2335 3.17 e33/24 3:e83c81e7:::rbd_data.116dc3b5629f.000000000000002f:head v 33'20, mlcod=33'18)", 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.378311+0000", 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.34991628200000002, 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001158049, 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378311+0000", 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378311+0000", 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378312+0000", 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2330000000000001e-06 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378322+0000", 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0526000000000001e-05 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378335+0000", 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.24e-05 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378342+0000", 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5190000000000003e-06 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378404+0000", 2024-09-11T06:17:19.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1941999999999997e-05 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378426+0000", 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1520000000000001e-05 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379434+0000", 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001008805 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379469+0000", 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4103999999999997e-05 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:2334 3.16 e33/24 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head v 33'37, mlcod=33'35)", 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.378452+0000", 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.34977489499999997, 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00116961, 2024-09-11T06:17:19.803 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378452+0000", 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378452+0000", 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378453+0000", 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378461+0000", 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2120000000000003e-06 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378471+0000", 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9210000000000004e-06 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378477+0000", 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3509999999999998e-06 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378526+0000", 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8770000000000002e-05 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378547+0000", 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0908e-05 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379580+0000", 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010328799999999999 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379622+0000", 2024-09-11T06:17:19.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1811000000000003e-05 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2344 3.1d 3:ba9a96b9:::rbd_data.116dc3b5629f.0000000000000012:head [truncate 906607] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.383400+0000", 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.344826562, 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012890740000000001, 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2344 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383400+0000", 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383400+0000", 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383402+0000", 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3289999999999999e-06 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383407+0000", 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8390000000000003e-06 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383419+0000", 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1184e-05 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383424+0000", 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.699e-06 2024-09-11T06:17:19.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383481+0000", 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6320000000000003e-05 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383574+0000", 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3356000000000005e-05 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.383708+0000", 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013372899999999999 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.384222+0000", 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051429799999999995 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.384625+0000", 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040345300000000001 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.384657+0000", 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1838000000000002e-05 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.384689+0000", 2024-09-11T06:17:19.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2029000000000001e-05 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2374 3.d 3:b06978a7:::rbd_data.116dc3b5629f.0000000000000093:head [set-alloc-hint object_size 1048576 write_size 1048576,write 871270~23709] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.411267+0000", 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.31696006799999998, 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012666260000000001, 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2374 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411267+0000", 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411267+0000", 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411268+0000", 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1769999999999999e-06 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411281+0000", 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3013000000000001e-05 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411291+0000", 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502999999999999e-05 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411297+0000", 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8529999999999997e-06 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411354+0000", 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7163999999999997e-05 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411447+0000", 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2145000000000006e-05 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.411540+0000", 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3187000000000001e-05 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.412249+0000", 2024-09-11T06:17:19.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000709062 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.412467+0000", 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021833399999999999 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.412500+0000", 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2663999999999998e-05 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.412533+0000", 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3524e-05 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2400 3.13 3:cc624474:::rbd_data.116dc3b5629f.0000000000000060:head [set-alloc-hint object_size 1048576 write_size 1048576,write 393216~30295] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.436569+0000", 2024-09-11T06:17:19.822 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.29165787100000001, 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001303551, 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2400 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436569+0000", 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436569+0000", 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436571+0000", 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436588+0000", 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7459e-05 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436605+0000", 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7003999999999998e-05 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436613+0000", 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9549999999999992e-06 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436672+0000", 2024-09-11T06:17:19.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8699999999999997e-05 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436736+0000", 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3819999999999995e-05 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.436837+0000", 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101025 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.437754+0000", 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091792700000000002 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.437793+0000", 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8574e-05 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.437829+0000", 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6140000000000003e-05 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.437873+0000", 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3325999999999998e-05 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2401 3.11 3:8c85306a:::rbd_data.116dc3b5629f.0000000000000065:head [set-alloc-hint object_size 1048576 write_size 1048576,write 377172~16044] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.438835+0000", 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.28939166599999999, 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012230120000000001, 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2401 2024-09-11T06:17:19.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.438835+0000", 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.438835+0000", 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.438836+0000", 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2900000000000002e-07 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.438847+0000", 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0954999999999999e-05 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.438856+0000", 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8270000000000004e-06 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.438861+0000", 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.438917+0000", 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6122000000000002e-05 2024-09-11T06:17:19.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.438972+0000", 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5458999999999999e-05 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.439066+0000", 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3467999999999993e-05 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.439725+0000", 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065897899999999997 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.439995+0000", 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000270165 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.440028+0000", 2024-09-11T06:17:19.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3574000000000001e-05 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.440058+0000", 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9757999999999999e-05 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2447 3.d 3:b06978a7:::rbd_data.116dc3b5629f.0000000000000093:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.836 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.509024+0000", 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.21920271799999999, 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016848200000000001, 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2447 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.837 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509024+0000", 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509024+0000", 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509026+0000", 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.79e-06 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509034+0000", 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8869999999999992e-06 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509049+0000", 2024-09-11T06:17:19.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.521e-05 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509058+0000", 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8219999999999996e-06 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509127+0000", 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8789999999999997e-05 2024-09-11T06:17:19.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509216+0000", 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9347999999999999e-05 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.509513+0000", 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029744 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.510634+0000", 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00112071 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.510651+0000", 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7113e-05 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.510681+0000", 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0093000000000001e-05 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.510709+0000", 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7617e-05 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2458 3.9 3:94a155d7:::rbd_data.116dc3b5629f.0000000000000000:head [write 483051~10200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.534474+0000", 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.19375326100000001, 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00136717, 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2458 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534474+0000", 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534474+0000", 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534475+0000", 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534486+0000", 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1212e-05 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534501+0000", 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4829e-05 2024-09-11T06:17:19.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534510+0000", 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0299999999999999e-06 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534570+0000", 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9577000000000002e-05 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534657+0000", 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7354000000000004e-05 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.534792+0000", 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013450199999999999 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.535450+0000", 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065857100000000005 2024-09-11T06:17:19.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.535738+0000", 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028790100000000002 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.535793+0000", 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5149999999999999e-05 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.535841+0000", 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7355999999999999e-05 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2496 3.13 3:ce7f97d2:::rbd_data.116dc3b5629f.000000000000004e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 432363~63479] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.602020+0000", 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.12620680200000001, 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278559999999999, 2024-09-11T06:17:19.850 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2496 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602020+0000", 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602020+0000", 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602022+0000", 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.187e-06 2024-09-11T06:17:19.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602050+0000", 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7577e-05 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602067+0000", 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7167999999999999e-05 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602076+0000", 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.687e-06 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602141+0000", 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5114e-05 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602206+0000", 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5702000000000002e-05 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.602312+0000", 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105716 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.603245+0000", 2024-09-11T06:17:19.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000932489 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.603384+0000", 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013934799999999999 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.603416+0000", 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2070000000000003e-05 2024-09-11T06:17:19.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.603448+0000", 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1798000000000003e-05 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2558 3.13 3:ce7f97d2:::rbd_data.116dc3b5629f.000000000000004e:head [write 393216~43696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.676230+0000", 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.051996492999999998, 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001440853, 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2558 2024-09-11T06:17:19.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676230+0000", 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676230+0000", 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676233+0000", 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4279999999999999e-06 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676255+0000", 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2082e-05 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676271+0000", 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5998000000000002e-05 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676279+0000", 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9340000000000006e-06 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:19.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676347+0000", 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8518999999999999e-05 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676433+0000", 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6032000000000006e-05 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.676586+0000", 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015276299999999999 2024-09-11T06:17:19.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.677525+0000", 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00093881499999999996 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.677611+0000", 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6051999999999995e-05 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.677644+0000", 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3458999999999999e-05 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.677671+0000", 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6771000000000002e-05 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:19.864 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:19.865 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:19.866 INFO:teuthology.orchestra.run.smithi070.stdout:900 writesame 0xcf0de3c thru 0xcf19d08 data_size 0x1(0xbecd bytes) 2024-09-11T06:17:19.866 INFO:teuthology.orchestra.run.smithi070.stdout:901 punch from 0x765f4ef to 0x766212a, (0x2c3b bytes) 2024-09-11T06:17:19.866 INFO:teuthology.orchestra.run.smithi070.stdout:902 punch from 0x8435dcf to 0x844451a, (0xe74b bytes) 2024-09-11T06:17:19.866 INFO:teuthology.orchestra.run.smithi070.stdout:903 write 0x9e6cca9 thru 0x9e6fe07 (0x315f bytes) 2024-09-11T06:17:19.866 INFO:teuthology.orchestra.run.smithi070.stdout:905 write 0x517527f thru 0x518365f (0xe3e1 bytes) 2024-09-11T06:17:19.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:19.869 INFO:teuthology.orchestra.run.smithi070.stdout:906 write 0x28040cb thru 0x2812b77 (0xeaad bytes) 2024-09-11T06:17:19.869 INFO:teuthology.orchestra.run.smithi070.stdout:907 punch from 0x416fa8b to 0x417f832, (0xfda7 bytes) 2024-09-11T06:17:19.869 INFO:teuthology.orchestra.run.smithi070.stdout:908 read 0x4837005 thru 0x48401f9 (0x91f5 bytes) 2024-09-11T06:17:19.869 INFO:teuthology.orchestra.run.smithi070.stdout:909 write 0xe3d343f thru 0xe3e2a59 (0xf61b bytes) 2024-09-11T06:17:19.869 INFO:teuthology.orchestra.run.smithi070.stdout:910 read 0x90fe073 thru 0x910397a (0x5908 bytes) 2024-09-11T06:17:19.869 INFO:teuthology.orchestra.run.smithi070.stdout:911 read 0x2c97605 thru 0x2c9e8ef (0x72eb bytes) 2024-09-11T06:17:19.869 INFO:teuthology.orchestra.run.smithi070.stdout:912 write 0xa170069 thru 0xa17a4f2 (0xa48a bytes) 2024-09-11T06:17:19.870 INFO:teuthology.orchestra.run.smithi070.stdout:913 read 0xc222bf1 thru 0xc22e26b (0xb67b bytes) 2024-09-11T06:17:19.870 INFO:teuthology.orchestra.run.smithi070.stdout:915 trunc from 0xe3e2a5a to 0x89c2e8f 2024-09-11T06:17:19.870 INFO:teuthology.orchestra.run.smithi070.stdout:917 write 0xe3737eb thru 0xe3809c3 (0xd1d9 bytes) 2024-09-11T06:17:19.870 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:19.870 INFO:teuthology.orchestra.run.smithi070.stdout:920 write 0x7fd2538 thru 0x7fd50ee (0x2bb7 bytes) 2024-09-11T06:17:19.870 INFO:teuthology.orchestra.run.smithi070.stdout:921 write 0xa2c6867 thru 0xa2d4031 (0xd7cb bytes) 2024-09-11T06:17:19.870 INFO:teuthology.orchestra.run.smithi070.stdout:922 writesame 0x98c0e8b thru 0x98c66f9 data_size 0x1(0x586f bytes) 2024-09-11T06:17:19.871 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:19.866+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:19.974 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:19.974 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:19.975 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:19.975 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:19.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:20.017 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:19.966+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:20.027 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:20.027 INFO:teuthology.orchestra.run.smithi070.stdout:925 read 0x2266fca thru 0x226ad6b (0x3da2 bytes) 2024-09-11T06:17:20.027 INFO:teuthology.orchestra.run.smithi070.stdout:926 write 0xd3e9bc4 thru 0xd3eaac0 (0xefd bytes) 2024-09-11T06:17:20.031 INFO:teuthology.orchestra.run.smithi070.stdout:927 writesame 0x907e709 thru 0x908b988 data_size 0x10(0xd280 bytes) 2024-09-11T06:17:20.036 INFO:teuthology.orchestra.run.smithi070.stdout:929 punch from 0x5addb03 to 0x5ae9d88, (0xc285 bytes) 2024-09-11T06:17:20.036 INFO:teuthology.orchestra.run.smithi070.stdout:930 write 0xcfb858a thru 0xcfc0e96 (0x890d bytes) 2024-09-11T06:17:20.039 INFO:teuthology.orchestra.run.smithi070.stdout:931 write 0xaa74124 thru 0xaa82778 (0xe655 bytes) 2024-09-11T06:17:20.046 INFO:teuthology.orchestra.run.smithi070.stdout:935 trunc from 0xe3809c4 to 0xbb63654 2024-09-11T06:17:20.057 INFO:teuthology.orchestra.run.smithi070.stdout:936 write 0x56faf7d thru 0x57062bb (0xb33f bytes) 2024-09-11T06:17:20.061 INFO:teuthology.orchestra.run.smithi070.stdout:937 punch from 0x88c51e2 to 0x88cddce, (0x8bec bytes) 2024-09-11T06:17:20.061 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:20.061 INFO:teuthology.orchestra.run.smithi070.stdout:941 write 0x69f7c90 thru 0x6a03b5f (0xbed0 bytes) 2024-09-11T06:17:20.067 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:20.067+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:20.074 INFO:teuthology.orchestra.run.smithi070.stdout:945 trunc from 0xbb63654 to 0x3eea394 2024-09-11T06:17:20.096 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:20.097 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:20.100 INFO:teuthology.orchestra.run.smithi070.stdout:947 write 0x49c8c94 thru 0x49cf98c (0x6cf9 bytes) 2024-09-11T06:17:20.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:20.108 INFO:teuthology.orchestra.run.smithi070.stdout:948 read 0xf8b81e thru 0xf99748 (0xdf2b bytes) 2024-09-11T06:17:20.108 INFO:teuthology.orchestra.run.smithi070.stdout:951 read 0x2d88822 thru 0x2d8fe62 (0x7641 bytes) 2024-09-11T06:17:20.108 INFO:teuthology.orchestra.run.smithi070.stdout:952 clone 2 order 25 su 4194304 sc 15 2024-09-11T06:17:20.190 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:20.190+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:20.251 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:285 3.19 3:9d7ea5eb:::rbd_data.116dc3b5629f.000000000000003d:head [zero 0~131072,write 131072~40157 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.733216+0000", 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.5164929169999999, 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039163119999999999, 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 285 2024-09-11T06:17:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733216+0000", 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733216+0000", 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733218+0000", 2024-09-11T06:17:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.695e-06 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733713+0000", 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049454999999999996 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733731+0000", 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8168e-05 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733741+0000", 2024-09-11T06:17:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0244999999999999e-05 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733823+0000", 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1324999999999998e-05 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733961+0000", 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000138362 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.734089+0000", 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000128076 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.735368+0000", 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012788159999999999 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737018+0000", 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016504060000000001 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737075+0000", 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6586999999999999e-05 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737132+0000", 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7082e-05 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:393 3.1b 3:ded177d1:::rbd_data.116dc3b5629f.0000000000000094:head [zero 0~33278,write 33278~34842 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.750204+0000", 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4995048740000003, 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001514636, 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 393 2024-09-11T06:17:20.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750204+0000", 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750204+0000", 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750205+0000", 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4309999999999999e-06 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750255+0000", 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0135e-05 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750282+0000", 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6886e-05 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750296+0000", 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3628000000000001e-05 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750356+0000", 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0495000000000003e-05 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750454+0000", 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7360000000000003e-05 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.750540+0000", 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6385999999999996e-05 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751264+0000", 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072436699999999996 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751654+0000", 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039006099999999998 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751689+0000", 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4981000000000003e-05 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.751718+0000", 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8906000000000001e-05 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:487 3.19 3:9d7ea5eb:::rbd_data.116dc3b5629f.000000000000003d:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.891138+0000", 2024-09-11T06:17:20.263 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3585704299999999, 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026632750000000001, 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 487 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891138+0000", 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891138+0000", 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891140+0000", 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891148+0000", 2024-09-11T06:17:20.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9619999999999993e-06 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891168+0000", 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0105000000000001e-05 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891178+0000", 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0023999999999999e-05 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891252+0000", 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3991000000000004e-05 2024-09-11T06:17:20.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891346+0000", 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3970999999999999e-05 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891459+0000", 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112629 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.892223+0000", 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00076421400000000004 2024-09-11T06:17:20.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893690+0000", 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001467185 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893741+0000", 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1125999999999998e-05 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893801+0000", 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0022000000000002e-05 2024-09-11T06:17:20.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:492 3.19 3:9db01ea0:::rbd_data.116dc3b5629f.0000000000000042:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.891594+0000", 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3581148929999998, 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023433030000000001, 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:20.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 492 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891594+0000", 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891594+0000", 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891594+0000", 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7199999999999998e-07 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891598+0000", 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2119999999999997e-06 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891609+0000", 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0908e-05 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891617+0000", 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1470000000000001e-06 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891818+0000", 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020016399999999999 2024-09-11T06:17:20.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891925+0000", 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010770800000000001 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893937+0000", 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020114920000000001 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:496 3.19 3:9cb67828:::rbd_data.116dc3b5629f.0000000000000046:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.892941+0000", 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.356767031, 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001549772, 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 496 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.274 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.892941+0000", 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.892941+0000", 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.892943+0000", 2024-09-11T06:17:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.167e-06 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.892948+0000", 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5010000000000004e-06 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.892963+0000", 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4935e-05 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.892973+0000", 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8050000000000001e-06 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893030+0000", 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7522000000000003e-05 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893143+0000", 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112219 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894491+0000", 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001348623 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:500 3.6 3:62f2cdc7:::rbd_data.116dc3b5629f.000000000000004a:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.893985+0000", 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.355723835, 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032991190000000001, 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:20.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 500 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893985+0000", 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893985+0000", 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893986+0000", 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8100000000000001e-07 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893992+0000", 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9920000000000004e-06 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894004+0000", 2024-09-11T06:17:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2043e-05 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894013+0000", 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2949999999999999e-06 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894079+0000", 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6118999999999995e-05 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894199+0000", 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011964 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897284+0000", 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0030850489999999999 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:502 3.1b 3:dcdb4a6b:::rbd_data.116dc3b5629f.000000000000004c:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.894245+0000", 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.355463726, 2024-09-11T06:17:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032131719999999998, 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 502 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894245+0000", 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894245+0000", 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894246+0000", 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.003e-06 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894251+0000", 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1749999999999996e-06 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894261+0000", 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6989999999999998e-06 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894284+0000", 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3592999999999999e-05 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894340+0000", 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6035000000000001e-05 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894452+0000", 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000111412 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897458+0000", 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0030062550000000002 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.93370547199999998, 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:17:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4461.0:2311 3.6 e33/24 ondisk, result = 0)", 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.329443+0000", 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.92026570600000002, 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0072359429999999999, 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.329443+0000", 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.329443+0000", 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.329443+0000", 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4700000000000001e-07 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.329446+0000", 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.329457+0000", 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0645000000000001e-05 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.329481+0000", 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3743999999999998e-05 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336660+0000", 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071789690000000003 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336668+0000", 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8089999999999993e-06 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336679+0000", 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1119e-05 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2336 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.377999+0000", 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87170968800000004, 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034962959999999999, 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2336 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.377999+0000", 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.377999+0000", 2024-09-11T06:17:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378000+0000", 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.009e-06 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378004+0000", 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378017+0000", 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2255e-05 2024-09-11T06:17:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378024+0000", 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378080+0000", 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5603999999999998e-05 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378185+0000", 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105269 2024-09-11T06:17:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378298+0000", 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112846 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.380387+0000", 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020891920000000001 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.381406+0000", 2024-09-11T06:17:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0010195670000000001 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.381454+0000", 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7641e-05 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.381495+0000", 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0988000000000001e-05 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2340 3.19 3:9a47d4f8:::rbd_data.116dc3b5629f.00000000000000a4:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.378042+0000", 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87166608300000004, 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017127360000000001, 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2340 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378042+0000", 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378042+0000", 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378043+0000", 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3200000000000005e-07 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378046+0000", 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.202e-06 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378053+0000", 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3050000000000004e-06 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378060+0000", 2024-09-11T06:17:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9809999999999997e-06 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378109+0000", 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8636e-05 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378179+0000", 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0068999999999996e-05 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378243+0000", 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4014000000000001e-05 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378719+0000", 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047572499999999998 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.379694+0000", 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00097470599999999999 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.379723+0000", 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9875000000000001e-05 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.379755+0000", 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1690999999999999e-05 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2492 3.19 3:9f24165c:::rbd_data.116dc3b5629f.00000000000000d0:head [set-alloc-hint object_size 1048576 write_size 1048576,write 307681~59578] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.570182+0000", 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.67952687899999997, 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00162601, 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2492 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570182+0000", 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570182+0000", 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570183+0000", 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4300000000000001e-07 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570261+0000", 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8176000000000005e-05 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570271+0000", 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0814e-05 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570277+0000", 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4949999999999999e-06 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570321+0000", 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3931999999999999e-05 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570372+0000", 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0698999999999997e-05 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.570459+0000", 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7332999999999999e-05 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.571035+0000", 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00057649399999999999 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.571739+0000", 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00070399700000000004 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.571780+0000", 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0732000000000002e-05 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.571808+0000", 2024-09-11T06:17:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7395000000000001e-05 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2535 3.19 3:9a47d4f8:::rbd_data.116dc3b5629f.00000000000000a4:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.661551+0000", 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.58815752700000001, 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001787933, 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2535 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661551+0000", 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661551+0000", 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661552+0000", 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8999999999999995e-07 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661556+0000", 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0169999999999998e-06 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661566+0000", 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0515e-05 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661572+0000", 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3159999999999996e-06 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661613+0000", 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1671000000000001e-05 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661670+0000", 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7049000000000002e-05 2024-09-11T06:17:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661771+0000", 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100956 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662846+0000", 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001074579 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663272+0000", 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00042586700000000002 2024-09-11T06:17:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663313+0000", 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1338999999999998e-05 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663339+0000", 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5834e-05 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2536 3.8 3:16e9d386:::rbd_data.116dc3b5629f.00000000000000a5:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.661589+0000", 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.588119261, 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025431899999999999, 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2536 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661589+0000", 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661589+0000", 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661590+0000", 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:17:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661591+0000", 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7579999999999999e-06 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661596+0000", 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9849999999999997e-06 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661600+0000", 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3100000000000001e-06 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661646+0000", 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6289999999999999e-05 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661720+0000", 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4196999999999995e-05 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661834+0000", 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011345000000000001 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662675+0000", 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00084126000000000003 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.664058+0000", 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001382819 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.664096+0000", 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8389999999999997e-05 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.664132+0000", 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6260999999999997e-05 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2538 3.7 3:e626f76b:::rbd_data.116dc3b5629f.00000000000000ae:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.661606+0000", 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.58810201900000003, 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054186659999999999, 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2538 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661606+0000", 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661606+0000", 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661607+0000", 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661608+0000", 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.311e-06 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661612+0000", 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:17:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661614+0000", 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7300000000000001e-06 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661661+0000", 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7169000000000002e-05 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661739+0000", 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7058999999999995e-05 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661852+0000", 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000113935 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.664062+0000", 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002209768 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666933+0000", 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00287076 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666985+0000", 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1616000000000002e-05 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.667025+0000", 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0509999999999997e-05 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2544 3.19 3:9f24165c:::rbd_data.116dc3b5629f.00000000000000d0:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.661622+0000", 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.58808631, 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054189260000000001, 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2544 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661622+0000", 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661622+0000", 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661623+0000", 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.39e-07 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661624+0000", 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7549999999999999e-06 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661630+0000", 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4129999999999997e-06 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661634+0000", 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000003e-06 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662357+0000", 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00072316199999999996 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662435+0000", 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7643000000000002e-05 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662590+0000", 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015514700000000001 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663806+0000", 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012155429999999999 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666956+0000", 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031500880000000001 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666998+0000", 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2722000000000002e-05 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.667041+0000", 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2713999999999998e-05 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2665 3.1b 3:df4bfc98:::rbd_data.116dc3b5629f.00000000000000aa:head [set-alloc-hint object_size 1048576 write_size 1048576,write 393216~10105] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:20.042478+0000", 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.20723023700000001, 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016346799999999999, 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2665 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042478+0000", 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042478+0000", 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042479+0000", 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2330000000000001e-06 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042492+0000", 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2605999999999999e-05 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042503+0000", 2024-09-11T06:17:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0674e-05 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042508+0000", 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042558+0000", 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9580999999999998e-05 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042686+0000", 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012819799999999999 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.042827+0000", 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000141104 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.043545+0000", 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00071842800000000001 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.044003+0000", 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00045774800000000001 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.044063+0000", 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000002e-05 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.044113+0000", 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9678000000000001e-05 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2699 3.19 3:9ed79809:::rbd_data.116dc3b5629f.0000000000000064:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:20.076620+0000", 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.17308874299999999, 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019089300000000001, 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2699 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076620+0000", 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076620+0000", 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076621+0000", 2024-09-11T06:17:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.367e-06 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076630+0000", 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4349999999999997e-06 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076641+0000", 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1358999999999999e-05 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076648+0000", 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4959999999999999e-06 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076703+0000", 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5031000000000002e-05 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076798+0000", 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4419000000000005e-05 2024-09-11T06:17:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.076906+0000", 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107954 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.077492+0000", 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058673000000000004 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.078465+0000", 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00097230299999999999 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.078496+0000", 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.074e-05 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.078529+0000", 2024-09-11T06:17:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3096000000000003e-05 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2710 3.1b 3:ded177d1:::rbd_data.116dc3b5629f.0000000000000094:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:20.079668+0000", 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.17004000499999999, 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020867490000000002, 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2710 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079668+0000", 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079668+0000", 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079669+0000", 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5600000000000004e-07 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079674+0000", 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7690000000000004e-06 2024-09-11T06:17:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079685+0000", 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0353999999999999e-05 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079691+0000", 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079759+0000", 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7942999999999996e-05 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079843+0000", 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4699999999999999e-05 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.079960+0000", 2024-09-11T06:17:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116823 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.080395+0000", 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00043523999999999999 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.081665+0000", 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001269502 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.081713+0000", 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7747999999999998e-05 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.081755+0000", 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2673000000000003e-05 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2736 3.6 3:62f2cdc7:::rbd_data.116dc3b5629f.000000000000004a:head [set-alloc-hint object_size 1048576 write_size 1048576,write 298132~27897] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:20.102816+0000", 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.146892356, 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054075219999999997, 2024-09-11T06:17:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2736 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.102816+0000", 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.102816+0000", 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.102818+0000", 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3970000000000001e-06 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.102837+0000", 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8906000000000002e-05 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.102854+0000", 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7008999999999999e-05 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.102862+0000", 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3220000000000004e-06 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.102912+0000", 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0064e-05 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.102916+0000", 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6099999999999999e-06 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.104586+0000", 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00166946 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.104670+0000", 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4575999999999998e-05 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.104818+0000", 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014731999999999999 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.106041+0000", 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001223121 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.108163+0000", 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002122171 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.108197+0000", 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3714999999999998e-05 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:20.108224+0000", 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6851000000000001e-05 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.361 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:20.362 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:20.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:20.361+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:20.463 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:20.462+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:20.505 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:20.505 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:20.505 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:20.505 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:20.513 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:20.564 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:20.563+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:20.616 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:20.616 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:20.616 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:20.617 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:20.617 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:20.625 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:20.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:20.666+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:20.765 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:20.765+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:20.770 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:20.770 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:20.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:33 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'19, mlcod=17'14)", 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:53.526781+0000", 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.242256817000001, 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005095235, 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526781+0000", 2024-09-11T06:17:20.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526781+0000", 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526782+0000", 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5799999999999999e-07 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526787+0000", 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526795+0000", 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1599999999999998e-06 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526800+0000", 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3499999999999999e-06 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526835+0000", 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5661999999999998e-05 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526848+0000", 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3108999999999999e-05 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.531832+0000", 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049840459999999998 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.531877+0000", 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4129999999999999e-05 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:37 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'23, mlcod=17'16)", 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:53.528772+0000", 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.240265678, 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0059884949999999999, 2024-09-11T06:17:20.775 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528772+0000", 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528772+0000", 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528773+0000", 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3099999999999997e-07 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528778+0000", 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6110000000000004e-06 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528787+0000", 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3980000000000005e-06 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528792+0000", 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3420000000000001e-06 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528833+0000", 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1020999999999999e-05 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528853+0000", 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0384999999999999e-05 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.534715+0000", 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058618999999999997 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.534761+0000", 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6106999999999997e-05 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.779 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:144 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:54.217977+0000", 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.551061283999999, 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058944399999999999, 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.217977+0000", 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.217977+0000", 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.217977+0000", 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5700000000000002e-07 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218047+0000", 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9356000000000005e-05 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218054+0000", 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2320000000000004e-06 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218058+0000", 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8199999999999998e-06 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218095+0000", 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6993000000000003e-05 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218105+0000", 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0394000000000001e-05 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.223836+0000", 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0057310429999999999 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.223871+0000", 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5045000000000001e-05 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.783 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:145 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'103, mlcod=17'98)", 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:54.218362+0000", 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.550676164999999, 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055288050000000004, 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218362+0000", 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218362+0000", 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218362+0000", 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0299999999999999e-07 2024-09-11T06:17:20.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218422+0000", 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9633000000000003e-05 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218429+0000", 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999998e-06 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218432+0000", 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3730000000000001e-06 2024-09-11T06:17:20.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218467+0000", 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5156e-05 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218480+0000", 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2897e-05 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.223874+0000", 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053935490000000001 2024-09-11T06:17:20.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.223891+0000", 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7034e-05 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'108)", 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:54.678648+0000", 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 26.09038997, 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053931689999999997, 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.788 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678648+0000", 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678648+0000", 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678649+0000", 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4899999999999995e-07 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678706+0000", 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7246e-05 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678714+0000", 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.554e-06 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678718+0000", 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2599999999999999e-06 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678753+0000", 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5661000000000003e-05 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678765+0000", 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1918e-05 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.683997+0000", 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052316410000000004 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.684041+0000", 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4339999999999999e-05 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:11.697150+0000", 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.0718883419999994, 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048607479999999998, 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.793 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697150+0000", 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697150+0000", 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697152+0000", 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.95e-06 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697158+0000", 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.195e-06 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697170+0000", 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2473999999999999e-05 2024-09-11T06:17:20.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697177+0000", 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2550000000000003e-06 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697227+0000", 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0002e-05 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697330+0000", 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103275 2024-09-11T06:17:20.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697474+0000", 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014447200000000001 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.698740+0000", 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001265391 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.701916+0000", 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031762040000000002 2024-09-11T06:17:20.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.701966+0000", 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9830000000000002e-05 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.702011+0000", 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000002e-05 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:148 3.18 3:184d3c88:::rbd_object_map.116dc3b5629f:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.737801+0000", 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.0312371320000002, 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005520367, 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 148 2024-09-11T06:17:20.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737801+0000", 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737801+0000", 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737802+0000", 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.463e-06 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737810+0000", 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8509999999999999e-06 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737825+0000", 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4963000000000001e-05 2024-09-11T06:17:20.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737833+0000", 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4189999999999996e-06 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737887+0000", 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4008999999999997e-05 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737891+0000", 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0210000000000001e-06 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739232+0000", 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001340918 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739305+0000", 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3786000000000001e-05 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739405+0000", 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100047 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743075+0000", 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003669945 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743265+0000", 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018956800000000001 2024-09-11T06:17:20.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743295+0000", 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0190000000000001e-05 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743321+0000", 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6186999999999998e-05 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:227 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'6, mlcod=27'2)", 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.723195+0000", 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0458427869999998, 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052394720000000002, 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723195+0000", 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723195+0000", 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723196+0000", 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723202+0000", 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4990000000000002e-06 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723212+0000", 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0097e-05 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723217+0000", 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4210000000000003e-06 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723275+0000", 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7568000000000002e-05 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723291+0000", 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6405999999999998e-05 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728385+0000", 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0050933030000000004 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728435+0000", 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0179000000000002e-05 2024-09-11T06:17:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:258 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'8, mlcod=31'3)", 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.725935+0000", 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0431035719999997, 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056757220000000002, 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725935+0000", 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725935+0000", 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725935+0000", 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725947+0000", 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1282e-05 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725957+0000", 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0638e-05 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725963+0000", 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726007+0000", 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3893000000000001e-05 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726022+0000", 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4766000000000001e-05 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731581+0000", 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055591420000000004 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731610+0000", 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9411999999999999e-05 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:259 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'9, mlcod=31'3)", 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.726445+0000", 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.042593535, 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051931060000000003, 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726445+0000", 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726445+0000", 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726445+0000", 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0599999999999999e-07 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726451+0000", 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1460000000000004e-06 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726459+0000", 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9060000000000002e-06 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726463+0000", 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6410000000000001e-06 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726498+0000", 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4419999999999999e-05 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726510+0000", 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2531000000000001e-05 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731613+0000", 2024-09-11T06:17:20.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051031770000000004 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731638+0000", 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4379000000000002e-05 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:274 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'14, mlcod=31'6)", 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.731653+0000", 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.037385156, 2024-09-11T06:17:20.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053908619999999997, 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731653+0000", 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731653+0000", 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731654+0000", 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7400000000000003e-07 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731660+0000", 2024-09-11T06:17:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2500000000000003e-06 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731673+0000", 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2908000000000001e-05 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731686+0000", 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2918000000000001e-05 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731824+0000", 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137949 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731838+0000", 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4491000000000001e-05 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737004+0000", 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051662770000000004 2024-09-11T06:17:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737044+0000", 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9394999999999998e-05 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:275 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'15, mlcod=31'6)", 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.732255+0000", 2024-09-11T06:17:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0367830839999996, 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048206430000000003, 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.732255+0000", 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.732255+0000", 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.732256+0000", 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0800000000000004e-07 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.732260+0000", 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4939999999999997e-06 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.732269+0000", 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3580000000000003e-06 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.732275+0000", 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1410000000000002e-06 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.732316+0000", 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0828999999999998e-05 2024-09-11T06:17:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.732331+0000", 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.554e-05 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737047+0000", 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047156619999999998 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737076+0000", 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8911000000000002e-05 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:374 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'28, mlcod=31'23)", 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.744392+0000", 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0246465349999996, 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005265835, 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744392+0000", 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744392+0000", 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744392+0000", 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744396+0000", 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4309999999999996e-06 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744403+0000", 2024-09-11T06:17:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7870000000000004e-06 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744408+0000", 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2540000000000003e-06 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744450+0000", 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2534000000000003e-05 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744464+0000", 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4242e-05 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749619+0000", 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051547119999999997 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749657+0000", 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8414999999999997e-05 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:384 3.10 e31/24 3:0c6bf9fb:::rbd_data.116dc3b5629f.000000000000006c:head v 31'4, mlcod=28'2)", 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.744543+0000", 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0244949300000004, 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051536359999999996, 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744543+0000", 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744543+0000", 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744544+0000", 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744667+0000", 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012360100000000001 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744675+0000", 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2470000000000008e-06 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744682+0000", 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2489999999999998e-06 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744756+0000", 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3811000000000002e-05 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744781+0000", 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5579999999999999e-05 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749662+0000", 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048805790000000003 2024-09-11T06:17:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749697+0000", 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5119e-05 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:375 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'29, mlcod=31'23)", 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.744715+0000", 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0243232249999998, 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049787579999999998, 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744715+0000", 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744715+0000", 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744715+0000", 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000002e-07 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744720+0000", 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1640000000000003e-06 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744729+0000", 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1209999999999996e-06 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744734+0000", 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3619999999999997e-06 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744827+0000", 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2936000000000006e-05 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744847+0000", 2024-09-11T06:17:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9607999999999999e-05 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749660+0000", 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004813927 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749694+0000", 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3192999999999999e-05 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:447 3.18 3:184d3c88:::rbd_object_map.116dc3b5629f:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.719312+0000", 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0497260930000003, 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0070999740000000002, 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 447 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719312+0000", 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719312+0000", 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719313+0000", 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.395e-06 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719319+0000", 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.361e-06 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719330+0000", 2024-09-11T06:17:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1454000000000001e-05 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719338+0000", 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6040000000000004e-06 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719397+0000", 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9394000000000001e-05 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719405+0000", 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0690000000000002e-06 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.720957+0000", 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001551738 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.721073+0000", 2024-09-11T06:17:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011555799999999999 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.721241+0000", 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016852300000000001 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.722148+0000", 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00090736400000000002 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.726319+0000", 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004170221 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.726372+0000", 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2862999999999999e-05 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.726412+0000", 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0429999999999997e-05 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2451 3.18 3:1f17666a:::rbd_data.116dc3b5629f.0000000000000020:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.2537144389999999, 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012096045, 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2451 2024-09-11T06:17:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515329+0000", 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1330000000000001e-06 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515339+0000", 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8989999999999996e-06 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515344+0000", 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515378+0000", 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3519999999999998e-05 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515423+0000", 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5221e-05 2024-09-11T06:17:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.517881+0000", 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024577269999999998 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527239+0000", 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093582379999999996 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527297+0000", 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7481000000000001e-05 2024-09-11T06:17:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527352+0000", 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5145000000000001e-05 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527420+0000", 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8062e-05 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4461.0:2451 3.18 e33/24 ondisk, result = 0)", 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.522099+0000", 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.2469387890000001, 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053272299999999996, 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522099+0000", 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522099+0000", 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522100+0000", 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2500000000000004e-07 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522103+0000", 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2569999999999999e-06 2024-09-11T06:17:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522114+0000", 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1032999999999999e-05 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522121+0000", 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8940000000000004e-06 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527281+0000", 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051597350000000004 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527290+0000", 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9449999999999999e-06 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527427+0000", 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013654100000000001 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2577 3.1f 3:fcb81ce6:::rbd_data.116dc3b5629f.00000000000000c3:head [set-alloc-hint object_size 1048576 write_size 1048576,write 732949~53483] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.720025+0000", 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.049013073, 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052113009999999998, 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2577 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720025+0000", 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720025+0000", 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720029+0000", 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7720000000000001e-06 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720088+0000", 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9487999999999997e-05 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720098+0000", 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6819999999999998e-06 2024-09-11T06:17:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720103+0000", 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2549999999999997e-06 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720145+0000", 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2169000000000002e-05 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720194+0000", 2024-09-11T06:17:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8971000000000003e-05 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720276+0000", 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1897999999999994e-05 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.721417+0000", 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011406459999999999 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.725050+0000", 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036332740000000001 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.725138+0000", 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7638000000000004e-05 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.725236+0000", 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8507999999999999e-05 2024-09-11T06:17:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2606 3.1f 3:fe2e2ee0:::rbd_data.116dc3b5629f.00000000000000e2:head [set-alloc-hint object_size 1048576 write_size 1048576,write 996415~52161] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.752931+0000", 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.016106846, 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051056979999999997, 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2606 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752931+0000", 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752931+0000", 2024-09-11T06:17:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752932+0000", 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752969+0000", 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7326999999999997e-05 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752978+0000", 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7059999999999993e-06 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752987+0000", 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7520000000000002e-06 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.753033+0000", 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5945999999999997e-05 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.753083+0000", 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9956000000000001e-05 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.753171+0000", 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7925999999999998e-05 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.753970+0000", 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00079896299999999997 2024-09-11T06:17:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.757944+0000", 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039741059999999998 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.757997+0000", 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2689999999999999e-05 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.758037+0000", 2024-09-11T06:17:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0435999999999997e-05 2024-09-11T06:17:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:20.872 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:20.873 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:20.874 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:20.872+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:20.974 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:20.974+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:21.018 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:21.018 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:21.018 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:21.018 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:21.027 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:21.075 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:21.074+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:17:21.134 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:21.135 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:21.135 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:21.135 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:21.135 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:21.144 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:21.187 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:21.187+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:21.248 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:21.248 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:21.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:13 3.b e27/24 3:d5a55ce5:::rbd_object_map.116d6cc70d0:head v 27'1, mlcod=0'0)", 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:11.706468+0000", 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5400561079999999, 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028050979999999998, 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706468+0000", 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706468+0000", 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706468+0000", 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:17:21.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706475+0000", 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2530000000000001e-06 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706495+0000", 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0723000000000001e-05 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706508+0000", 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.272e-05 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706578+0000", 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9777000000000006e-05 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706602+0000", 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3887999999999999e-05 2024-09-11T06:17:21.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.709225+0000", 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026230329999999999 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.709273+0000", 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8374000000000001e-05 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:148 3.18 e30/24 3:184d3c88:::rbd_object_map.116dc3b5629f:head v 30'1, mlcod=0'0)", 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.739820+0000", 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.5067040179999998, 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033473370000000001, 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739820+0000", 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739820+0000", 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739820+0000", 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739825+0000", 2024-09-11T06:17:21.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1949999999999996e-06 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739834+0000", 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8300000000000008e-06 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739841+0000", 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4819999999999999e-06 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739895+0000", 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3927000000000001e-05 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739911+0000", 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5900999999999999e-05 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743125+0000", 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032140929999999999 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743167+0000", 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2658999999999999e-05 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:229 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 786432~22602 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.721757+0000", 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5247669860000004, 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003627332, 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.258 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 229 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721757+0000", 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721757+0000", 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721758+0000", 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0979999999999999e-06 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721762+0000", 2024-09-11T06:17:21.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8700000000000002e-06 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721772+0000", 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8160000000000005e-06 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721785+0000", 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2918000000000001e-05 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722776+0000", 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099127500000000001 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722872+0000", 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5483999999999996e-05 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725384+0000", 2024-09-11T06:17:21.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025128709999999999 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:232 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 131072~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.721957+0000", 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.524567298, 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003712698, 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:21.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 232 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721957+0000", 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721957+0000", 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721958+0000", 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721962+0000", 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0609999999999997e-06 2024-09-11T06:17:21.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721972+0000", 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.781e-06 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721978+0000", 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3579999999999999e-06 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725436+0000", 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034582039999999999 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725546+0000", 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109746 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725670+0000", 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012361300000000001 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.267 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:233 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [read 917504~40157 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5245283619999999, 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065151039999999999, 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 233 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6499999999999999e-07 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722000+0000", 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0740000000000001e-06 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722007+0000", 2024-09-11T06:17:21.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.712e-06 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722012+0000", 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2410000000000003e-06 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725710+0000", 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036971550000000001 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725811+0000", 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101788 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728511+0000", 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026994689999999999 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:236 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 262144~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:21.272 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.524499101, 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067599590000000003, 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 236 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:21.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.27e-07 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722029+0000", 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2320000000000001e-06 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722040+0000", 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0842999999999999e-05 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722044+0000", 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728568+0000", 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065239929999999996 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728647+0000", 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8856999999999994e-05 2024-09-11T06:17:21.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728785+0000", 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013785800000000001 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:240 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 393216~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.524276457, 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006743181, 2024-09-11T06:17:21.277 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 240 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5499999999999997e-07 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722252+0000", 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.065e-06 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722261+0000", 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2519999999999999e-06 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722265+0000", 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4279999999999998e-06 2024-09-11T06:17:21.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728816+0000", 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065505650000000004 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728886+0000", 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9986000000000004e-05 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728991+0000", 2024-09-11T06:17:21.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010513 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:245 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 524288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5240575490000001, 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066994699999999999, 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 245 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722468+0000", 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722471+0000", 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.123e-06 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722477+0000", 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7819999999999996e-06 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722493+0000", 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5034999999999999e-05 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729030+0000", 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006537434 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729085+0000", 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5232999999999998e-05 2024-09-11T06:17:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729166+0000", 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0876000000000003e-05 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:249 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 655360~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5237603360000005, 2024-09-11T06:17:21.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065545639999999997, 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 249 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722765+0000", 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2500000000000001e-06 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722770+0000", 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1490000000000002e-06 2024-09-11T06:17:21.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722784+0000", 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3694e-05 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722792+0000", 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2290000000000003e-06 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729196+0000", 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0064038560000000003 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729246+0000", 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0226000000000003e-05 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729318+0000", 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.216e-05 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.290 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:284 3.18 e31/24 3:1a9bf857:::rbd_data.116dc3b5629f.000000000000003c:head v 31'3, mlcod=30'1)", 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.733236+0000", 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5132884039999999, 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035805099999999999, 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733236+0000", 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733236+0000", 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733236+0000", 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0299999999999999e-07 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733251+0000", 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5221999999999999e-05 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733258+0000", 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733263+0000", 2024-09-11T06:17:21.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4100000000000001e-06 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733318+0000", 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.465e-05 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733333+0000", 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5173e-05 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.736780+0000", 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003446873 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.736816+0000", 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643999999999997e-05 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.295 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:497 3.12 3:4febd602:::rbd_data.116dc3b5629f.0000000000000047:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.893161+0000", 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3533632749999995, 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034896329999999998, 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 497 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893161+0000", 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893161+0000", 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893162+0000", 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2950000000000001e-06 2024-09-11T06:17:21.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893166+0000", 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5820000000000002e-06 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893175+0000", 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6059999999999992e-06 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893182+0000", 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.55e-06 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893239+0000", 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7457000000000002e-05 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893345+0000", 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010563799999999999 2024-09-11T06:17:21.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.896650+0000", 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033055049999999998 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:498 3.1 3:871c60c0:::rbd_data.116dc3b5629f.0000000000000048:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.893198+0000", 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3533260919999996, 2024-09-11T06:17:21.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034495559999999999, 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 498 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893198+0000", 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893198+0000", 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893199+0000", 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7800000000000001e-07 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893201+0000", 2024-09-11T06:17:21.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.712e-06 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893209+0000", 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0860000000000002e-06 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893217+0000", 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8259999999999993e-06 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893279+0000", 2024-09-11T06:17:21.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1746000000000001e-05 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893355+0000", 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5950000000000003e-05 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893462+0000", 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107476 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894320+0000", 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085771299999999997 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.896555+0000", 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022347930000000001 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.896604+0000", 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9372000000000001e-05 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.896648+0000", 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3303999999999997e-05 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.15 epoch 32/24 rep_tid 34 entries 32'2 (0'0) error 3:aab7007a:::rbd_data.116dc3b5629f.0000000000000049:head by client.4461.0:499 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.893988+0000", 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3525356449999997, 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039848649999999998, 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:21.306 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893988+0000", 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893988+0000", 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893989+0000", 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5899999999999995e-07 2024-09-11T06:17:21.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893997+0000", 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9109999999999993e-06 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894014+0000", 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7337e-05 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894028+0000", 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3200999999999999e-05 2024-09-11T06:17:21.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894115+0000", 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6881999999999999e-05 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897973+0000", 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038587750000000001 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.15 epoch 32/24 rep_tid 35 entries 32'3 (0'0) error 3:ad1ccdb6:::rbd_data.116dc3b5629f.000000000000004b:head by client.4461.0:501 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.894405+0000", 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3521188689999999, 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003582591, 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894405+0000", 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894405+0000", 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894406+0000", 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8400000000000004e-07 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894413+0000", 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1300000000000003e-06 2024-09-11T06:17:21.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894432+0000", 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9320000000000001e-05 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894446+0000", 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3540000000000001e-05 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894517+0000", 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1454999999999999e-05 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897988+0000", 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003470562 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.313 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2415 3.12 3:48a1cb4c:::rbd_data.116dc3b5629f.0000000000000068:head [set-alloc-hint object_size 1048576 write_size 1048576,write 765087~21345] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.468387+0000", 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.7781375779999999, 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046644640000000001, 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2415 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468387+0000", 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468387+0000", 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468388+0000", 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.142e-06 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468403+0000", 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5705e-05 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468412+0000", 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7579999999999998e-06 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468417+0000", 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9060000000000001e-06 2024-09-11T06:17:21.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468461+0000", 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3925999999999999e-05 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468510+0000", 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9366000000000001e-05 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:21.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468596+0000", 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5520999999999997e-05 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.469595+0000", 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099875000000000007 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.472979+0000", 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00338427 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.473017+0000", 2024-09-11T06:17:21.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8146999999999999e-05 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.473051+0000", 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3973000000000002e-05 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2522 3.18 e33/24 3:184d3c88:::rbd_object_map.116dc3b5629f:head v 33'501, mlcod=33'498)", 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.632535+0000", 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.61398961, 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002821793, 2024-09-11T06:17:21.319 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.632535+0000", 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.632535+0000", 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.632535+0000", 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.82e-07 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.632539+0000", 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4129999999999999e-06 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.632547+0000", 2024-09-11T06:17:21.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.627e-06 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.632551+0000", 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2610000000000004e-06 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.632596+0000", 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4929999999999998e-05 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.632616+0000", 2024-09-11T06:17:21.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9925999999999999e-05 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.635326+0000", 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027102630000000001 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.635356+0000", 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9890999999999999e-05 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2530 3.12 3:4ace6d73:::rbd_data.116dc3b5629f.00000000000000dd:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.645993+0000", 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.6005310150000001, 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002840441, 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.324 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2530 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.645993+0000", 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.645993+0000", 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.645994+0000", 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1200000000000001e-06 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.645999+0000", 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3780000000000003e-06 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646008+0000", 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9230000000000008e-06 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646020+0000", 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.22e-05 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646065+0000", 2024-09-11T06:17:21.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5068000000000003e-05 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646115+0000", 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0385e-05 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646272+0000", 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015728199999999999 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.647250+0000", 2024-09-11T06:17:21.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00097773099999999991 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.648682+0000", 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014319980000000001 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.648767+0000", 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5078000000000001e-05 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.648834+0000", 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6278000000000005e-05 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2538 3.7 e33/24 3:e626f76b:::rbd_data.116dc3b5629f.00000000000000ae:head v 33'10, mlcod=33'8)", 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.662228+0000", 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.584296428, 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045536020000000003, 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.330 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662228+0000", 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662228+0000", 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662228+0000", 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4199999999999995e-07 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662234+0000", 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5559999999999998e-06 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662249+0000", 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4797000000000001e-05 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662256+0000", 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9099999999999999e-06 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662361+0000", 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010509999999999999 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662382+0000", 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1002e-05 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666740+0000", 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00435856 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666781+0000", 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0935e-05 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2542 3.b e33/24 3:d244c7ed:::rbd_data.116dc3b5629f.00000000000000be:head v 33'43, mlcod=33'41)", 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.662297+0000", 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.5842271110000001, 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045043899999999996, 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662297+0000", 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662297+0000", 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662298+0000", 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3699999999999999e-07 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662304+0000", 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1809999999999998e-06 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662314+0000", 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0121e-05 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662321+0000", 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662388+0000", 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6081000000000006e-05 2024-09-11T06:17:21.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662409+0000", 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1761000000000001e-05 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666761+0000", 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004351181 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666801+0000", 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0908999999999997e-05 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.338 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2545 3.12 3:4ace6d73:::rbd_data.116dc3b5629f.00000000000000dd:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.663237+0000", 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.5832874320000001, 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036391050000000001, 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2545 2024-09-11T06:17:21.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663237+0000", 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663237+0000", 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663238+0000", 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1200000000000001e-06 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663242+0000", 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6650000000000002e-06 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663255+0000", 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2843000000000001e-05 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663263+0000", 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4930000000000001e-06 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663307+0000", 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4549999999999999e-05 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663361+0000", 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3504999999999997e-05 2024-09-11T06:17:21.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663423+0000", 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1799999999999998e-05 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.664237+0000", 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081436500000000005 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666790+0000", 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002552894 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666836+0000", 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5695999999999998e-05 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666876+0000", 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0173999999999999e-05 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:21.344 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:21.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:21.346 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:21.345+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:21.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:21.446 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:21.445+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:21.486 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:21.487 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:21.489 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:21.489 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:21.489 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:21.489 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:21.498 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:21.503 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:21.503 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:21.519 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:21.535 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:21.546 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:21.546+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:21.552 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:21.552 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:21.568 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:21.569 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:21.585 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:21.585 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:21.601 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:21.602 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:21.602 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:21.611 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:21.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:21.655+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:21.715 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:21.715 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:21.724 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:21.729 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T06:17:21.730 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:17:21.730 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T06:17:21.730 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.693256 2024-09-11T06:17:21.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.6932561551283167 2024-09-11T06:17:21.768 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:21.767+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:21.830 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:21.831 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:21.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:21.885 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:21.884+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:21.947 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:21.948 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:21.950 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:21.949+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:21.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:22.050 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:22.050+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:22.095 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.1 primary-affinity to 0.693256 (8454332) 2024-09-11T06:17:22.105 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:22.105 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:22.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:22.152 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:22.151+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:22.253 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:22.252+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:22.263 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:22.263 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:22.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:22.353 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:22.352+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:22.374 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:22.374 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:22.383 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:22.454 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:22.453+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:22.487 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:22.487 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:22.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:22.555 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:22.554+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:22.641 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:22.641 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:22.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:22.655 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:22.655+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:22.751 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:22.751 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:22.757 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:22.756+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:22.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:22.857 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:22.857+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:22.902 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:22.902 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:22.910 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:22.958 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:22.957+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:23.014 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:23.014 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:23.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:23.067 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:23.066+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:23.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:17:23.138 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:23.138 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:23.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:23.160 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:23.160+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:23.261 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:23.260+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:23.325 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:23.325 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:23.334 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:23.378 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:23.378+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:23.442 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:23.442 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:23.450 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:23.462 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:23.461+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:23.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:23.562+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:23.594 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:23.594 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:23.602 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:23.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:23.664 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:23.663+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:23.732 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:23.745 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:23.745 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:23.748 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:23.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:23.765 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:23.765 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:23.764+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:23.780 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:23.781 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:23.797 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:23.797 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:23.817 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:23.817 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:23.831 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:23.831 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:23.848 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:23.848 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:23.859 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:23.860 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:23.860 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:23.860 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:23.866 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:23.865+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:23.868 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:23.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:23.967+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:24.013 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:24.014 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:24.025 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:24.068 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:24.067+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:24.108 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:17:24.168 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:24.167+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:33 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'19, mlcod=17'14)", 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:53.526781+0000", 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.645469238, 2024-09-11T06:17:24.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005095235, 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526781+0000", 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526781+0000", 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526782+0000", 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5799999999999999e-07 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526787+0000", 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.22e-06 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526795+0000", 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1599999999999998e-06 2024-09-11T06:17:24.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526800+0000", 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3499999999999999e-06 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526835+0000", 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5661999999999998e-05 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.526848+0000", 2024-09-11T06:17:24.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3108999999999999e-05 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.531832+0000", 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049840459999999998 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.531877+0000", 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4129999999999999e-05 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:37 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'23, mlcod=17'16)", 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:53.528772+0000", 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.643478098999999, 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0059884949999999999, 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528772+0000", 2024-09-11T06:17:24.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528772+0000", 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528773+0000", 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3099999999999997e-07 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528778+0000", 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6110000000000004e-06 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528787+0000", 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3980000000000005e-06 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528792+0000", 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3420000000000001e-06 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528833+0000", 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1020999999999999e-05 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.528853+0000", 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0384999999999999e-05 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.534715+0000", 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058618999999999997 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:53.534761+0000", 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6106999999999997e-05 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:144 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:54.217977+0000", 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.954273704999999, 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058944399999999999, 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.217977+0000", 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.217977+0000", 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.217977+0000", 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5700000000000002e-07 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218047+0000", 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9356000000000005e-05 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218054+0000", 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2320000000000004e-06 2024-09-11T06:17:24.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218058+0000", 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8199999999999998e-06 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218095+0000", 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6993000000000003e-05 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218105+0000", 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0394000000000001e-05 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.223836+0000", 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0057310429999999999 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.223871+0000", 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5045000000000001e-05 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:145 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'103, mlcod=17'98)", 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:54.218362+0000", 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.953888586000001, 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055288050000000004, 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218362+0000", 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218362+0000", 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218362+0000", 2024-09-11T06:17:24.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0299999999999999e-07 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218422+0000", 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9633000000000003e-05 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218429+0000", 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6599999999999998e-06 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218432+0000", 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3730000000000001e-06 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218467+0000", 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5156e-05 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.218480+0000", 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2897e-05 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.223874+0000", 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053935490000000001 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.223891+0000", 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7034e-05 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.192 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4181.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'108)", 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:16:54.678648+0000", 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.493602391, 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053931689999999997, 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678648+0000", 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678648+0000", 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678649+0000", 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4899999999999995e-07 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678706+0000", 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7246e-05 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678714+0000", 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.554e-06 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678718+0000", 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2599999999999999e-06 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678753+0000", 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5661000000000003e-05 2024-09-11T06:17:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.678765+0000", 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1918e-05 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.683997+0000", 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052316410000000004 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:16:54.684041+0000", 2024-09-11T06:17:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4339999999999999e-05 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:11.697150+0000", 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.475100763, 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048607479999999998, 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 11 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697150+0000", 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697150+0000", 2024-09-11T06:17:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697152+0000", 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.95e-06 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697158+0000", 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.195e-06 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697170+0000", 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2473999999999999e-05 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697177+0000", 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2550000000000003e-06 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697227+0000", 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0002e-05 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697330+0000", 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103275 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.697474+0000", 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014447200000000001 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.698740+0000", 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001265391 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.701916+0000", 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031762040000000002 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.701966+0000", 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9830000000000002e-05 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.702011+0000", 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000002e-05 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:148 3.18 3:184d3c88:::rbd_object_map.116dc3b5629f:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.737801+0000", 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4344495530000003, 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005520367, 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 148 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737801+0000", 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737801+0000", 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737802+0000", 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.463e-06 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737810+0000", 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8509999999999999e-06 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737825+0000", 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4963000000000001e-05 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737833+0000", 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4189999999999996e-06 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737887+0000", 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4008999999999997e-05 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.737891+0000", 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0210000000000001e-06 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739232+0000", 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001340918 2024-09-11T06:17:24.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739305+0000", 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3786000000000001e-05 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739405+0000", 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100047 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743075+0000", 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003669945 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743265+0000", 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00018956800000000001 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743295+0000", 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0190000000000001e-05 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743321+0000", 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6186999999999998e-05 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:227 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'6, mlcod=27'2)", 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.723195+0000", 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.4490552080000008, 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052394720000000002, 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.210 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723195+0000", 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723195+0000", 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723196+0000", 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723202+0000", 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4990000000000002e-06 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723212+0000", 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0097e-05 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723217+0000", 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4210000000000003e-06 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723275+0000", 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7568000000000002e-05 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.723291+0000", 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6405999999999998e-05 2024-09-11T06:17:24.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728385+0000", 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0050933030000000004 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728435+0000", 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0179000000000002e-05 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:258 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'8, mlcod=31'3)", 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.725935+0000", 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.4463159930000007, 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056757220000000002, 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725935+0000", 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725935+0000", 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725935+0000", 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725947+0000", 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1282e-05 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725957+0000", 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0638e-05 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725963+0000", 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726007+0000", 2024-09-11T06:17:24.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3893000000000001e-05 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726022+0000", 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4766000000000001e-05 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731581+0000", 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055591420000000004 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731610+0000", 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9411999999999999e-05 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:259 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'9, mlcod=31'3)", 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.726445+0000", 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.4458059559999992, 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051931060000000003, 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.219 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726445+0000", 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726445+0000", 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726445+0000", 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0599999999999999e-07 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726451+0000", 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1460000000000004e-06 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726459+0000", 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9060000000000002e-06 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726463+0000", 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6410000000000001e-06 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726498+0000", 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4419999999999999e-05 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726510+0000", 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2531000000000001e-05 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731613+0000", 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051031770000000004 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731638+0000", 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4379000000000002e-05 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:274 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'14, mlcod=31'6)", 2024-09-11T06:17:24.223 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.731653+0000", 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.4405975770000001, 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053908619999999997, 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731653+0000", 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731653+0000", 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731654+0000", 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7400000000000003e-07 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731660+0000", 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2500000000000003e-06 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731673+0000", 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2908000000000001e-05 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731686+0000", 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2918000000000001e-05 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731824+0000", 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000137949 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731838+0000", 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4491000000000001e-05 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737004+0000", 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051662770000000004 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.737044+0000", 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9394999999999998e-05 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:374 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'28, mlcod=31'23)", 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.744392+0000", 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.4278589559999997, 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005265835, 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744392+0000", 2024-09-11T06:17:24.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744392+0000", 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744392+0000", 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5999999999999999e-07 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744396+0000", 2024-09-11T06:17:24.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4309999999999996e-06 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744403+0000", 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7870000000000004e-06 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744408+0000", 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2540000000000003e-06 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744450+0000", 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2534000000000003e-05 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744464+0000", 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4242e-05 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749619+0000", 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051547119999999997 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749657+0000", 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8414999999999997e-05 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:384 3.10 e31/24 3:0c6bf9fb:::rbd_data.116dc3b5629f.000000000000006c:head v 31'4, mlcod=28'2)", 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.744543+0000", 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.4277073510000005, 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051536359999999996, 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744543+0000", 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744543+0000", 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744544+0000", 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744667+0000", 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012360100000000001 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744675+0000", 2024-09-11T06:17:24.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2470000000000008e-06 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744682+0000", 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2489999999999998e-06 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744756+0000", 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3811000000000002e-05 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744781+0000", 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5579999999999999e-05 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749662+0000", 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048805790000000003 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749697+0000", 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5119e-05 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.236 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:375 3.1a e31/24 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head v 31'29, mlcod=31'23)", 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.744715+0000", 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.4275356460000008, 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049787579999999998, 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744715+0000", 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744715+0000", 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744715+0000", 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000002e-07 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744720+0000", 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1640000000000003e-06 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744729+0000", 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1209999999999996e-06 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744734+0000", 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3619999999999997e-06 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744827+0000", 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2936000000000006e-05 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.744847+0000", 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9607999999999999e-05 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749660+0000", 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004813927 2024-09-11T06:17:24.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.749694+0000", 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3192999999999999e-05 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:447 3.18 3:184d3c88:::rbd_object_map.116dc3b5629f:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.719312+0000", 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.4529385140000004, 2024-09-11T06:17:24.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0070999740000000002, 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 447 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719312+0000", 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719312+0000", 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719313+0000", 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.395e-06 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719319+0000", 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.361e-06 2024-09-11T06:17:24.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719330+0000", 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1454000000000001e-05 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719338+0000", 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6040000000000004e-06 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719397+0000", 2024-09-11T06:17:24.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9394000000000001e-05 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.719405+0000", 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0690000000000002e-06 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.720957+0000", 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001551738 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.721073+0000", 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011555799999999999 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.721241+0000", 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016852300000000001 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.722148+0000", 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00090736400000000002 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.726319+0000", 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004170221 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.726372+0000", 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2862999999999999e-05 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.726412+0000", 2024-09-11T06:17:24.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0429999999999997e-05 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2451 3.18 3:1f17666a:::rbd_data.116dc3b5629f.0000000000000020:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6569268600000004, 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012096045, 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2451 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515329+0000", 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1330000000000001e-06 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515339+0000", 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8989999999999996e-06 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515344+0000", 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515378+0000", 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3519999999999998e-05 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515423+0000", 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5221e-05 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.517881+0000", 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024577269999999998 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527239+0000", 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093582379999999996 2024-09-11T06:17:24.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527297+0000", 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7481000000000001e-05 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527352+0000", 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5145000000000001e-05 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527420+0000", 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8062e-05 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop_reply(client.4461.0:2451 3.18 e33/24 ondisk, result = 0)", 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.522099+0000", 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6501512099999998, 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053272299999999996, 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.254 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522099+0000", 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522099+0000", 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522100+0000", 2024-09-11T06:17:24.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2500000000000004e-07 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522103+0000", 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2569999999999999e-06 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522114+0000", 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1032999999999999e-05 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.522121+0000", 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8940000000000004e-06 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527281+0000", 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051597350000000004 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527290+0000", 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9449999999999999e-06 2024-09-11T06:17:24.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527427+0000", 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013654100000000001 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2577 3.1f 3:fcb81ce6:::rbd_data.116dc3b5629f.00000000000000c3:head [set-alloc-hint object_size 1048576 write_size 1048576,write 732949~53483] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.720025+0000", 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4522254940000003, 2024-09-11T06:17:24.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052113009999999998, 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2577 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720025+0000", 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720025+0000", 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720029+0000", 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7720000000000001e-06 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720088+0000", 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9487999999999997e-05 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720098+0000", 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6819999999999998e-06 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720103+0000", 2024-09-11T06:17:24.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2549999999999997e-06 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720145+0000", 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2169000000000002e-05 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720194+0000", 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8971000000000003e-05 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.720276+0000", 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1897999999999994e-05 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.721417+0000", 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011406459999999999 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.725050+0000", 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036332740000000001 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.725138+0000", 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7638000000000004e-05 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.725236+0000", 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8507999999999999e-05 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2606 3.1f 3:fe2e2ee0:::rbd_data.116dc3b5629f.00000000000000e2:head [set-alloc-hint object_size 1048576 write_size 1048576,write 996415~52161] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.752931+0000", 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.4193192669999997, 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051056979999999997, 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2606 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752931+0000", 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752931+0000", 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752932+0000", 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752969+0000", 2024-09-11T06:17:24.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7326999999999997e-05 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752978+0000", 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7059999999999993e-06 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.752987+0000", 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7520000000000002e-06 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.753033+0000", 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5945999999999997e-05 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.753083+0000", 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9956000000000001e-05 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.753171+0000", 2024-09-11T06:17:24.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7925999999999998e-05 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.753970+0000", 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00079896299999999997 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.757944+0000", 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039741059999999998 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.757997+0000", 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2689999999999999e-05 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.758037+0000", 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0435999999999997e-05 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2744 3.18 3:184d3c88:::rbd_object_map.116dc3b5629f:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:21.101410+0000", 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.0708409539999999, 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054548369999999997, 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2744 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101410+0000", 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101410+0000", 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101410+0000", 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9199999999999999e-07 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101415+0000", 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2010000000000001e-06 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101423+0000", 2024-09-11T06:17:24.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5199999999999997e-06 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101428+0000", 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2510000000000002e-06 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101476+0000", 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101561+0000", 2024-09-11T06:17:24.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5101999999999999e-05 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101812+0000", 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025087800000000001 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.103704+0000", 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018920320000000001 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.106797+0000", 2024-09-11T06:17:24.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0030931890000000001 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.106835+0000", 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7758e-05 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.106864+0000", 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9374999999999999e-05 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.278 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.278 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:24.278 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-11T06:17:24.279 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:24.280 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:24.278+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:24.380 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:24.379+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:24.421 INFO:teuthology.orchestra.run.smithi070.stdout:953 punch from 0x155472a to 0x1560ea3, (0xc779 bytes) 2024-09-11T06:17:24.425 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:24.425 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:24.425 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:24.425 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:24.426 INFO:teuthology.orchestra.run.smithi070.stdout:956 read 0x2e9d6a0 thru 0x2e9ee64 (0x17c5 bytes) 2024-09-11T06:17:24.426 INFO:teuthology.orchestra.run.smithi070.stdout:958 writesame 0x33b3890 thru 0x33b50bf data_size 0x30(0x1830 bytes) 2024-09-11T06:17:24.428 INFO:teuthology.orchestra.run.smithi070.stdout:960 write 0x2adb1b3 thru 0x2ae56bb (0xa509 bytes) 2024-09-11T06:17:24.430 INFO:teuthology.orchestra.run.smithi070.stdout:961 writesame 0x379249 thru 0x37bf60 data_size 0x4e(0x2d18 bytes) 2024-09-11T06:17:24.431 INFO:teuthology.orchestra.run.smithi070.stdout:962 punch from 0x426dda9 to 0x426dede, (0x135 bytes) 2024-09-11T06:17:24.431 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.431 INFO:teuthology.orchestra.run.smithi070.stdout:965 punch from 0x195e247 to 0x196b862, (0xd61b bytes) 2024-09-11T06:17:24.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:24.446 INFO:teuthology.orchestra.run.smithi070.stdout:967 write 0xbe9b462 thru 0xbea9987 (0xe526 bytes) 2024-09-11T06:17:24.449 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.449 INFO:teuthology.orchestra.run.smithi070.stdout:972 read 0x3ca3e6a thru 0x3ca52f4 (0x148b bytes) 2024-09-11T06:17:24.449 INFO:teuthology.orchestra.run.smithi070.stdout:974 read 0x527a79c thru 0x5282b1e (0x8383 bytes) 2024-09-11T06:17:24.449 INFO:teuthology.orchestra.run.smithi070.stdout:975 write 0x4f74ea0 thru 0x4f7a048 (0x51a9 bytes) 2024-09-11T06:17:24.451 INFO:teuthology.orchestra.run.smithi070.stdout:976 read 0x47d325f thru 0x47df66f (0xc411 bytes) 2024-09-11T06:17:24.451 INFO:teuthology.orchestra.run.smithi070.stdout:980 read 0x612fce5 thru 0x61342cd (0x45e9 bytes) 2024-09-11T06:17:24.453 INFO:teuthology.orchestra.run.smithi070.stdout:981 trunc from 0xbea9988 to 0xd3227ed 2024-09-11T06:17:24.474 INFO:teuthology.orchestra.run.smithi070.stdout:983 trunc from 0xd3227ed to 0xe0cf29 2024-09-11T06:17:24.481 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:24.480+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:24.497 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.497 INFO:teuthology.orchestra.run.smithi070.stdout:985 read 0xa61c7 thru 0xab326 (0x5160 bytes) 2024-09-11T06:17:24.515 INFO:teuthology.orchestra.run.smithi070.stdout:986 write 0xa93c39b thru 0xa945131 (0x8d97 bytes) 2024-09-11T06:17:24.518 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.518 INFO:teuthology.orchestra.run.smithi070.stdout:988 read 0xc540b3 thru 0xc5c174 (0x80c2 bytes) 2024-09-11T06:17:24.518 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.518 INFO:teuthology.orchestra.run.smithi070.stdout:990 write 0x4f6a332 thru 0x4f6d6ca (0x3399 bytes) 2024-09-11T06:17:24.521 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.529 INFO:teuthology.orchestra.run.smithi070.stdout:992 writesame 0xc51ecce thru 0xc52b4e8 data_size 0x1(0xc81b bytes) 2024-09-11T06:17:24.542 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:24.542 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:24.542 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:24.543 INFO:teuthology.orchestra.run.smithi070.stdout:993 trunc from 0xc52b4e9 to 0x214f357 2024-09-11T06:17:24.552 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:24.553 INFO:teuthology.orchestra.run.smithi070.stdout:994 punch from 0x1512a93 to 0x1521e1e, (0xf38b bytes) 2024-09-11T06:17:24.553 INFO:teuthology.orchestra.run.smithi070.stdout:996 punch from 0x183a307 to 0x183f1cb, (0x4ec4 bytes) 2024-09-11T06:17:24.553 INFO:teuthology.orchestra.run.smithi070.stdout:997 read 0x136f29d thru 0x1373260 (0x3fc4 bytes) 2024-09-11T06:17:24.554 INFO:teuthology.orchestra.run.smithi070.stdout:999 punch from 0x760cdf to 0x76aec7, (0xa1e8 bytes) 2024-09-11T06:17:24.554 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.554 INFO:teuthology.orchestra.run.smithi070.stdout:1001 read 0x1cc46f thru 0x1cdec8 (0x1a5a bytes) 2024-09-11T06:17:24.569 INFO:teuthology.orchestra.run.smithi070.stdout:1002 write 0xb5e4356 thru 0xb5ed7df (0x948a bytes) 2024-09-11T06:17:24.571 INFO:teuthology.orchestra.run.smithi070.stdout:1003 write 0x66b51da thru 0x66c0e4a (0xbc71 bytes) 2024-09-11T06:17:24.573 INFO:teuthology.orchestra.run.smithi070.stdout:1004 write 0x379dd93 thru 0x37ad329 (0xf597 bytes) 2024-09-11T06:17:24.583 INFO:teuthology.orchestra.run.smithi070.stdout:1006 write 0xc19ee33 thru 0xc1a9373 (0xa541 bytes) 2024-09-11T06:17:24.584 INFO:teuthology.orchestra.run.smithi070.stdout:1007 read 0x4e7c539 thru 0x4e892cf (0xcd97 bytes) 2024-09-11T06:17:24.585 INFO:teuthology.orchestra.run.smithi070.stdout:1008 writesame 0x128b7fb thru 0x1298843 data_size 0x1(0xd049 bytes) 2024-09-11T06:17:24.597 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:24.597+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:24.610 INFO:teuthology.orchestra.run.smithi070.stdout:1009 read 0x9ae93c6 thru 0x9af3845 (0xa480 bytes) 2024-09-11T06:17:24.610 INFO:teuthology.orchestra.run.smithi070.stdout:1010 write 0xbd3d11e thru 0xbd4c3fb (0xf2de bytes) 2024-09-11T06:17:24.612 INFO:teuthology.orchestra.run.smithi070.stdout:1012 writesame 0x2b976d2 thru 0x2b9d536 data_size 0x1b(0x5e65 bytes) 2024-09-11T06:17:24.613 INFO:teuthology.orchestra.run.smithi070.stdout:1014 read 0x78f4ef7 thru 0x78fed42 (0x9e4c bytes) 2024-09-11T06:17:24.623 INFO:teuthology.orchestra.run.smithi070.stdout:1015 write 0xedf8d81 thru 0xedfe617 (0x5897 bytes) 2024-09-11T06:17:24.626 INFO:teuthology.orchestra.run.smithi070.stdout:1016 read 0x39a9352 thru 0x39a9f56 (0xc05 bytes) 2024-09-11T06:17:24.626 INFO:teuthology.orchestra.run.smithi070.stdout:1017 read 0xd8f9af3 thru 0xd90202f (0x853d bytes) 2024-09-11T06:17:24.627 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.627 INFO:teuthology.orchestra.run.smithi070.stdout:1020 read 0x22e944c thru 0x22f4a54 (0xb609 bytes) 2024-09-11T06:17:24.627 INFO:teuthology.orchestra.run.smithi070.stdout:1022 read 0x3b6299c thru 0x3b62d09 (0x36e bytes) 2024-09-11T06:17:24.627 INFO:teuthology.orchestra.run.smithi070.stdout:1024 punch from 0x1eb2666 to 0x1ebd7bb, (0xb155 bytes) 2024-09-11T06:17:24.644 INFO:teuthology.orchestra.run.smithi070.stdout:1026 trunc from 0xedfe618 to 0xb6500 2024-09-11T06:17:24.662 INFO:teuthology.orchestra.run.smithi070.stdout:1027 read 0x9aead thru 0xaa164 (0xf2b8 bytes) 2024-09-11T06:17:24.662 INFO:teuthology.orchestra.run.smithi070.stdout:1028 read 0x495c2 thru 0x57fb4 (0xe9f3 bytes) 2024-09-11T06:17:24.663 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:148 3.18 e30/24 3:184d3c88:::rbd_object_map.116dc3b5629f:head v 30'1, mlcod=0'0)", 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:14.739820+0000", 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9236198039999994, 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033473370000000001, 2024-09-11T06:17:24.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739820+0000", 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739820+0000", 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739820+0000", 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739825+0000", 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1949999999999996e-06 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739834+0000", 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8300000000000008e-06 2024-09-11T06:17:24.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739841+0000", 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4819999999999999e-06 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739895+0000", 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3927000000000001e-05 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.739911+0000", 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5900999999999999e-05 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743125+0000", 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032140929999999999 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:14.743167+0000", 2024-09-11T06:17:24.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2658999999999999e-05 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:229 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 786432~22602 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.721757+0000", 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9416827720000001, 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003627332, 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 229 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721757+0000", 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721757+0000", 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721758+0000", 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0979999999999999e-06 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721762+0000", 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8700000000000002e-06 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721772+0000", 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8160000000000005e-06 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721785+0000", 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2918000000000001e-05 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722776+0000", 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099127500000000001 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722872+0000", 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5483999999999996e-05 2024-09-11T06:17:24.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725384+0000", 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0025128709999999999 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:232 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 131072~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.721957+0000", 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9414830839999997, 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003712698, 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.674 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 232 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721957+0000", 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721957+0000", 2024-09-11T06:17:24.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721958+0000", 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721962+0000", 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0609999999999997e-06 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721972+0000", 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.781e-06 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721978+0000", 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3579999999999999e-06 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725436+0000", 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034582039999999999 2024-09-11T06:17:24.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725546+0000", 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109746 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725670+0000", 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012361300000000001 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:233 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [read 917504~40157 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9414441480000004, 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065151039999999999, 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 233 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.679 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:24.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6499999999999999e-07 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722000+0000", 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0740000000000001e-06 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722007+0000", 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.712e-06 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722012+0000", 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2410000000000003e-06 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725710+0000", 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036971550000000001 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725811+0000", 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101788 2024-09-11T06:17:24.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728511+0000", 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026994689999999999 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:236 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 262144~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9414148870000005, 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067599590000000003, 2024-09-11T06:17:24.683 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 236 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.27e-07 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722029+0000", 2024-09-11T06:17:24.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2320000000000001e-06 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722040+0000", 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0842999999999999e-05 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722044+0000", 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728568+0000", 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065239929999999996 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728647+0000", 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8856999999999994e-05 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728785+0000", 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013785800000000001 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:240 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 393216~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9411922429999997, 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006743181, 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 240 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:24.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5499999999999997e-07 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722252+0000", 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.065e-06 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722261+0000", 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2519999999999999e-06 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722265+0000", 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4279999999999998e-06 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728816+0000", 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065505650000000004 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728886+0000", 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9986000000000004e-05 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728991+0000", 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010513 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:245 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 524288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9409733350000007, 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066994699999999999, 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.692 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 245 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722468+0000", 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722471+0000", 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.123e-06 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722477+0000", 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7819999999999996e-06 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722493+0000", 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5034999999999999e-05 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729030+0000", 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006537434 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729085+0000", 2024-09-11T06:17:24.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5232999999999998e-05 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729166+0000", 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0876000000000003e-05 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:249 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 655360~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9406761219999993, 2024-09-11T06:17:24.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065545639999999997, 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 249 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:24.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722765+0000", 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2500000000000001e-06 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722770+0000", 2024-09-11T06:17:24.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1490000000000002e-06 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722784+0000", 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3694e-05 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722792+0000", 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2290000000000003e-06 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729196+0000", 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0064038560000000003 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729246+0000", 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0226000000000003e-05 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729318+0000", 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.216e-05 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.700 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:284 3.18 e31/24 3:1a9bf857:::rbd_data.116dc3b5629f.000000000000003c:head v 31'3, mlcod=30'1)", 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.733236+0000", 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9302041899999995, 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0035805099999999999, 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733236+0000", 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733236+0000", 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733236+0000", 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0299999999999999e-07 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733251+0000", 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5221999999999999e-05 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733258+0000", 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733263+0000", 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4100000000000001e-06 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733318+0000", 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.465e-05 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.733333+0000", 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5173e-05 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.736780+0000", 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003446873 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.736816+0000", 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6643999999999997e-05 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:497 3.12 3:4febd602:::rbd_data.116dc3b5629f.0000000000000047:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.893161+0000", 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7702790610000001, 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034896329999999998, 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.705 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 497 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893161+0000", 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893161+0000", 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893162+0000", 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2950000000000001e-06 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893166+0000", 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5820000000000002e-06 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893175+0000", 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6059999999999992e-06 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893182+0000", 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.55e-06 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893239+0000", 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7457000000000002e-05 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893345+0000", 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010563799999999999 2024-09-11T06:17:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.896650+0000", 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0033055049999999998 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:498 3.1 3:871c60c0:::rbd_data.116dc3b5629f.0000000000000048:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.893198+0000", 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7702418780000002, 2024-09-11T06:17:24.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034495559999999999, 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 498 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893198+0000", 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893198+0000", 2024-09-11T06:17:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893199+0000", 2024-09-11T06:17:24.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7800000000000001e-07 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893201+0000", 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.712e-06 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893209+0000", 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0860000000000002e-06 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893217+0000", 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8259999999999993e-06 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893279+0000", 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1746000000000001e-05 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893355+0000", 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5950000000000003e-05 2024-09-11T06:17:24.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893462+0000", 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000107476 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894320+0000", 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085771299999999997 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.896555+0000", 2024-09-11T06:17:24.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022347930000000001 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.896604+0000", 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9372000000000001e-05 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.896648+0000", 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3303999999999997e-05 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.15 epoch 32/24 rep_tid 34 entries 32'2 (0'0) error 3:aab7007a:::rbd_data.116dc3b5629f.0000000000000049:head by client.4461.0:499 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.893988+0000", 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7694514310000002, 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039848649999999998, 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893988+0000", 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893988+0000", 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893989+0000", 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5899999999999995e-07 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.893997+0000", 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9109999999999993e-06 2024-09-11T06:17:24.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894014+0000", 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7337e-05 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894028+0000", 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3200999999999999e-05 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894115+0000", 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6881999999999999e-05 2024-09-11T06:17:24.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897973+0000", 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038587750000000001 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.15 epoch 32/24 rep_tid 35 entries 32'3 (0'0) error 3:ad1ccdb6:::rbd_data.116dc3b5629f.000000000000004b:head by client.4461.0:501 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.894405+0000", 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 7.7690346550000005, 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003582591, 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894405+0000", 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894405+0000", 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894406+0000", 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8400000000000004e-07 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894413+0000", 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1300000000000003e-06 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894432+0000", 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9320000000000001e-05 2024-09-11T06:17:24.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894446+0000", 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3540000000000001e-05 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894517+0000", 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1454999999999999e-05 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897988+0000", 2024-09-11T06:17:24.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003470562 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2415 3.12 3:48a1cb4c:::rbd_data.116dc3b5629f.0000000000000068:head [set-alloc-hint object_size 1048576 write_size 1048576,write 765087~21345] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.468387+0000", 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1950533639999996, 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046644640000000001, 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2415 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468387+0000", 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468387+0000", 2024-09-11T06:17:24.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468388+0000", 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.142e-06 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468403+0000", 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5705e-05 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468412+0000", 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7579999999999998e-06 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468417+0000", 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9060000000000001e-06 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468461+0000", 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3925999999999999e-05 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468510+0000", 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9366000000000001e-05 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.468596+0000", 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5520999999999997e-05 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.469595+0000", 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00099875000000000007 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.472979+0000", 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00338427 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.473017+0000", 2024-09-11T06:17:24.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8146999999999999e-05 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.473051+0000", 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3973000000000002e-05 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2530 3.12 3:4ace6d73:::rbd_data.116dc3b5629f.00000000000000dd:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.645993+0000", 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0174468010000002, 2024-09-11T06:17:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002840441, 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2530 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.645993+0000", 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.645993+0000", 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.645994+0000", 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1200000000000001e-06 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.645999+0000", 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3780000000000003e-06 2024-09-11T06:17:24.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646008+0000", 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9230000000000008e-06 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646020+0000", 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.22e-05 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646065+0000", 2024-09-11T06:17:24.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5068000000000003e-05 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646115+0000", 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0385e-05 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.646272+0000", 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015728199999999999 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.647250+0000", 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00097773099999999991 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.648682+0000", 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014319980000000001 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.648767+0000", 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5078000000000001e-05 2024-09-11T06:17:24.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.648834+0000", 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6278000000000005e-05 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2538 3.7 e33/24 3:e626f76b:::rbd_data.116dc3b5629f.00000000000000ae:head v 33'10, mlcod=33'8)", 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.662228+0000", 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0012122139999997, 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045536020000000003, 2024-09-11T06:17:24.735 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662228+0000", 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662228+0000", 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662228+0000", 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4199999999999995e-07 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662234+0000", 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5559999999999998e-06 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662249+0000", 2024-09-11T06:17:24.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4797000000000001e-05 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662256+0000", 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9099999999999999e-06 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662361+0000", 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010509999999999999 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662382+0000", 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1002e-05 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666740+0000", 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00435856 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666781+0000", 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0935e-05 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.739 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2542 3.b e33/24 3:d244c7ed:::rbd_data.116dc3b5629f.00000000000000be:head v 33'43, mlcod=33'41)", 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.662297+0000", 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0011428970000003, 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045043899999999996, 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662297+0000", 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662297+0000", 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662298+0000", 2024-09-11T06:17:24.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3699999999999999e-07 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662304+0000", 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1809999999999998e-06 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662314+0000", 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0121e-05 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662321+0000", 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662388+0000", 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6081000000000006e-05 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.662409+0000", 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1761000000000001e-05 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666761+0000", 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004351181 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666801+0000", 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0908999999999997e-05 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2545 3.12 3:4ace6d73:::rbd_data.116dc3b5629f.00000000000000dd:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.663237+0000", 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.0002032180000002, 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036391050000000001, 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2545 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.745 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663237+0000", 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663237+0000", 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663238+0000", 2024-09-11T06:17:24.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1200000000000001e-06 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663242+0000", 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6650000000000002e-06 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663255+0000", 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2843000000000001e-05 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663263+0000", 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4930000000000001e-06 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663307+0000", 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4549999999999999e-05 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663361+0000", 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3504999999999997e-05 2024-09-11T06:17:24.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.663423+0000", 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1799999999999998e-05 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.664237+0000", 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00081436500000000005 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666790+0000", 2024-09-11T06:17:24.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002552894 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666836+0000", 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5695999999999998e-05 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666876+0000", 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0173999999999999e-05 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2744 3.18 e35/24 3:184d3c88:::rbd_object_map.116dc3b5629f:head v 35'549, mlcod=33'547)", 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:21.101922+0000", 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.5615177280000001, 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047474919999999999, 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101922+0000", 2024-09-11T06:17:24.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101922+0000", 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101922+0000", 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-07 2024-09-11T06:17:24.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101928+0000", 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4639999999999997e-06 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101942+0000", 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4090999999999999e-05 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101951+0000", 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5930000000000006e-06 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.102011+0000", 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0136999999999997e-05 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.102033+0000", 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2711999999999999e-05 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.106640+0000", 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046063359999999999 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.106670+0000", 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9862999999999999e-05 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:3925 3.1 3:873edad6:::rbd_data.116d6cc70d0.0000000000000012:head [sparse-read 0~15742] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:24.227687+0000", 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.43575298299999998, 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028891339999999998, 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 3925 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.756 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.227687+0000", 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.227687+0000", 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:24.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.227687+0000", 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5300000000000004e-07 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.227694+0000", 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3620000000000002e-06 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.227704+0000", 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0227999999999999e-05 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.227710+0000", 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.19e-06 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.227772+0000", 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1630000000000005e-05 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.227777+0000", 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0000000000000004e-06 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.230147+0000", 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023700549999999998 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.230201+0000", 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3672999999999999e-05 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.230576+0000", 2024-09-11T06:17:24.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037544299999999999 2024-09-11T06:17:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:24.761 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:24.761 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:24.763 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:24.764 INFO:teuthology.orchestra.run.smithi070.stdout:1034 write 0x598d4fd thru 0x598dc18 (0x71c bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1035 read 0x20083 thru 0x2961a (0x9598 bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1037 punch from 0x299f17a to 0x29a68ec, (0x7772 bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1039 read 0x13ecca4 thru 0x13f9f96 (0xd2f3 bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1041 read 0x483f0c5 thru 0x48417a4 (0x26e0 bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1042 trunc from 0x598dc19 to 0xcbc1b27 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1043 read 0x1146df4 thru 0x1146fd0 (0x1dd bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1046 read 0x8983a95 thru 0x89865ad (0x2b19 bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1049 write 0xde33166 thru 0xde40c60 (0xdafb bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1050 trunc from 0xde40c61 to 0x60a7d84 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1051 write 0x2d921ab thru 0x2d9c3b9 (0xa20f bytes) 2024-09-11T06:17:24.765 INFO:teuthology.orchestra.run.smithi070.stdout:1052 trunc from 0x60a7d84 to 0xd99769a 2024-09-11T06:17:24.766 INFO:teuthology.orchestra.run.smithi070.stdout:1053 write 0xcfe06c2 thru 0xcfe2657 (0x1f96 bytes) 2024-09-11T06:17:24.766 INFO:teuthology.orchestra.run.smithi070.stdout:1054 write 0x5d24c1 thru 0x5dde26 (0xb966 bytes) 2024-09-11T06:17:24.766 INFO:teuthology.orchestra.run.smithi070.stdout:1055 trunc from 0xd99769a to 0x9e767a7 2024-09-11T06:17:24.766 INFO:teuthology.orchestra.run.smithi070.stdout:1056 read 0x14eb3da thru 0x14ec371 (0xf98 bytes) 2024-09-11T06:17:24.766 INFO:teuthology.orchestra.run.smithi070.stdout:1057 read 0x1b15b1a thru 0x1b15f4d (0x434 bytes) 2024-09-11T06:17:24.766 INFO:teuthology.orchestra.run.smithi070.stdout:1058 trunc from 0x9e767a7 to 0xb2b98c7 2024-09-11T06:17:24.766 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:24.761+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:24.766 INFO:teuthology.orchestra.run.smithi070.stdout:1059 write 0xf7c9cb thru 0xf8aafc (0xe132 bytes) 2024-09-11T06:17:24.775 INFO:teuthology.orchestra.run.smithi070.stdout:1060 trunc from 0xb2b98c7 to 0x29ef0b6 2024-09-11T06:17:24.786 INFO:teuthology.orchestra.run.smithi070.stdout:1061 read 0xc8467b thru 0xc89f08 (0x588e bytes) 2024-09-11T06:17:24.801 INFO:teuthology.orchestra.run.smithi070.stdout:1062 write 0xb029afd thru 0xb033946 (0x9e4a bytes) 2024-09-11T06:17:24.804 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.804 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.804 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.804 INFO:teuthology.orchestra.run.smithi070.stdout:1067 read 0x59ed195 thru 0x59f4678 (0x74e4 bytes) 2024-09-11T06:17:24.805 INFO:teuthology.orchestra.run.smithi070.stdout:1069 trunc from 0xb033947 to 0xb1e8689 2024-09-11T06:17:24.810 INFO:teuthology.orchestra.run.smithi070.stdout:1073 read 0x6d39fac thru 0x6d3fd0c (0x5d61 bytes) 2024-09-11T06:17:24.810 INFO:teuthology.orchestra.run.smithi070.stdout:1074 punch from 0x9e12cb6 to 0x9e19ed4, (0x721e bytes) 2024-09-11T06:17:24.810 INFO:teuthology.orchestra.run.smithi070.stdout:1075 read 0x36ab500 thru 0x36b9373 (0xde74 bytes) 2024-09-11T06:17:24.810 INFO:teuthology.orchestra.run.smithi070.stdout:1076 write 0x7113150 thru 0x71207b3 (0xd664 bytes) 2024-09-11T06:17:24.812 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.818 INFO:teuthology.orchestra.run.smithi070.stdout:1078 trunc from 0xb1e8689 to 0x6aa9c9b 2024-09-11T06:17:24.836 INFO:teuthology.orchestra.run.smithi070.stdout:1079 writesame 0xae1a4c7 thru 0xae29d16 data_size 0x89(0xf850 bytes) 2024-09-11T06:17:24.844 INFO:teuthology.orchestra.run.smithi070.stdout:1080 trunc from 0xae29d17 to 0x4b0abf9 2024-09-11T06:17:24.860 INFO:teuthology.orchestra.run.smithi070.stdout:1081 writesame 0x705eea0 thru 0x70644e5 data_size 0x6(0x5646 bytes) 2024-09-11T06:17:24.861 INFO:teuthology.orchestra.run.smithi070.stdout:1082 read 0x45fdfe2 thru 0x4607a7c (0x9a9b bytes) 2024-09-11T06:17:24.861 INFO:teuthology.orchestra.run.smithi070.stdout:1083 punch from 0x4a6d41b to 0x4a7cdf5, (0xf9da bytes) 2024-09-11T06:17:24.862 INFO:teuthology.orchestra.run.smithi070.stdout:1086 read 0x38fa709 thru 0x3904f3d (0xa835 bytes) 2024-09-11T06:17:24.862 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.862 INFO:teuthology.orchestra.run.smithi070.stdout:1090 write 0x115670c thru 0x1163931 (0xd226 bytes) 2024-09-11T06:17:24.863 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:24.862+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:24.865 INFO:teuthology.orchestra.run.smithi070.stdout:1091 write 0x2ba249a thru 0x2ba3066 (0xbcd bytes) 2024-09-11T06:17:24.866 INFO:teuthology.orchestra.run.smithi070.stdout:1094 writesame 0x308b786 thru 0x308dfbe data_size 0x1(0x2839 bytes) 2024-09-11T06:17:24.872 INFO:teuthology.orchestra.run.smithi070.stdout:1096 write 0xf2a28b thru 0xf39943 (0xf6b9 bytes) 2024-09-11T06:17:24.874 INFO:teuthology.orchestra.run.smithi070.stdout:1097 write 0x55af6ae thru 0x55b9992 (0xa2e5 bytes) 2024-09-11T06:17:24.888 INFO:teuthology.orchestra.run.smithi070.stdout:1098 write 0xc558c0e thru 0xc565f90 (0xd383 bytes) 2024-09-11T06:17:24.889 INFO:teuthology.orchestra.run.smithi070.stdout:1099 read 0x60cc3f8 thru 0x60d0cd8 (0x48e1 bytes) 2024-09-11T06:17:24.889 INFO:teuthology.orchestra.run.smithi070.stdout:1102 punch from 0x8c09e89 to 0x8c1753b, (0xd6b2 bytes) 2024-09-11T06:17:24.889 INFO:teuthology.orchestra.run.smithi070.stdout:1103 write 0x859a6cc thru 0x85a304c (0x8981 bytes) 2024-09-11T06:17:24.890 INFO:teuthology.orchestra.run.smithi070.stdout:1104 write 0x3ffab8e thru 0x3ffce6b (0x22de bytes) 2024-09-11T06:17:24.893 INFO:teuthology.orchestra.run.smithi070.stdout:1105 write 0x921a5e8 thru 0x92260f6 (0xbb0f bytes) 2024-09-11T06:17:24.894 INFO:teuthology.orchestra.run.smithi070.stdout:1106 write 0xc13325b thru 0xc140c8a (0xda30 bytes) 2024-09-11T06:17:24.910 INFO:teuthology.orchestra.run.smithi070.stdout:1107 trunc from 0xc565f91 to 0x5a9ea1 2024-09-11T06:17:24.912 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:24.912 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:24.912 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:24.912 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:24.921 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:24.929 INFO:teuthology.orchestra.run.smithi070.stdout:1108 punch from 0x4698c0 to 0x46f0a0, (0x57e0 bytes) 2024-09-11T06:17:24.938 INFO:teuthology.orchestra.run.smithi070.stdout:1109 trunc from 0x5a9ea1 to 0x77f506a 2024-09-11T06:17:24.947 INFO:teuthology.orchestra.run.smithi070.stdout:1110 trunc from 0x77f506a to 0x9b4300b 2024-09-11T06:17:24.954 INFO:teuthology.orchestra.run.smithi070.stdout:1112 read 0x1616f56 thru 0x1617e52 (0xefd bytes) 2024-09-11T06:17:24.954 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:24.964 INFO:teuthology.orchestra.run.smithi070.stdout:1114 trunc from 0x9b4300b to 0x118ab3e 2024-09-11T06:17:24.964 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:24.963+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:24.982 INFO:teuthology.orchestra.run.smithi070.stdout:1115 writesame 0x573c8b6 thru 0x574ab69 data_size 0x16(0xe2b4 bytes) 2024-09-11T06:17:24.982 INFO:teuthology.orchestra.run.smithi070.stdout:1116 read 0x3bc6b20 thru 0x3bd0f56 (0xa437 bytes) 2024-09-11T06:17:24.982 INFO:teuthology.orchestra.run.smithi070.stdout:1117 read 0x8da397 thru 0x8e1ee8 (0x7b52 bytes) 2024-09-11T06:17:24.982 INFO:teuthology.orchestra.run.smithi070.stdout:1118 read 0x3611aa9 thru 0x361a512 (0x8a6a bytes) 2024-09-11T06:17:24.991 INFO:teuthology.orchestra.run.smithi070.stdout:1119 write 0x8d3cbe9 thru 0x8d4b25a (0xe672 bytes) 2024-09-11T06:17:24.994 INFO:teuthology.orchestra.run.smithi070.stdout:1121 punch from 0x4cfa27f to 0x4cfdd53, (0x3ad4 bytes) 2024-09-11T06:17:24.996 INFO:teuthology.orchestra.run.smithi070.stdout:1123 trunc from 0x8d4b25b to 0xa32c4d9 2024-09-11T06:17:25.002 INFO:teuthology.orchestra.run.smithi070.stdout:1124 read 0x5392b12 thru 0x539af8e (0x847d bytes) 2024-09-11T06:17:25.002 INFO:teuthology.orchestra.run.smithi070.stdout:1125 read 0x2c9bd83 thru 0x2ca833f (0xc5bd bytes) 2024-09-11T06:17:25.002 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.002 INFO:teuthology.orchestra.run.smithi070.stdout:1129 write 0x3cbc582 thru 0x3cc7766 (0xb1e5 bytes) 2024-09-11T06:17:25.004 INFO:teuthology.orchestra.run.smithi070.stdout:1130 writesame 0x7a4e305 thru 0x7a5dda5 data_size 0x3(0xfaa1 bytes) 2024-09-11T06:17:25.014 INFO:teuthology.orchestra.run.smithi070.stdout:1131 write 0x33730c8 thru 0x3373d20 (0xc59 bytes) 2024-09-11T06:17:25.017 INFO:teuthology.orchestra.run.smithi070.stdout:1134 punch from 0x1d6e74b to 0x1d6f38e, (0xc43 bytes) 2024-09-11T06:17:25.017 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.017 INFO:teuthology.orchestra.run.smithi070.stdout:1137 write 0x63aefe3 thru 0x63b2d13 (0x3d31 bytes) 2024-09-11T06:17:25.020 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.020 INFO:teuthology.orchestra.run.smithi070.stdout:1140 write 0x5e4a45d thru 0x5e57334 (0xced8 bytes) 2024-09-11T06:17:25.022 INFO:teuthology.orchestra.run.smithi070.stdout:1141 read 0x3dfbde2 thru 0x3dfd855 (0x1a74 bytes) 2024-09-11T06:17:25.023 INFO:teuthology.orchestra.run.smithi070.stdout:1142 write 0x48c7e6b thru 0x48d68aa (0xea40 bytes) 2024-09-11T06:17:25.025 INFO:teuthology.orchestra.run.smithi070.stdout:1145 write 0x9c1a3a9 thru 0x9c24deb (0xaa43 bytes) 2024-09-11T06:17:25.029 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:25.029 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:25.029 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:25.029 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:25.029 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:25.033 INFO:teuthology.orchestra.run.smithi070.stdout:1146 write 0xae70a83 thru 0xae7acc1 (0xa23f bytes) 2024-09-11T06:17:25.036 INFO:teuthology.orchestra.run.smithi070.stdout:1147 write 0x4ccc268 thru 0x4cd9625 (0xd3be bytes) 2024-09-11T06:17:25.039 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:25.049 INFO:teuthology.orchestra.run.smithi070.stdout:1148 trunc from 0xae7acc2 to 0x2da96f0 2024-09-11T06:17:25.060 INFO:teuthology.orchestra.run.smithi070.stdout:1149 read 0x1e75e94 thru 0x1e85677 (0xf7e4 bytes) 2024-09-11T06:17:25.073 INFO:teuthology.orchestra.run.smithi070.stdout:1151 write 0x6ca5256 thru 0x6ca6d19 (0x1ac4 bytes) 2024-09-11T06:17:25.076 INFO:teuthology.orchestra.run.smithi070.stdout:1152 punch from 0x50ee27f to 0x50f9eb1, (0xbc32 bytes) 2024-09-11T06:17:25.076 INFO:teuthology.orchestra.run.smithi070.stdout:1153 writesame 0x40e1c4c thru 0x40ee2a2 data_size 0x19(0xc657 bytes) 2024-09-11T06:17:25.078 INFO:teuthology.orchestra.run.smithi070.stdout:1154 read 0x60316f2 thru 0x6034e5d (0x376c bytes) 2024-09-11T06:17:25.078 INFO:teuthology.orchestra.run.smithi070.stdout:1155 punch from 0xf9b18a to 0xfa5acc, (0xa942 bytes) 2024-09-11T06:17:25.083 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:25.083+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:25.087 INFO:teuthology.orchestra.run.smithi070.stdout:1156 write 0x9f78857 thru 0x9f7f66a (0x6e14 bytes) 2024-09-11T06:17:25.088 INFO:teuthology.orchestra.run.smithi070.stdout:1157 write 0x559816c thru 0x559d208 (0x509d bytes) 2024-09-11T06:17:25.094 INFO:teuthology.orchestra.run.smithi070.stdout:1158 read 0x9a2785 thru 0x9a7ab2 (0x532e bytes) 2024-09-11T06:17:25.095 INFO:teuthology.orchestra.run.smithi070.stdout:1159 punch from 0x84c0f7f to 0x84cf129, (0xe1aa bytes) 2024-09-11T06:17:25.095 INFO:teuthology.orchestra.run.smithi070.stdout:1160 write 0x3fb618e thru 0x3fbb1ac (0x501f bytes) 2024-09-11T06:17:25.097 INFO:teuthology.orchestra.run.smithi070.stdout:1161 write 0x31f07d4 thru 0x31f2eec (0x2719 bytes) 2024-09-11T06:17:25.099 INFO:teuthology.orchestra.run.smithi070.stdout:1162 read 0x537ff3a thru 0x538241a (0x24e1 bytes) 2024-09-11T06:17:25.099 INFO:teuthology.orchestra.run.smithi070.stdout:1163 read 0x8c40741 thru 0x8c4f551 (0xee11 bytes) 2024-09-11T06:17:25.100 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.100 INFO:teuthology.orchestra.run.smithi070.stdout:1165 writesame 0x97333a5 thru 0x97401e8 data_size 0x56(0xce44 bytes) 2024-09-11T06:17:25.102 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.103 INFO:teuthology.orchestra.run.smithi070.stdout:1168 read 0x84931c4 thru 0x84a06b7 (0xd4f4 bytes) 2024-09-11T06:17:25.103 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.103 INFO:teuthology.orchestra.run.smithi070.stdout:1172 punch from 0x3fa7d1a to 0x3fb1f4a, (0xa230 bytes) 2024-09-11T06:17:25.103 INFO:teuthology.orchestra.run.smithi070.stdout:1173 punch from 0x6316969 to 0x631d315, (0x69ac bytes) 2024-09-11T06:17:25.116 INFO:teuthology.orchestra.run.smithi070.stdout:1174 trunc from 0x9f7f66b to 0xb2efd 2024-09-11T06:17:25.137 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.137 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.137 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.137 INFO:teuthology.orchestra.run.smithi070.stdout:1178 trunc from 0xb2efd to 0x70a5fc 2024-09-11T06:17:25.152 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:25.152 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:25.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:25.152 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:25.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.152 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:13 3.b 3:d5a55ce5:::rbd_object_map.116d6cc70d0:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:11.704330+0000", 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.446317681, 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051895129999999998, 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 13 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704330+0000", 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704330+0000", 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704331+0000", 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4920000000000001e-06 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704338+0000", 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5459999999999997e-06 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704347+0000", 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3780000000000007e-06 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704356+0000", 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0089999999999996e-06 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704426+0000", 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9994999999999996e-05 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704431+0000", 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3359999999999997e-06 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706054+0000", 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016233389999999999 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706155+0000", 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100626 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706318+0000", 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016297100000000001 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.707187+0000", 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00086985000000000003 2024-09-11T06:17:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.709417+0000", 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002229759 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.709471+0000", 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3499999999999999e-05 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.709519+0000", 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8711999999999997e-05 2024-09-11T06:17:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:260 3.b 3:d7f57357:::rbd_data.116dc3b5629f.0000000000000027:head [write 655360~48084 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.726824+0000", 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.423823402, 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046184629999999997, 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 260 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726824+0000", 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726824+0000", 2024-09-11T06:17:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726826+0000", 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-06 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726949+0000", 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012277499999999999 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726967+0000", 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7482e-05 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726978+0000", 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.152e-05 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.727050+0000", 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2088000000000005e-05 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.727056+0000", 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0460000000000002e-06 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728994+0000", 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019377520000000001 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729143+0000", 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014853499999999999 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729302+0000", 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015944700000000001 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731295+0000", 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019926229999999998 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731371+0000", 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6695999999999999e-05 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731416+0000", 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4169999999999999e-05 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731443+0000", 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7005e-05 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.165 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:485 3.b 3:d7f57357:::rbd_data.116dc3b5629f.0000000000000027:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.2595316570000001, 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0079083450000000007, 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 485 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891118+0000", 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.057e-06 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891127+0000", 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8729999999999996e-06 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891145+0000", 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8566000000000001e-05 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891155+0000", 2024-09-11T06:17:25.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7289999999999995e-06 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891223+0000", 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7589000000000006e-05 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891229+0000", 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5309999999999998e-06 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897038+0000", 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058083919999999999 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897130+0000", 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2645000000000005e-05 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897240+0000", 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110198 2024-09-11T06:17:25.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898693+0000", 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014520990000000001 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898924+0000", 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023185600000000001 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898972+0000", 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7858000000000002e-05 2024-09-11T06:17:25.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.899024+0000", 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1952e-05 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:491 3.b 3:d76613ba:::rbd_data.116dc3b5629f.0000000000000041:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.891206+0000", 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.2594417139999994, 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0080977770000000004, 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.172 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 491 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891206+0000", 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891206+0000", 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891206+0000", 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-07 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891212+0000", 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2630000000000003e-06 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891220+0000", 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7409999999999998e-06 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891226+0000", 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.049e-06 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891282+0000", 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5138e-05 2024-09-11T06:17:25.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891286+0000", 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7369999999999997e-06 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897569+0000", 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062831359999999999 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897691+0000", 2024-09-11T06:17:25.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121462 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.899304+0000", 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016126420000000001 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:503 3.b 3:d6f6946e:::rbd_data.116dc3b5629f.000000000000004d:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.894359+0000", 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.2562886940000002, 2024-09-11T06:17:25.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056785109999999998, 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 503 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894359+0000", 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894359+0000", 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894360+0000", 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.78e-07 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894364+0000", 2024-09-11T06:17:25.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2050000000000004e-06 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894375+0000", 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1134e-05 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894382+0000", 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2679999999999997e-06 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894690+0000", 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030741399999999999 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894693+0000", 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3830000000000001e-06 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897956+0000", 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032631000000000001 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898081+0000", 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124516 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.900037+0000", 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019566129999999998 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.6 epoch 32/24 rep_tid 6 entries 32'1 (0'0) error 3:62f2cdc7:::rbd_data.116dc3b5629f.000000000000004a:head by client.4461.0:500 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-11T06:17:25.182 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.894410+0000", 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.2562373909999991, 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026537750000000001, 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894410+0000", 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894410+0000", 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894410+0000", 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.74e-07 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894416+0000", 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0750000000000003e-06 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894443+0000", 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6896000000000001e-05 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894460+0000", 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6285000000000001e-05 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894536+0000", 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5957999999999993e-05 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897064+0000", 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002528387 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.0 epoch 32/24 rep_tid 20 entries 32'2 (0'0) error 3:05a5b218:::rbd_data.116dc3b5629f.000000000000006e:head by client.4461.0:506 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.897287+0000", 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.2533602259999999, 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001627458, 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.186 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897287+0000", 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897287+0000", 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897288+0000", 2024-09-11T06:17:25.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2600000000000002e-07 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897297+0000", 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6640000000000004e-06 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897313+0000", 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6359999999999999e-05 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897326+0000", 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3188e-05 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897393+0000", 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6890000000000005e-05 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898915+0000", 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00152173 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:616 3.b 3:d2647583:::rbd_data.116dc3b5629f.0000000000000091:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:17.034193+0000", 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.1164550270000007, 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013711050000000001, 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 616 2024-09-11T06:17:25.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034193+0000", 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034193+0000", 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034194+0000", 2024-09-11T06:17:25.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6610000000000001e-06 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034203+0000", 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6109999999999994e-06 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034218+0000", 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5537e-05 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034227+0000", 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7280000000000001e-06 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034286+0000", 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8783000000000003e-05 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034385+0000", 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8679999999999997e-05 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.034526+0000", 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000141237 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.035392+0000", 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000865758 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.035498+0000", 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106309 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.035534+0000", 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6279999999999998e-05 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:17.035564+0000", 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9521000000000001e-05 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2336 3.6 e33/24 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head v 33'17, mlcod=33'15)", 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.378379+0000", 2024-09-11T06:17:25.195 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.7722683769999996, 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001917329, 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378379+0000", 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378379+0000", 2024-09-11T06:17:25.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378380+0000", 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.299e-06 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378392+0000", 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1450999999999999e-05 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378407+0000", 2024-09-11T06:17:25.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5415999999999999e-05 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378416+0000", 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1130000000000007e-06 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378490+0000", 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3726000000000005e-05 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.378512+0000", 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1520000000000001e-05 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.380264+0000", 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0017519790000000001 2024-09-11T06:17:25.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.380296+0000", 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2824999999999998e-05 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2523 3.c e33/24 3:3632f484:::rbd_data.116dc3b5629f.0000000000000024:head v 33'21, mlcod=33'19)", 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.633533+0000", 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5171145829999997, 2024-09-11T06:17:25.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024261220000000002, 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633533+0000", 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633533+0000", 2024-09-11T06:17:25.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633534+0000", 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0299999999999998e-07 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633590+0000", 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6149000000000001e-05 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633600+0000", 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0327e-05 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633606+0000", 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0950000000000001e-06 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633648+0000", 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1965999999999998e-05 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633663+0000", 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4657999999999999e-05 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.635920+0000", 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002256704 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.635959+0000", 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9520000000000001e-05 2024-09-11T06:17:25.204 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2542 3.b 3:d244c7ed:::rbd_data.116dc3b5629f.00000000000000be:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.661703+0000", 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.488944343, 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053168549999999997, 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:25.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2542 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661703+0000", 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661703+0000", 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661705+0000", 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9819999999999998e-06 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661711+0000", 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0290000000000002e-06 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661727+0000", 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5945000000000001e-05 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661743+0000", 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6007000000000001e-05 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661817+0000", 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3817000000000002e-05 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661894+0000", 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7510999999999997e-05 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661999+0000", 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104934 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.664026+0000", 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002026922 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666924+0000", 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002897878 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666977+0000", 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2676999999999997e-05 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.667020+0000", 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3152999999999998e-05 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2560 3.0 e33/24 3:01819d14:::rbd_data.116dc3b5629f.0000000000000053:head v 33'24, mlcod=33'22)", 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.678135+0000", 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.4725128989999998, 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023013370000000001, 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.211 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678135+0000", 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678135+0000", 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678135+0000", 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8999999999999995e-07 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678158+0000", 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2537000000000001e-05 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678170+0000", 2024-09-11T06:17:25.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1843e-05 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678176+0000", 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4999999999999996e-06 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678226+0000", 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9359e-05 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678247+0000", 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1670000000000001e-05 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.680405+0000", 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021578230000000001 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.680436+0000", 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0815000000000002e-05 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2592 3.c e33/24 3:37e72c44:::rbd_data.116dc3b5629f.0000000000000051:head v 33'23, mlcod=33'21)", 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.738633+0000", 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.4120145629999996, 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020213509999999998, 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.738633+0000", 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.738633+0000", 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.738634+0000", 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1299999999999999e-07 2024-09-11T06:17:25.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.738703+0000", 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9573000000000006e-05 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.738715+0000", 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.203e-05 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.738721+0000", 2024-09-11T06:17:25.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0750000000000003e-06 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.738778+0000", 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6759000000000003e-05 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.738794+0000", 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5307000000000001e-05 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.740616+0000", 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001822579 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.740654+0000", 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8214999999999999e-05 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2613 3.b 3:d2647583:::rbd_data.116dc3b5629f.0000000000000091:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.220 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.768936+0000", 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.3817114549999996, 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022443430000000002, 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2613 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.768936+0000", 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.768936+0000", 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.768937+0000", 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0100000000000003e-07 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.768942+0000", 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6229999999999996e-06 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.768952+0000", 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9860000000000006e-06 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.768957+0000", 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0869999999999997e-06 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769008+0000", 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1805999999999998e-05 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769056+0000", 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7636000000000003e-05 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769116+0000", 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9607e-05 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.770950+0000", 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018338670000000001 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.771098+0000", 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014842699999999999 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.771150+0000", 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.189e-05 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.771180+0000", 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0513000000000001e-05 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2616 3.c e33/24 3:348363dc:::rbd_data.116dc3b5629f.0000000000000098:head v 33'24, mlcod=33'22)", 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.769903+0000", 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.3807443690000003, 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013961900000000001, 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.226 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769903+0000", 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769903+0000", 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769904+0000", 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1999999999999999e-07 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769909+0000", 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7319999999999998e-06 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769918+0000", 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1390000000000001e-06 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769922+0000", 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3710000000000002e-06 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769959+0000", 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7021999999999999e-05 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.769972+0000", 2024-09-11T06:17:25.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2537e-05 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.771264+0000", 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001292203 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.771299+0000", 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5466000000000002e-05 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2776 3.8 e35/24 3:144ea2fb:::rbd_header.116df69fa911:head v 35'7, mlcod=33'5)", 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:21.126269+0000", 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0243782809999997, 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022738150000000002, 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.126269+0000", 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.126269+0000", 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.126270+0000", 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0800000000000004e-07 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.126275+0000", 2024-09-11T06:17:25.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2939999999999996e-06 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.126285+0000", 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.696e-06 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.126291+0000", 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3249999999999996e-06 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.126332+0000", 2024-09-11T06:17:25.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0638e-05 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.126344+0000", 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1821000000000001e-05 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.128520+0000", 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021760999999999998 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.128543+0000", 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3332999999999998e-05 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2792 3.8 e35/24 3:144ea2fb:::rbd_header.116df69fa911:head v 35'9, mlcod=35'7)", 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:21.144270+0000", 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0063770749999996, 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00150851, 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.144270+0000", 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.144270+0000", 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.144271+0000", 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0299999999999999e-07 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.144277+0000", 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3419999999999996e-06 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.144287+0000", 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3540000000000006e-06 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.144292+0000", 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7550000000000002e-06 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.144334+0000", 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2073999999999997e-05 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.144345+0000", 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.186e-05 2024-09-11T06:17:25.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.145743+0000", 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013975140000000001 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.145779+0000", 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6007999999999998e-05 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:3878 3.8 e38/24 3:144ea2fb:::rbd_header.116df69fa911:head v 38'22, mlcod=38'20)", 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:24.115181+0000", 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.035466792, 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019775919999999998, 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.115181+0000", 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.115181+0000", 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.115181+0000", 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6899999999999997e-07 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.115187+0000", 2024-09-11T06:17:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8159999999999999e-06 2024-09-11T06:17:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.115198+0000", 2024-09-11T06:17:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:17:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.115205+0000", 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7299999999999999e-06 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.115251+0000", 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6217000000000002e-05 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.115271+0000", 2024-09-11T06:17:25.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9655000000000001e-05 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.117133+0000", 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0018617989999999999 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.117158+0000", 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5641999999999999e-05 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:4225 3.8 e38/24 3:144ea2fb:::rbd_header.116df69fa911:head v 38'40, mlcod=38'38)", 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:24.749368+0000", 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.40127916000000002, 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001565089, 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.749368+0000", 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.749368+0000", 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.749369+0000", 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8800000000000002e-07 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.749375+0000", 2024-09-11T06:17:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.75e-06 2024-09-11T06:17:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.749386+0000", 2024-09-11T06:17:25.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0871e-05 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.749393+0000", 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8379999999999996e-06 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.749431+0000", 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7910999999999997e-05 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.749443+0000", 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2904999999999999e-05 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.750899+0000", 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001455097 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.750933+0000", 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4928999999999997e-05 2024-09-11T06:17:25.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:4506 3.8 e38/24 3:144ea2fb:::rbd_header.116df69fa911:head v 38'59, mlcod=38'57)", 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.067285+0000", 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.083362456000000001, 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0030464429999999998, 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:25.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067285+0000", 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067285+0000", 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067286+0000", 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.33e-06 2024-09-11T06:17:25.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067298+0000", 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2046e-05 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067315+0000", 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6064000000000001e-05 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067323+0000", 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5199999999999997e-06 2024-09-11T06:17:25.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067389+0000", 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6293999999999999e-05 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067415+0000", 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5239e-05 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.070286+0000", 2024-09-11T06:17:25.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028717920000000002 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.070332+0000", 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5157999999999997e-05 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:25.254 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:25.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:25.258 INFO:teuthology.orchestra.run.smithi070.stdout:1179 writesame 0x859390a thru 0x859e952 data_size 0x31(0xb049 bytes) 2024-09-11T06:17:25.258 INFO:teuthology.orchestra.run.smithi070.stdout:1180 read 0x41235a5 thru 0x412cdbd (0x9819 bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1182 read 0x2ee4064 thru 0x2ef310c (0xf0a9 bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1183 write 0x3be3ff4 thru 0x3beb800 (0x780d bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1184 writesame 0x58428e8 thru 0x5845f66 data_size 0x1(0x367f bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1185 writesame 0x347e412 thru 0x3489b6b data_size 0x3(0xb75a bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1186 read 0x97059d thru 0x97ebe8 (0xe64c bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1187 writesame 0x60fb1d thru 0x61c7d8 data_size 0x2(0xccbc bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1188 write 0x7a0b693 thru 0x7a1b124 (0xfa92 bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1189 write 0x51b0d30 thru 0x51bb8b1 (0xab82 bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1190 write 0x2a27528 thru 0x2a2c30b (0x4de4 bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1191 write 0xca729ce thru 0xca7a18f (0x77c2 bytes) 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.259 INFO:teuthology.orchestra.run.smithi070.stdout:1194 read 0x70ea897 thru 0x70f3950 (0x90ba bytes) 2024-09-11T06:17:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:1197 read 0xaf0c84b thru 0xaf139a2 (0x7158 bytes) 2024-09-11T06:17:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:1199 trunc from 0xca7a190 to 0xd406e56 2024-09-11T06:17:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:1200 read 0x88b08ac thru 0x88b9975 (0x90ca bytes) 2024-09-11T06:17:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:1201 writesame 0x751dd14 thru 0x752a266 data_size 0x1(0xc553 bytes) 2024-09-11T06:17:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:1202 write 0x2dd7245 thru 0x2dd8777 (0x1533 bytes) 2024-09-11T06:17:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:1204 write 0xdc755d0 thru 0xdc7c5df (0x7010 bytes) 2024-09-11T06:17:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:1205 write 0xe3e51c thru 0xe47975 (0x945a bytes) 2024-09-11T06:17:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:1206 writesame 0xcf4d984 thru 0xcf55594 data_size 0x3(0x7c11 bytes) 2024-09-11T06:17:25.260 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:25.255+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:25.269 INFO:teuthology.orchestra.run.smithi070.stdout:1207 trunc from 0xdc7c5e0 to 0x54a5805 2024-09-11T06:17:25.278 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.294 INFO:teuthology.orchestra.run.smithi070.stdout:1209 write 0xcaf6f3d thru 0xcb025f7 (0xb6bb bytes) 2024-09-11T06:17:25.297 INFO:teuthology.orchestra.run.smithi070.stdout:1210 trunc from 0xcb025f8 to 0xabd6fb9 2024-09-11T06:17:25.304 INFO:teuthology.orchestra.run.smithi070.stdout:1211 read 0x6f2a910 thru 0x6f2efbd (0x46ae bytes) 2024-09-11T06:17:25.304 INFO:teuthology.orchestra.run.smithi070.stdout:1212 write 0x5664547 thru 0x5664d38 (0x7f2 bytes) 2024-09-11T06:17:25.306 INFO:teuthology.orchestra.run.smithi070.stdout:1214 write 0x9a201e1 thru 0x9a2f36c (0xf18c bytes) 2024-09-11T06:17:25.309 INFO:teuthology.orchestra.run.smithi070.stdout:1215 writesame 0x77bdcfe thru 0x77c64c4 data_size 0x1(0x87c7 bytes) 2024-09-11T06:17:25.327 INFO:teuthology.orchestra.run.smithi070.stdout:1216 trunc from 0xabd6fb9 to 0xd5e9751 2024-09-11T06:17:25.332 INFO:teuthology.orchestra.run.smithi070.stdout:1217 writesame 0x687ebcc thru 0x68861a5 data_size 0x23(0x75da bytes) 2024-09-11T06:17:25.334 INFO:teuthology.orchestra.run.smithi070.stdout:1218 write 0x3d792f9 thru 0x3d7eef7 (0x5bff bytes) 2024-09-11T06:17:25.335 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.336 INFO:teuthology.orchestra.run.smithi070.stdout:1220 writesame 0x6797927 thru 0x679b8a7 data_size 0x1(0x3f81 bytes) 2024-09-11T06:17:25.343 INFO:teuthology.orchestra.run.smithi070.stdout:1222 writesame 0xc393905 thru 0xc393fc1 data_size 0x5(0x6bd bytes) 2024-09-11T06:17:25.349 INFO:teuthology.orchestra.run.smithi070.stdout:1226 trunc from 0xd5e9751 to 0x9ecaa6b 2024-09-11T06:17:25.356 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:25.355+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:25.357 INFO:teuthology.orchestra.run.smithi070.stdout:1228 write 0x8f7fe54 thru 0x8f8b008 (0xb1b5 bytes) 2024-09-11T06:17:25.358 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.358 INFO:teuthology.orchestra.run.smithi070.stdout:1231 punch from 0x4aa7eb4 to 0x4aab902, (0x3a4e bytes) 2024-09-11T06:17:25.359 INFO:teuthology.orchestra.run.smithi070.stdout:1234 read 0x8099589 thru 0x80a0fce (0x7a46 bytes) 2024-09-11T06:17:25.359 INFO:teuthology.orchestra.run.smithi070.stdout:1235 read 0x18e061d thru 0x18e77c4 (0x71a8 bytes) 2024-09-11T06:17:25.359 INFO:teuthology.orchestra.run.smithi070.stdout:1236 read 0x5aa42e8 thru 0x5aa4b90 (0x8a9 bytes) 2024-09-11T06:17:25.368 INFO:teuthology.orchestra.run.smithi070.stdout:1237 write 0xc0daa4b thru 0xc0df27c (0x4832 bytes) 2024-09-11T06:17:25.369 INFO:teuthology.orchestra.run.smithi070.stdout:1239 write 0xea347b thru 0xead509 (0xa08f bytes) 2024-09-11T06:17:25.371 INFO:teuthology.orchestra.run.smithi070.stdout:1240 read 0xeb47a7 thru 0xebfd7b (0xb5d5 bytes) 2024-09-11T06:17:25.371 INFO:teuthology.orchestra.run.smithi070.stdout:1241 read 0xab0de88 thru 0xab0e2d7 (0x450 bytes) 2024-09-11T06:17:25.371 INFO:teuthology.orchestra.run.smithi070.stdout:1242 read 0xbc365f3 thru 0xbc39cf4 (0x3702 bytes) 2024-09-11T06:17:25.371 INFO:teuthology.orchestra.run.smithi070.stdout:1243 read 0xc08d37e thru 0xc098d86 (0xba09 bytes) 2024-09-11T06:17:25.371 INFO:teuthology.orchestra.run.smithi070.stdout:1244 read 0x591125 thru 0x59856d (0x7449 bytes) 2024-09-11T06:17:25.372 INFO:teuthology.orchestra.run.smithi070.stdout:1246 writesame 0xb59241 thru 0xb60a87 data_size 0x1(0x7847 bytes) 2024-09-11T06:17:25.383 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:25.383 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:25.384 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:25.384 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:25.388 INFO:teuthology.orchestra.run.smithi070.stdout:1247 punch from 0x2847aed to 0x2848073, (0x586 bytes) 2024-09-11T06:17:25.388 INFO:teuthology.orchestra.run.smithi070.stdout:1250 punch from 0x5ed29cb to 0x5ed42f5, (0x192a bytes) 2024-09-11T06:17:25.389 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.389 INFO:teuthology.orchestra.run.smithi070.stdout:1252 write 0x79c84d7 thru 0x79d14ca (0x8ff4 bytes) 2024-09-11T06:17:25.390 INFO:teuthology.orchestra.run.smithi070.stdout:1253 write 0x4295f60 thru 0x429af96 (0x5037 bytes) 2024-09-11T06:17:25.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:25.400 INFO:teuthology.orchestra.run.smithi070.stdout:1254 write 0xe3438d4 thru 0xe3438fa (0x27 bytes) 2024-09-11T06:17:25.402 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.409 INFO:teuthology.orchestra.run.smithi070.stdout:1257 write 0xe9233ee thru 0xe92c2ba (0x8ecd bytes) 2024-09-11T06:17:25.410 INFO:teuthology.orchestra.run.smithi070.stdout:1258 write 0x7ee23fb thru 0x7eed704 (0xb30a bytes) 2024-09-11T06:17:25.412 INFO:teuthology.orchestra.run.smithi070.stdout:1260 write 0xd46d0cc thru 0xd47c78a (0xf6bf bytes) 2024-09-11T06:17:25.413 INFO:teuthology.orchestra.run.smithi070.stdout:1263 read 0x7d4d89e thru 0x7d5953f (0xbca2 bytes) 2024-09-11T06:17:25.414 INFO:teuthology.orchestra.run.smithi070.stdout:1264 write 0x65a9d76 thru 0x65ad481 (0x370c bytes) 2024-09-11T06:17:25.415 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.415 INFO:teuthology.orchestra.run.smithi070.stdout:1266 write 0x202b7f8 thru 0x20395bc (0xddc5 bytes) 2024-09-11T06:17:25.417 INFO:teuthology.orchestra.run.smithi070.stdout:1267 punch from 0xa73f543 to 0xa74b93e, (0xc3fb bytes) 2024-09-11T06:17:25.417 INFO:teuthology.orchestra.run.smithi070.stdout:1268 read 0xc7d1c0b thru 0xc7dfd67 (0xe15d bytes) 2024-09-11T06:17:25.433 INFO:teuthology.orchestra.run.smithi070.stdout:1270 trunc from 0xe92c2bb to 0xba65e6 2024-09-11T06:17:25.457 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:25.456+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:25.463 INFO:teuthology.orchestra.run.smithi070.stdout:1271 write 0x22b1fca thru 0x22b53b8 (0x33ef bytes) 2024-09-11T06:17:25.466 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.475 INFO:teuthology.orchestra.run.smithi070.stdout:1274 trunc from 0x22b53b9 to 0x9cc07a3 2024-09-11T06:17:25.480 INFO:teuthology.orchestra.run.smithi070.stdout:1276 read 0x84c974c thru 0x84d400f (0xa8c4 bytes) 2024-09-11T06:17:25.480 INFO:teuthology.orchestra.run.smithi070.stdout:1277 write 0x7461189 thru 0x746d972 (0xc7ea bytes) 2024-09-11T06:17:25.485 INFO:teuthology.orchestra.run.smithi070.stdout:1278 trunc from 0x9cc07a3 to 0xad6ea43 2024-09-11T06:17:25.490 INFO:teuthology.orchestra.run.smithi070.stdout:1279 write 0x2a0e088 thru 0x2a13106 (0x507f bytes) 2024-09-11T06:17:25.492 INFO:teuthology.orchestra.run.smithi070.stdout:1280 read 0x71db8ef thru 0x71e5f62 (0xa674 bytes) 2024-09-11T06:17:25.492 INFO:teuthology.orchestra.run.smithi070.stdout:1281 read 0x5a0d4d2 thru 0x5a0e5b3 (0x10e2 bytes) 2024-09-11T06:17:25.493 INFO:teuthology.orchestra.run.smithi070.stdout:1283 read 0x5f66c95 thru 0x5f6df30 (0x729c bytes) 2024-09-11T06:17:25.493 INFO:teuthology.orchestra.run.smithi070.stdout:1284 punch from 0x6432182 to 0x6436eda, (0x4d58 bytes) 2024-09-11T06:17:25.497 INFO:teuthology.orchestra.run.smithi070.stdout:1285 trunc from 0xad6ea43 to 0xe125d39 2024-09-11T06:17:25.502 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.502 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.502 INFO:teuthology.orchestra.run.smithi070.stdout:1288 write 0x727e54b thru 0x728a232 (0xbce8 bytes) 2024-09-11T06:17:25.505 INFO:teuthology.orchestra.run.smithi070.stdout:1290 read 0x1471f7b thru 0x147fe7a (0xdf00 bytes) 2024-09-11T06:17:25.505 INFO:teuthology.orchestra.run.smithi070.stdout:1291 writesame 0x58eaabc thru 0x58ef042 data_size 0x11(0x4587 bytes) 2024-09-11T06:17:25.508 INFO:teuthology.orchestra.run.smithi070.stdout:1292 punch from 0x9f4526e to 0x9f4da46, (0x87d8 bytes) 2024-09-11T06:17:25.508 INFO:teuthology.orchestra.run.smithi070.stdout:1293 write 0xa34e82a thru 0xa35a72c (0xbf03 bytes) 2024-09-11T06:17:25.509 INFO:teuthology.orchestra.run.smithi070.stdout:1294 trunc from 0xe125d39 to 0xdea6b94 2024-09-11T06:17:25.515 INFO:teuthology.orchestra.run.smithi070.stdout:1296 punch from 0xbe2c5d7 to 0xbe3a72a, (0xe153 bytes) 2024-09-11T06:17:25.515 INFO:teuthology.orchestra.run.smithi070.stdout:1297 write 0xd1d2866 thru 0xd1d5bb2 (0x334d bytes) 2024-09-11T06:17:25.516 INFO:teuthology.orchestra.run.smithi070.stdout:1298 read 0xda2294e thru 0xda32496 (0xfb49 bytes) 2024-09-11T06:17:25.517 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.517 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.517 INFO:teuthology.orchestra.run.smithi070.stdout:1302 write 0x21313e9 thru 0x2133711 (0x2329 bytes) 2024-09-11T06:17:25.517 INFO:teuthology.orchestra.run.smithi070.stdout:1303 writesame 0xc4fdd67 thru 0xc509bc5 data_size 0x87(0xbe5f bytes) 2024-09-11T06:17:25.521 INFO:teuthology.orchestra.run.smithi070.stdout:1305 read 0xb768458 thru 0xb7739d9 (0xb582 bytes) 2024-09-11T06:17:25.521 INFO:teuthology.orchestra.run.smithi070.stdout:1308 write 0x3bdb0f9 thru 0x3be27b9 (0x76c1 bytes) 2024-09-11T06:17:25.521 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:25.521 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:25.522 INFO:teuthology.orchestra.run.smithi070.stdout:1309 read 0xdaa2bcd thru 0xdaab8b1 (0x8ce5 bytes) 2024-09-11T06:17:25.522 INFO:teuthology.orchestra.run.smithi070.stdout:1310 write 0xc947f03 thru 0xc94df82 (0x6080 bytes) 2024-09-11T06:17:25.525 INFO:teuthology.orchestra.run.smithi070.stdout:1311 read 0x642650b thru 0x642d7e0 (0x72d6 bytes) 2024-09-11T06:17:25.525 INFO:teuthology.orchestra.run.smithi070.stdout:1314 read 0x73df43a thru 0x73e1c22 (0x27e9 bytes) 2024-09-11T06:17:25.526 INFO:teuthology.orchestra.run.smithi070.stdout:1315 write 0x3102785 thru 0x3112658 (0xfed4 bytes) 2024-09-11T06:17:25.529 INFO:teuthology.orchestra.run.smithi070.stdout:1316 read 0xc7a7c0 thru 0xc87c89 (0xd4ca bytes) 2024-09-11T06:17:25.529 INFO:teuthology.orchestra.run.smithi070.stdout:1318 read 0x720ec32 thru 0x720f4e0 (0x8af bytes) 2024-09-11T06:17:25.529 INFO:teuthology.orchestra.run.smithi070.stdout:1319 writesame 0xc9c55b9 thru 0xc9d0f26 data_size 0x65(0xb96e bytes) 2024-09-11T06:17:25.531 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.531 INFO:teuthology.orchestra.run.smithi070.stdout:1321 write 0x9d2682f thru 0x9d2fd41 (0x9513 bytes) 2024-09-11T06:17:25.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:25.534 INFO:teuthology.orchestra.run.smithi070.stdout:1323 write 0x3133a98 thru 0x3133c00 (0x169 bytes) 2024-09-11T06:17:25.549 INFO:teuthology.orchestra.run.smithi070.stdout:1324 trunc from 0xdea6b94 to 0x1e05410 2024-09-11T06:17:25.558 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:25.558+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:25.568 INFO:teuthology.orchestra.run.smithi070.stdout:1325 punch from 0x17bbd54 to 0x17c3896, (0x7b42 bytes) 2024-09-11T06:17:25.568 INFO:teuthology.orchestra.run.smithi070.stdout:1326 write 0x17bcca8 thru 0x17c961b (0xc974 bytes) 2024-09-11T06:17:25.583 INFO:teuthology.orchestra.run.smithi070.stdout:1327 writesame 0x8deae8d thru 0x8df1da7 data_size 0x13(0x6f1b bytes) 2024-09-11T06:17:25.585 INFO:teuthology.orchestra.run.smithi070.stdout:1328 trunc from 0x8df1da8 to 0x82892b7 2024-09-11T06:17:25.591 INFO:teuthology.orchestra.run.smithi070.stdout:1329 writesame 0x7c56e05 thru 0x7c5d1e1 data_size 0x1(0x63dd bytes) 2024-09-11T06:17:25.604 INFO:teuthology.orchestra.run.smithi070.stdout:1330 punch from 0x7997e6 to 0x7a8cc6, (0xf4e0 bytes) 2024-09-11T06:17:25.604 INFO:teuthology.orchestra.run.smithi070.stdout:1331 read 0x456eeea thru 0x457ab20 (0xbc37 bytes) 2024-09-11T06:17:25.605 INFO:teuthology.orchestra.run.smithi070.stdout:1332 write 0xb755cf thru 0xb83746 (0xe178 bytes) 2024-09-11T06:17:25.607 INFO:teuthology.orchestra.run.smithi070.stdout:1334 read 0x63d38c8 thru 0x63d882f (0x4f68 bytes) 2024-09-11T06:17:25.607 INFO:teuthology.orchestra.run.smithi070.stdout:1335 read 0x112b3 thru 0x1df23 (0xcc71 bytes) 2024-09-11T06:17:25.621 INFO:teuthology.orchestra.run.smithi070.stdout:1336 write 0xed0392a thru 0xed11552 (0xdc29 bytes) 2024-09-11T06:17:25.624 INFO:teuthology.orchestra.run.smithi070.stdout:1338 punch from 0x4627972 to 0x4627b4c, (0x1da bytes) 2024-09-11T06:17:25.624 INFO:teuthology.orchestra.run.smithi070.stdout:1339 read 0x1c4fcfe thru 0x1c5791e (0x7c21 bytes) 2024-09-11T06:17:25.625 INFO:teuthology.orchestra.run.smithi070.stdout:1340 write 0x708a3d thru 0x714571 (0xbb35 bytes) 2024-09-11T06:17:25.626 INFO:teuthology.orchestra.run.smithi070.stdout:1341 writesame 0x311ab80 thru 0x3126ca6 data_size 0x1(0xc127 bytes) 2024-09-11T06:17:25.651 INFO:teuthology.orchestra.run.smithi070.stdout:1342 writesame 0x2967c32 thru 0x297265b data_size 0x1(0xaa2a bytes) 2024-09-11T06:17:25.653 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:25.653 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:25.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:25.653 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:169 3.3 3:c5565208:::rbd_header.116dc3b5629f:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.9423995559999998, 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028354740000000002, 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 169 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.654 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708934+0000", 2024-09-11T06:17:25.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0590000000000001e-06 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708944+0000", 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115999999999999e-05 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708962+0000", 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8501000000000001e-05 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708973+0000", 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.709034+0000", 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0751000000000002e-05 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.709039+0000", 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:17:25.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710519+0000", 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014800530000000001 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710578+0000", 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9370999999999998e-05 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710812+0000", 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023360199999999999 2024-09-11T06:17:25.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711346+0000", 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053434000000000001 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711705+0000", 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035856499999999998 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711738+0000", 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2817000000000001e-05 2024-09-11T06:17:25.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711767+0000", 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9458000000000002e-05 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:444 3.3 3:c5565208:::rbd_header.116dc3b5629f:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:25.660 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9365158850000004, 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003423368, 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 444 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:25.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714817+0000", 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9309999999999998e-06 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714824+0000", 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4200000000000004e-06 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714838+0000", 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4171999999999999e-05 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714849+0000", 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1505000000000001e-05 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714910+0000", 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0594999999999998e-05 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714919+0000", 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7180000000000002e-06 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.716614+0000", 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001694936 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.716710+0000", 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6496000000000006e-05 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.717111+0000", 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040113200000000001 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.717718+0000", 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060639799999999996 2024-09-11T06:17:25.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718151+0000", 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043355800000000001 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718205+0000", 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4048999999999997e-05 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718239+0000", 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3457999999999997e-05 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:499 3.15 3:aab7007a:::rbd_data.116dc3b5629f.0000000000000049:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7578420379999997, 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047301069999999999, 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 499 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893490+0000", 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893494+0000", 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000001e-06 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893503+0000", 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3719999999999994e-06 2024-09-11T06:17:25.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893510+0000", 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6800000000000004e-06 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893558+0000", 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8078000000000003e-05 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893683+0000", 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012479599999999999 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898219+0000", 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045364539999999997 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:501 3.15 3:ad1ccdb6:::rbd_data.116dc3b5629f.000000000000004b:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:25.671 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7572489759999996, 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042345639999999997, 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 501 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894083+0000", 2024-09-11T06:17:25.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4399999999999999e-07 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894087+0000", 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4530000000000004e-06 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894098+0000", 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0892e-05 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894105+0000", 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0949999999999998e-06 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894148+0000", 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2330000000000003e-05 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894246+0000", 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7820999999999997e-05 2024-09-11T06:17:25.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898317+0000", 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040711289999999997 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2339 3.15 3:ab55ab8e:::rbd_data.116dc3b5629f.00000000000000a2:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.2732932630000002, 2024-09-11T06:17:25.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036876579999999999, 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2339 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378040+0000", 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378047+0000", 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378064+0000", 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6490999999999998e-05 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378073+0000", 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0820000000000005e-06 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378152+0000", 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9116999999999995e-05 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378248+0000", 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6522999999999997e-05 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378384+0000", 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013565499999999999 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379558+0000", 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011737169999999999 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381646+0000", 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020887200000000001 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381683+0000", 2024-09-11T06:17:25.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6641999999999999e-05 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381726+0000", 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2521999999999997e-05 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2523 3.c 3:3632f484:::rbd_data.116dc3b5629f.0000000000000024:head [set-alloc-hint object_size 1048576 write_size 1048576,write 229064~33080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.0180941590000003, 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029321939999999999, 2024-09-11T06:17:25.682 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2523 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633238+0000", 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633255+0000", 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7257000000000001e-05 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633270+0000", 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4884e-05 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633278+0000", 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8970000000000008e-06 2024-09-11T06:17:25.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633324+0000", 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6300000000000001e-05 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633375+0000", 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0358000000000001e-05 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633462+0000", 2024-09-11T06:17:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7462999999999999e-05 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.634030+0000", 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056805799999999997 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636091+0000", 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020603370000000002 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636126+0000", 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4962999999999997e-05 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636169+0000", 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3509e-05 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.9679134410000003, 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:25.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2562 3.3 e33/24 ondisk, result = 0)", 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.9524095419999998, 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074132119999999998, 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698923+0000", 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698928+0000", 2024-09-11T06:17:25.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698942+0000", 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4399999999999999e-05 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698953+0000", 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0463e-05 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706238+0000", 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072859140000000001 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706246+0000", 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706335+0000", 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9016000000000003e-05 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2592 3.c 3:37e72c44:::rbd_data.116dc3b5629f.0000000000000051:head [set-alloc-hint object_size 1048576 write_size 1048576,write 610943~44417] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.9131095240000002, 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026217329999999998, 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2592 2024-09-11T06:17:25.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738223+0000", 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8369999999999999e-06 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738247+0000", 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3178000000000001e-05 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738265+0000", 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8133000000000001e-05 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738273+0000", 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7980000000000006e-06 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738328+0000", 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5597000000000003e-05 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738438+0000", 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010934600000000001 2024-09-11T06:17:25.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738543+0000", 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010534100000000001 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.739285+0000", 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074247799999999997 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740770+0000", 2024-09-11T06:17:25.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014848909999999999 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740806+0000", 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5714999999999999e-05 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740843+0000", 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7419000000000002e-05 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2593 3.15 3:afcf008c:::rbd_data.116dc3b5629f.0000000000000052:head [set-alloc-hint object_size 1048576 write_size 1048576,write 524288~13920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.9105762479999999, 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022544399999999999, 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2593 2024-09-11T06:17:25.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740756+0000", 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4700000000000001e-07 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740772+0000", 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6396999999999999e-05 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740778+0000", 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2489999999999998e-06 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740783+0000", 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740827+0000", 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4641000000000002e-05 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740876+0000", 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8748999999999997e-05 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740964+0000", 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8577000000000003e-05 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.741455+0000", 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049060399999999995 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.742951+0000", 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014960030000000001 2024-09-11T06:17:25.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.742984+0000", 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2842000000000002e-05 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.743009+0000", 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5426999999999999e-05 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2616 3.c 3:348363dc:::rbd_data.116dc3b5629f.0000000000000098:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.8823099919999997, 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024901509999999999, 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2616 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769022+0000", 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-07 2024-09-11T06:17:25.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769025+0000", 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2260000000000001e-06 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769033+0000", 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7249999999999997e-06 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769038+0000", 2024-09-11T06:17:25.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0900000000000004e-06 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769113+0000", 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5154000000000006e-05 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769209+0000", 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6560999999999999e-05 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769312+0000", 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102872 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.770316+0000", 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001003531 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771432+0000", 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001116641 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771479+0000", 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6523000000000002e-05 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771511+0000", 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2342999999999998e-05 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2623 3.15 3:a82ef535:::rbd_data.116dc3b5629f.0000000000000089:head [truncate 917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.773748+0000", 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.8775832980000002, 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019986890000000001, 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2623 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773748+0000", 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773748+0000", 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773749+0000", 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.017e-06 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773754+0000", 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6979999999999997e-06 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773765+0000", 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1276e-05 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773770+0000", 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.147e-06 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773813+0000", 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2908999999999999e-05 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773862+0000", 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9118e-05 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.773944+0000", 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2156000000000004e-05 2024-09-11T06:17:25.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.774387+0000", 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044296199999999998 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.775694+0000", 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013068699999999999 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.775723+0000", 2024-09-11T06:17:25.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.919e-05 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.775747+0000", 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3346e-05 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.8479172029999997, 2024-09-11T06:17:25.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:25.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:17:25.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2651 3.3 e33/24 ondisk, result = 0)", 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:25.728 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6268347700000003, 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031677519999999998, 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024497+0000", 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5300000000000003e-07 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024500+0000", 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.269e-06 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024511+0000", 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024518+0000", 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.114e-06 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027574+0000", 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030561249999999998 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027581+0000", 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5080000000000002e-06 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027664+0000", 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3143e-05 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2691 3.c 3:37e72c44:::rbd_data.116dc3b5629f.0000000000000051:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5747150019999996, 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022947499999999999, 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2691 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076618+0000", 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:17:25.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076624+0000", 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.127e-06 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076641+0000", 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6898e-05 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076648+0000", 2024-09-11T06:17:25.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076716+0000", 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7836999999999994e-05 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076815+0000", 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8825000000000003e-05 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076939+0000", 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012387800000000001 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078187+0000", 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012486050000000001 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078816+0000", 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062893599999999997 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078864+0000", 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7809999999999998e-05 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078911+0000", 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6876999999999999e-05 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.738 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2695 3.c 3:3177d100:::rbd_data.116dc3b5629f.0000000000000059:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.574629228, 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022989870000000002, 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076705+0000", 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.649e-06 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076712+0000", 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5880000000000003e-06 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076716+0000", 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.882e-06 2024-09-11T06:17:25.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077215+0000", 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049831500000000004 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077281+0000", 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000003e-05 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077380+0000", 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9135999999999994e-05 2024-09-11T06:17:25.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078397+0000", 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010168589999999999 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078917+0000", 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052007599999999996 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078955+0000", 2024-09-11T06:17:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7821000000000003e-05 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079001+0000", 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6196999999999998e-05 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2696 3.f 3:f6622635:::rbd_data.116dc3b5629f.000000000000005e:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.076726+0000", 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5746050870000001, 2024-09-11T06:17:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001945811, 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2696 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076726+0000", 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076726+0000", 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076726+0000", 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076729+0000", 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076735+0000", 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6160000000000001e-06 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076739+0000", 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5299999999999998e-06 2024-09-11T06:17:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076827+0000", 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7899999999999995e-05 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076934+0000", 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107193 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077044+0000", 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010999 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078314+0000", 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001269753 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078587+0000", 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027312099999999998 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078631+0000", 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3649000000000002e-05 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078672+0000", 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1034e-05 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2697 3.15 3:ad475496:::rbd_data.116dc3b5629f.000000000000005f:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.076751+0000", 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5745803399999998, 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020201540000000001, 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2697 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076751+0000", 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076751+0000", 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076751+0000", 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076753+0000", 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2029999999999999e-06 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076759+0000", 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8119999999999996e-06 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076764+0000", 2024-09-11T06:17:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.091e-06 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077326+0000", 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056152299999999997 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077403+0000", 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7064999999999995e-05 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077629+0000", 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022592000000000001 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078677+0000", 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010476960000000001 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078698+0000", 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1727999999999999e-05 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078732+0000", 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4171000000000002e-05 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078771+0000", 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8547999999999998e-05 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2708 3.15 3:a82ef535:::rbd_data.116dc3b5629f.0000000000000089:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5717726719999998, 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024258830000000002, 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2708 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079560+0000", 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.111e-06 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079565+0000", 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0690000000000001e-06 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079579+0000", 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4433999999999999e-05 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079587+0000", 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9449999999999993e-06 2024-09-11T06:17:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079642+0000", 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5220000000000003e-05 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079718+0000", 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079816+0000", 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7684999999999997e-05 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080811+0000", 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099504099999999989 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081866+0000", 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001055194 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081931+0000", 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455000000000005e-05 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081984+0000", 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3621e-05 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2711 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5713747250000001, 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020553699999999999, 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2711 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079957+0000", 2024-09-11T06:17:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079962+0000", 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.702e-06 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079974+0000", 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1821000000000001e-05 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079981+0000", 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3100000000000003e-06 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080403+0000", 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042168000000000001 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080482+0000", 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9072000000000005e-05 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080660+0000", 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017823599999999999 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081865+0000", 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012044740000000001 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081884+0000", 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9099000000000001e-05 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081967+0000", 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3107000000000002e-05 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082012+0000", 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4957999999999999e-05 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:25.769 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:25.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:25.771 INFO:teuthology.orchestra.run.smithi070.stdout:1344 writesame 0x631010e thru 0x631ed21 data_size 0x3a(0xec14 bytes) 2024-09-11T06:17:25.771 INFO:teuthology.orchestra.run.smithi070.stdout:1345 punch from 0x8a0c987 to 0x8a0efce, (0x2647 bytes) 2024-09-11T06:17:25.771 INFO:teuthology.orchestra.run.smithi070.stdout:1346 writesame 0xe32911c thru 0xe336e0c data_size 0x1(0xdcf1 bytes) 2024-09-11T06:17:25.771 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.771 INFO:teuthology.orchestra.run.smithi070.stdout:1348 read 0xb0a6be3 thru 0xb0b6840 (0xfc5e bytes) 2024-09-11T06:17:25.771 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:25.771 INFO:teuthology.orchestra.run.smithi070.stdout:1350 clone 3 order 19 su 65536 sc 11 2024-09-11T06:17:25.772 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:25.769+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:25.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:25.904 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:25.903+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:25.916 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:25.916 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:25.916 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:25.916 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:25.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:25.971 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:25.971+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:25.980 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:25.980 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:25.997 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:25.997 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:26.013 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:26.013 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:26.031 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:26.031 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:26.048 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:26.048 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:26.065 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:26.065 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:26.071 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:26.072 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:26.072 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:26.071+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:26.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:26.081 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:26.098 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:26.099 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:26.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:17:26.173 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:26.173+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:26.190 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:26.190 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:26.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:26.274 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:26.273+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:26.346 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:26.346 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:26.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:26.400 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:26.399+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:26.460 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:26.460 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:26.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:26.475 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:26.474+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:26.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:26.575+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:26.613 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:26.613 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:26.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:26.680 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:26.677+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:26.724 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:26.724 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:26.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:26.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:26.778+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:26.836 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:26.836 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:26.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:26.887 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:26.887+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:26.946 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:26.947 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:26.955 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:26.996 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:26.995+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:27.059 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:27.059 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:27.067 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:27.081 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:27.081+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:27.113 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T06:17:27.113 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:17:27.113 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T06:17:27.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:17:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:17:27.182 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:27.182+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:27.198 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:27.198 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:27.209 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:27.283 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:27.283+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:27.347 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:27.348 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:27.360 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:27.385 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:27.384+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 41, 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:17:27.115064+0000", 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:16:51.453603+0000", 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:16:42.356322+0000", 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:17:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 5, 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:17:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:17:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:17:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:17:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:17:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:17:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:17:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:17:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:17:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:17:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:17:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:17:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:17:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.96165657043457031, 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.95999997854232788, 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.95999997854232788 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:17:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:17:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:17:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:17:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:17:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:17:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.96165657043457031, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.95999997854232788, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.95999997854232788 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:17:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:17:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:17:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:17:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:17:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:17:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:17:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:17:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "41", 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 8, 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 41, 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:17:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:17:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.96165657043457031, 2024-09-11T06:17:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.95999997854232788, 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.95999997854232788 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:17:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:17:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:17:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:17:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:17:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.6932525634765625, 2024-09-11T06:17:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:17:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:17:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:17:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:17:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:17:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:17:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:17:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:17:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/569448355", 2024-09-11T06:17:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/569448355", 2024-09-11T06:17:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/569448355", 2024-09-11T06:17:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/569448355", 2024-09-11T06:17:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:17:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:17:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:17:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:17:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:17:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:17:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:17:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:17:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:17:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/720689704", 2024-09-11T06:17:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/720689704", 2024-09-11T06:17:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/720689704", 2024-09-11T06:17:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/720689704", 2024-09-11T06:17:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:17:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:17:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:17:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:17:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:17:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:17:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 36, 2024-09-11T06:17:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:17:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:17:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:17:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:17:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:17:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:17:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:17:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:17:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:17:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 6, 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:17:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:17:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:17:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:27.569 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:27.571 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:27.571 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:27.571 INFO:tasks.thrashosds.thrasher:j is {'epoch': 41, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:17:27.115064+0000', 'last_up_change': '2024-09-11T06:16:51.453603+0000', 'last_in_change': '2024-09-11T06:16:42.356322+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9616565704345703, 'average_primary_affinity': 0.9599999785423279, 'average_primary_affinity_weighted': 0.9599999785423279}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 0.9616565704345703, 'average_primary_affinity': 0.9599999785423279, 'average_primary_affinity_weighted': 0.9599999785423279}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 8, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9616565704345703, 'average_primary_affinity': 0.9599999785423279, 'average_primary_affinity_weighted': 0.9599999785423279}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6932525634765625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 569448355}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 569448355}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 569448355}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 569448355}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 569448355}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 569448355}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 569448355}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 569448355}]}, 'public_addr': '172.21.15.70:6817/569448355', 'cluster_addr': '172.21.15.70:6819/569448355', 'heartbeat_back_addr': '172.21.15.70:6823/569448355', 'heartbeat_front_addr': '172.21.15.70:6821/569448355', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 720689704}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 720689704}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 720689704}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 720689704}]}, 'public_addr': '172.21.15.70:6809/720689704', 'cluster_addr': '172.21.15.70:6811/720689704', 'heartbeat_back_addr': '172.21.15.70:6815/720689704', 'heartbeat_front_addr': '172.21.15.70:6813/720689704', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 36, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 6, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:17:27.572 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:27.572 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:27.569+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:27.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:27.671 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:27.670+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:27.675 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:27.676 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:27.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:27.772 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:27.771+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:27.829 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:27.829 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:27.837 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:27.873 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:27.872+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:27.886 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:27.886 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:27.898 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-11T06:17:27.118859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23069296,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6210,"num_read_kb":6098,"num_write":2013,"num_write_kb":13308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1584,"ondisk_log_size":1584,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245916,"kb_used_data":4704,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728804,"statfs":{"total":773094113280,"available":772842295296,"internally_reserved":0,"allocated":4816896,"data_stored":4211336,"data_compressed":20321,"data_compressed_allocated":143360,"data_compressed_original":1710814,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-69303,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":22,"num_read_kb":197,"num_write":25,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.017388"},"pg_stats":[{"pgid":"3.1f","version":"33'24","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.096858+0000","last_change":"2024-09-11T06:17:16.721205+0000","last_active":"2024-09-11T06:17:22.096858+0000","last_peered":"2024-09-11T06:17:22.096858+0000","last_clean":"2024-09-11T06:17:22.096858+0000","last_became_active":"2024-09-11T06:17:09.686692+0000","last_became_peered":"2024-09-11T06:17:09.686692+0000","last_unstale":"2024-09-11T06:17:22.096858+0000","last_undegraded":"2024-09-11T06:17:22.096858+0000","last_fullsized":"2024-09-11T06:17:22.096858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:42.368059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043740599999999999,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":23,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.1e","version":"33'13","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.096740+0000","last_change":"2024-09-11T06:17:16.720967+0000","last_active":"2024-09-11T06:17:22.096740+0000","last_peered":"2024-09-11T06:17:22.096740+0000","last_clean":"2024-09-11T06:17:22.096740+0000","last_became_active":"2024-09-11T06:17:09.686913+0000","last_became_peered":"2024-09-11T06:17:09.686913+0000","last_unstale":"2024-09-11T06:17:22.096740+0000","last_undegraded":"2024-09-11T06:17:22.096740+0000","last_fullsized":"2024-09-11T06:17:22.096740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:47:23.539099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026973600000000002,"stat_sum":{"num_bytes":393891,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":39,"num_write":13,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.1d","version":"35'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.118063+0000","last_change":"2024-09-11T06:17:16.714563+0000","last_active":"2024-09-11T06:17:22.118063+0000","last_peered":"2024-09-11T06:17:22.118063+0000","last_clean":"2024-09-11T06:17:22.118063+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:17:22.118063+0000","last_undegraded":"2024-09-11T06:17:22.118063+0000","last_fullsized":"2024-09-11T06:17:22.118063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:17.528562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001396464,"stat_sum":{"num_bytes":906645,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":10,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.1c","version":"35'19","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.094542+0000","last_change":"2024-09-11T06:17:16.713552+0000","last_active":"2024-09-11T06:17:22.094542+0000","last_peered":"2024-09-11T06:17:22.094542+0000","last_clean":"2024-09-11T06:17:22.094542+0000","last_became_active":"2024-09-11T06:17:09.680193+0000","last_became_peered":"2024-09-11T06:17:09.680193+0000","last_unstale":"2024-09-11T06:17:22.094542+0000","last_undegraded":"2024-09-11T06:17:22.094542+0000","last_fullsized":"2024-09-11T06:17:22.094542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:25:28.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087628100000000002,"stat_sum":{"num_bytes":179156,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":88,"num_write":19,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.1b","version":"33'17","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.100005+0000","last_change":"2024-09-11T06:17:16.714287+0000","last_active":"2024-09-11T06:17:22.100005+0000","last_peered":"2024-09-11T06:17:22.100005+0000","last_clean":"2024-09-11T06:17:22.100005+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:17:22.100005+0000","last_undegraded":"2024-09-11T06:17:22.100005+0000","last_fullsized":"2024-09-11T06:17:22.100005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:16.409228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000700317,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.1a","version":"33'60","reported_seq":242,"reported_epoch":36,"state":"peering","last_fresh":"2024-09-11T06:17:22.096970+0000","last_change":"2024-09-11T06:17:22.096970+0000","last_active":"2024-09-11T06:17:22.096970+0000","last_peered":"2024-09-11T06:17:19.625002+0000","last_clean":"2024-09-11T06:17:19.625002+0000","last_became_active":"2024-09-11T06:17:09.686937+0000","last_became_peered":"2024-09-11T06:17:09.686937+0000","last_unstale":"2024-09-11T06:17:22.096970+0000","last_undegraded":"2024-09-11T06:17:22.096970+0000","last_fullsized":"2024-09-11T06:17:22.096970+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083100700000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":272,"num_write":88,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.19","version":"33'46","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.100033+0000","last_change":"2024-09-11T06:17:16.713964+0000","last_active":"2024-09-11T06:17:22.100033+0000","last_peered":"2024-09-11T06:17:22.100033+0000","last_clean":"2024-09-11T06:17:22.100033+0000","last_became_active":"2024-09-11T06:17:09.680455+0000","last_became_peered":"2024-09-11T06:17:09.680455+0000","last_unstale":"2024-09-11T06:17:22.100033+0000","last_undegraded":"2024-09-11T06:17:22.100033+0000","last_fullsized":"2024-09-11T06:17:22.100033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:07.335269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040671899999999999,"stat_sum":{"num_bytes":524288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":29,"num_write":44,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.18","version":"35'550","reported_seq":606,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.119451+0000","last_change":"2024-09-11T06:17:16.721643+0000","last_active":"2024-09-11T06:17:22.119451+0000","last_peered":"2024-09-11T06:17:22.119451+0000","last_clean":"2024-09-11T06:17:22.119451+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:17:22.119451+0000","last_undegraded":"2024-09-11T06:17:22.119451+0000","last_fullsized":"2024-09-11T06:17:22.119451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:15:43.894681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078006699999999996,"stat_sum":{"num_bytes":178316,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2244,"num_write":932,"num_write_kb":1237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.17","version":"33'23","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.096770+0000","last_change":"2024-09-11T06:17:16.721092+0000","last_active":"2024-09-11T06:17:22.096770+0000","last_peered":"2024-09-11T06:17:22.096770+0000","last_clean":"2024-09-11T06:17:22.096770+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:17:22.096770+0000","last_undegraded":"2024-09-11T06:17:22.096770+0000","last_fullsized":"2024-09-11T06:17:22.096770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:04.697715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034699999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.16","version":"33'48","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.121402+0000","last_change":"2024-09-11T06:17:16.719198+0000","last_active":"2024-09-11T06:17:22.121402+0000","last_peered":"2024-09-11T06:17:22.121402+0000","last_clean":"2024-09-11T06:17:22.121402+0000","last_became_active":"2024-09-11T06:17:09.686021+0000","last_became_peered":"2024-09-11T06:17:09.686021+0000","last_unstale":"2024-09-11T06:17:22.121402+0000","last_undegraded":"2024-09-11T06:17:22.121402+0000","last_fullsized":"2024-09-11T06:17:22.121402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:11.965290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036259900000000002,"stat_sum":{"num_bytes":1001319,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":47,"num_write_kb":539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.15","version":"33'49","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.125534+0000","last_change":"2024-09-11T06:17:16.716890+0000","last_active":"2024-09-11T06:17:22.125534+0000","last_peered":"2024-09-11T06:17:22.125534+0000","last_clean":"2024-09-11T06:17:22.125534+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:17:22.125534+0000","last_undegraded":"2024-09-11T06:17:22.125534+0000","last_fullsized":"2024-09-11T06:17:22.125534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:01:58.387759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040332299999999997,"stat_sum":{"num_bytes":1439247,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":51,"num_write":46,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.14","version":"33'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.111412+0000","last_change":"2024-09-11T06:17:16.714290+0000","last_active":"2024-09-11T06:17:22.111412+0000","last_peered":"2024-09-11T06:17:22.111412+0000","last_clean":"2024-09-11T06:17:22.111412+0000","last_became_active":"2024-09-11T06:17:09.682654+0000","last_became_peered":"2024-09-11T06:17:09.682654+0000","last_unstale":"2024-09-11T06:17:22.111412+0000","last_undegraded":"2024-09-11T06:17:22.111412+0000","last_fullsized":"2024-09-11T06:17:22.111412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:36.290040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013025650000000001,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.095233+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:22.095233+0000","last_peered":"2024-09-11T06:17:22.095233+0000","last_clean":"2024-09-11T06:17:22.095233+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:22.095233+0000","last_undegraded":"2024-09-11T06:17:22.095233+0000","last_fullsized":"2024-09-11T06:17:22.095233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"34'20","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.111874+0000","last_change":"2024-09-11T06:17:16.714497+0000","last_active":"2024-09-11T06:17:22.111874+0000","last_peered":"2024-09-11T06:17:22.111874+0000","last_clean":"2024-09-11T06:17:22.111874+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:17:22.111874+0000","last_undegraded":"2024-09-11T06:17:22.111874+0000","last_fullsized":"2024-09-11T06:17:22.111874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:03:33.017734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066562999999999995,"stat_sum":{"num_bytes":326029,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":19,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.100043+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:22.100043+0000","last_peered":"2024-09-11T06:17:22.100043+0000","last_clean":"2024-09-11T06:17:22.100043+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:22.100043+0000","last_undegraded":"2024-09-11T06:17:22.100043+0000","last_fullsized":"2024-09-11T06:17:22.100043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'10","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.100047+0000","last_change":"2024-09-11T06:17:16.714428+0000","last_active":"2024-09-11T06:17:22.100047+0000","last_peered":"2024-09-11T06:17:22.100047+0000","last_clean":"2024-09-11T06:17:22.100047+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:17:22.100047+0000","last_undegraded":"2024-09-11T06:17:22.100047+0000","last_fullsized":"2024-09-11T06:17:22.100047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:58.520651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071825600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.094840+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:22.094840+0000","last_peered":"2024-09-11T06:17:22.094840+0000","last_clean":"2024-09-11T06:17:22.094840+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:22.094840+0000","last_undegraded":"2024-09-11T06:17:22.094840+0000","last_fullsized":"2024-09-11T06:17:22.094840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"39'28","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T06:17:26.139019+0000","last_change":"2024-09-11T06:17:24.230322+0000","last_active":"2024-09-11T06:17:26.139019+0000","last_peered":"2024-09-11T06:17:26.139019+0000","last_clean":"2024-09-11T06:17:26.139019+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:17:26.139019+0000","last_undegraded":"2024-09-11T06:17:26.139019+0000","last_fullsized":"2024-09-11T06:17:26.139019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:35.639205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092498000000000005,"stat_sum":{"num_bytes":264414,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":33,"num_write":27,"num_write_kb":534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.096659+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:22.096659+0000","last_peered":"2024-09-11T06:17:22.096659+0000","last_clean":"2024-09-11T06:17:22.096659+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:22.096659+0000","last_undegraded":"2024-09-11T06:17:22.096659+0000","last_fullsized":"2024-09-11T06:17:22.096659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"33'11","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.104134+0000","last_change":"2024-09-11T06:17:16.719052+0000","last_active":"2024-09-11T06:17:22.104134+0000","last_peered":"2024-09-11T06:17:22.104134+0000","last_clean":"2024-09-11T06:17:22.104134+0000","last_became_active":"2024-09-11T06:17:09.680887+0000","last_became_peered":"2024-09-11T06:17:09.680887+0000","last_unstale":"2024-09-11T06:17:22.104134+0000","last_undegraded":"2024-09-11T06:17:22.104134+0000","last_fullsized":"2024-09-11T06:17:22.104134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:50:52.369264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039009599999999999,"stat_sum":{"num_bytes":2445791,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":52,"num_write":11,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.3","version":"36'189","reported_seq":1111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.125331+0000","last_change":"2024-09-11T06:17:16.717676+0000","last_active":"2024-09-11T06:17:22.125331+0000","last_peered":"2024-09-11T06:17:22.125331+0000","last_clean":"2024-09-11T06:17:22.125331+0000","last_became_active":"2024-09-11T06:17:09.676881+0000","last_became_peered":"2024-09-11T06:17:09.676881+0000","last_unstale":"2024-09-11T06:17:22.125331+0000","last_undegraded":"2024-09-11T06:17:22.125331+0000","last_fullsized":"2024-09-11T06:17:22.125331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:01:36.979971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001111508,"stat_sum":{"num_bytes":1282956,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2515,"num_read_kb":2216,"num_write":188,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.095509+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:22.095509+0000","last_peered":"2024-09-11T06:17:22.095509+0000","last_clean":"2024-09-11T06:17:22.095509+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:22.095509+0000","last_undegraded":"2024-09-11T06:17:22.095509+0000","last_fullsized":"2024-09-11T06:17:22.095509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"35'28","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.096805+0000","last_change":"2024-09-11T06:17:16.721316+0000","last_active":"2024-09-11T06:17:22.096805+0000","last_peered":"2024-09-11T06:17:22.096805+0000","last_clean":"2024-09-11T06:17:22.096805+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:17:22.096805+0000","last_undegraded":"2024-09-11T06:17:22.096805+0000","last_fullsized":"2024-09-11T06:17:22.096805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:54:29.787317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049695700000000002,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":37,"num_write":26,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T06:17:24.110756+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:24.110756+0000","last_peered":"2024-09-11T06:17:24.110756+0000","last_clean":"2024-09-11T06:17:24.110756+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:24.110756+0000","last_undegraded":"2024-09-11T06:17:24.110756+0000","last_fullsized":"2024-09-11T06:17:24.110756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'36","reported_seq":149,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T06:17:26.138930+0000","last_change":"2024-09-11T06:17:24.230727+0000","last_active":"2024-09-11T06:17:26.138930+0000","last_peered":"2024-09-11T06:17:26.138930+0000","last_clean":"2024-09-11T06:17:26.138930+0000","last_became_active":"2024-09-11T06:17:09.679986+0000","last_became_peered":"2024-09-11T06:17:09.679986+0000","last_unstale":"2024-09-11T06:17:26.138930+0000","last_undegraded":"2024-09-11T06:17:26.138930+0000","last_fullsized":"2024-09-11T06:17:26.138930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:51.275521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001498568,"stat_sum":{"num_bytes":4356770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":321,"num_write":29,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.094358+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:22.094358+0000","last_peered":"2024-09-11T06:17:22.094358+0000","last_clean":"2024-09-11T06:17:22.094358+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:22.094358+0000","last_undegraded":"2024-09-11T06:17:22.094358+0000","last_fullsized":"2024-09-11T06:17:22.094358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.106998+0000","last_change":"2024-09-11T06:17:16.714204+0000","last_active":"2024-09-11T06:17:22.106998+0000","last_peered":"2024-09-11T06:17:22.106998+0000","last_clean":"2024-09-11T06:17:22.106998+0000","last_became_active":"2024-09-11T06:17:09.675683+0000","last_became_peered":"2024-09-11T06:17:09.675683+0000","last_unstale":"2024-09-11T06:17:22.106998+0000","last_undegraded":"2024-09-11T06:17:22.106998+0000","last_fullsized":"2024-09-11T06:17:22.106998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:10.808235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062724899999999997,"stat_sum":{"num_bytes":917558,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":41,"num_write":6,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.094758+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:22.094758+0000","last_peered":"2024-09-11T06:17:22.094758+0000","last_clean":"2024-09-11T06:17:22.094758+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:22.094758+0000","last_undegraded":"2024-09-11T06:17:22.094758+0000","last_fullsized":"2024-09-11T06:17:22.094758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.094652+0000","last_change":"2024-09-11T06:16:53.499469+0000","last_active":"2024-09-11T06:17:22.094652+0000","last_peered":"2024-09-11T06:17:22.094652+0000","last_clean":"2024-09-11T06:17:22.094652+0000","last_became_active":"2024-09-11T06:16:53.498584+0000","last_became_peered":"2024-09-11T06:16:53.498584+0000","last_unstale":"2024-09-11T06:17:22.094652+0000","last_undegraded":"2024-09-11T06:17:22.094652+0000","last_fullsized":"2024-09-11T06:17:22.094652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:54.729518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.106186+0000","last_change":"2024-09-11T06:17:16.714027+0000","last_active":"2024-09-11T06:17:22.106186+0000","last_peered":"2024-09-11T06:17:22.106186+0000","last_clean":"2024-09-11T06:17:22.106186+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:17:22.106186+0000","last_undegraded":"2024-09-11T06:17:22.106186+0000","last_fullsized":"2024-09-11T06:17:22.106186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:51:10.464466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000458312,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":12,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.9","version":"33'12","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.111209+0000","last_change":"2024-09-11T06:17:16.713513+0000","last_active":"2024-09-11T06:17:22.111209+0000","last_peered":"2024-09-11T06:17:22.111209+0000","last_clean":"2024-09-11T06:17:22.111209+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:17:22.111209+0000","last_undegraded":"2024-09-11T06:17:22.111209+0000","last_fullsized":"2024-09-11T06:17:22.111209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:44.946005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001110013,"stat_sum":{"num_bytes":935341,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12,"num_write":12,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.a","version":"33'15","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.095397+0000","last_change":"2024-09-11T06:17:16.713821+0000","last_active":"2024-09-11T06:17:22.095397+0000","last_peered":"2024-09-11T06:17:22.095397+0000","last_clean":"2024-09-11T06:17:22.095397+0000","last_became_active":"2024-09-11T06:17:09.684600+0000","last_became_peered":"2024-09-11T06:17:09.684600+0000","last_unstale":"2024-09-11T06:17:22.095397+0000","last_undegraded":"2024-09-11T06:17:22.095397+0000","last_fullsized":"2024-09-11T06:17:22.095397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:29:03.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011363079999999999,"stat_sum":{"num_bytes":592408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":35,"num_write":15,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.b","version":"33'44","reported_seq":102,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-11T06:17:24.111054+0000","last_change":"2024-09-11T06:17:24.111243+0000","last_active":"2024-09-11T06:17:24.111054+0000","last_peered":"2024-09-11T06:17:24.111054+0000","last_clean":"2024-09-11T06:17:24.111054+0000","last_became_active":"2024-09-11T06:17:09.681406+0000","last_became_peered":"2024-09-11T06:17:09.681406+0000","last_unstale":"2024-09-11T06:17:24.111054+0000","last_undegraded":"2024-09-11T06:17:24.111054+0000","last_fullsized":"2024-09-11T06:17:24.111054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:53.694258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000329174,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":52,"num_write":49,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"4","length":"1"},{"start":"6","length":"1"}]},{"pgid":"3.c","version":"33'27","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.125991+0000","last_change":"2024-09-11T06:17:16.717702+0000","last_active":"2024-09-11T06:17:22.125991+0000","last_peered":"2024-09-11T06:17:22.125991+0000","last_clean":"2024-09-11T06:17:22.125991+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:17:22.125991+0000","last_undegraded":"2024-09-11T06:17:22.125991+0000","last_fullsized":"2024-09-11T06:17:22.125991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:46.937544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001066727,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":27,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.d","version":"33'11","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.094785+0000","last_change":"2024-09-11T06:17:16.714318+0000","last_active":"2024-09-11T06:17:22.094785+0000","last_peered":"2024-09-11T06:17:22.094785+0000","last_clean":"2024-09-11T06:17:22.094785+0000","last_became_active":"2024-09-11T06:17:09.684618+0000","last_became_peered":"2024-09-11T06:17:09.684618+0000","last_unstale":"2024-09-11T06:17:22.094785+0000","last_undegraded":"2024-09-11T06:17:22.094785+0000","last_fullsized":"2024-09-11T06:17:22.094785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:28.534927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013109910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.e","version":"33'15","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.104232+0000","last_change":"2024-09-11T06:17:16.719298+0000","last_active":"2024-09-11T06:17:22.104232+0000","last_peered":"2024-09-11T06:17:22.104232+0000","last_clean":"2024-09-11T06:17:22.104232+0000","last_became_active":"2024-09-11T06:17:09.679886+0000","last_became_peered":"2024-09-11T06:17:09.679886+0000","last_unstale":"2024-09-11T06:17:22.104232+0000","last_undegraded":"2024-09-11T06:17:22.104232+0000","last_fullsized":"2024-09-11T06:17:22.104232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:54:31.586417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037742,"stat_sum":{"num_bytes":49,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":13,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.f","version":"33'26","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.114602+0000","last_change":"2024-09-11T06:17:16.716853+0000","last_active":"2024-09-11T06:17:22.114602+0000","last_peered":"2024-09-11T06:17:22.114602+0000","last_clean":"2024-09-11T06:17:22.114602+0000","last_became_active":"2024-09-11T06:17:09.679342+0000","last_became_peered":"2024-09-11T06:17:09.679342+0000","last_unstale":"2024-09-11T06:17:22.114602+0000","last_undegraded":"2024-09-11T06:17:22.114602+0000","last_fullsized":"2024-09-11T06:17:22.114602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:15:43.894681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039322000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":176,"num_write":25,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.10","version":"33'24","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.121649+0000","last_change":"2024-09-11T06:17:16.712709+0000","last_active":"2024-09-11T06:17:22.121649+0000","last_peered":"2024-09-11T06:17:22.121649+0000","last_clean":"2024-09-11T06:17:22.121649+0000","last_became_active":"2024-09-11T06:17:09.687700+0000","last_became_peered":"2024-09-11T06:17:09.687700+0000","last_unstale":"2024-09-11T06:17:22.121649+0000","last_undegraded":"2024-09-11T06:17:22.121649+0000","last_fullsized":"2024-09-11T06:17:22.121649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:01:48.269846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047699199999999998,"stat_sum":{"num_bytes":4410055,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":158,"num_write":24,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.11","version":"33'21","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.094452+0000","last_change":"2024-09-11T06:17:16.713253+0000","last_active":"2024-09-11T06:17:22.094452+0000","last_peered":"2024-09-11T06:17:22.094452+0000","last_clean":"2024-09-11T06:17:22.094452+0000","last_became_active":"2024-09-11T06:17:09.683890+0000","last_became_peered":"2024-09-11T06:17:09.683890+0000","last_unstale":"2024-09-11T06:17:22.094452+0000","last_undegraded":"2024-09-11T06:17:22.094452+0000","last_fullsized":"2024-09-11T06:17:22.094452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:57.923849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010100199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":21,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"}]},{"pgid":"3.12","version":"33'44","reported_seq":115,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T06:17:26.139077+0000","last_change":"2024-09-11T06:17:24.229718+0000","last_active":"2024-09-11T06:17:26.139077+0000","last_peered":"2024-09-11T06:17:26.139077+0000","last_clean":"2024-09-11T06:17:26.139077+0000","last_became_active":"2024-09-11T06:17:09.685538+0000","last_became_peered":"2024-09-11T06:17:09.685538+0000","last_unstale":"2024-09-11T06:17:26.139077+0000","last_undegraded":"2024-09-11T06:17:26.139077+0000","last_fullsized":"2024-09-11T06:17:26.139077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:56.703373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000477128,"stat_sum":{"num_bytes":1013803,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":102,"num_write":42,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"1"}]},{"pgid":"3.13","version":"33'18","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T06:17:22.094655+0000","last_change":"2024-09-11T06:17:16.713371+0000","last_active":"2024-09-11T06:17:22.094655+0000","last_peered":"2024-09-11T06:17:22.094655+0000","last_clean":"2024-09-11T06:17:22.094655+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:17:22.094655+0000","last_undegraded":"2024-09-11T06:17:22.094655+0000","last_fullsized":"2024-09-11T06:17:22.094655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:44.275266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010282469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"4","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":22478909,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":6094,"num_read_kb":5998,"num_write":1852,"num_write_kb":10890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1572864,"data_stored":1764375,"data_compressed":2983,"data_compressed_allocated":69632,"data_compressed_original":563934,"omap_allocated":0,"internal_metadata":0},"log_size":1464,"ondisk_log_size":1464,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":557056,"data_stored":972391,"data_compressed":9528,"data_compressed_allocated":53248,"data_compressed_original":745472,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":442368,"data_stored":208795,"data_compressed":131,"data_compressed_allocated":4096,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":610304,"data_stored":355566,"data_compressed":185,"data_compressed_allocated":8192,"data_compressed_original":17775,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":794624,"data_stored":553402,"data_compressed":211,"data_compressed_allocated":4096,"data_compressed_original":45056,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":544768,"data_stored":954898,"data_compressed":9381,"data_compressed_allocated":49152,"data_compressed_original":716800,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":552960,"data_stored":343717,"data_compressed":326,"data_compressed_allocated":8192,"data_compressed_original":54639,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":835584,"data_stored":590225,"data_compressed":428,"data_compressed_allocated":12288,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":479232,"data_stored":232342,"data_compressed":131,"data_compressed_allocated":4096,"data_compressed_original":24576,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":190734,"data_compressed":326,"data_compressed_allocated":8192,"data_compressed_original":54639,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":211547,"data_compressed":712,"data_compressed_allocated":12288,"data_compressed_original":143360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":400457,"data_compressed":211,"data_compressed_allocated":4096,"data_compressed_original":45056,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":202564,"data_compressed":185,"data_compressed_allocated":8192,"data_compressed_original":17775,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":55850,"data_compressed":131,"data_compressed_allocated":4096,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":229040,"data_compressed":859,"data_compressed_allocated":16384,"data_compressed_original":172032,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":413087,"data_compressed":428,"data_compressed_allocated":12288,"data_compressed_original":81920,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":61096,"data_compressed":131,"data_compressed_allocated":4096,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:27.900 INFO:tasks.thrashosds.thrasher:Setting 3.f to [7, 2] 2024-09-11T06:17:27.900 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.f', '7', '2'] 2024-09-11T06:17:27.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.f 7 2 2024-09-11T06:17:27.973 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:27.973+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:27.980 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:27.980 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:27.989 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:28.074 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:28.074+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:28.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:28.135 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:28.135 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:28.145 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:28.189 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:28.189+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:28.250 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:28.251 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:28.260 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:28.261 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:28.278 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:28.294 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:28.294 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:28.296 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-11T06:17:28.301 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:28.300+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:28.325 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:28.325 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:28.350 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:28.368 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:28.368 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:28.377 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:28.377+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:28.395 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:28.399 INFO:teuthology.orchestra.run.smithi070.stdout:1352 write 0x49ab423 thru 0x49b5fc9 (0xaba7 bytes) 2024-09-11T06:17:28.406 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:28.406 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:28.407 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:28.407 INFO:teuthology.orchestra.run.smithi070.stdout:1355 read 0x3c3a32d thru 0x3c3c87b (0x254f bytes) 2024-09-11T06:17:28.407 INFO:teuthology.orchestra.run.smithi070.stdout:1356 punch from 0x3c9023d to 0x3c9bc6b, (0xba2e bytes) 2024-09-11T06:17:28.407 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:28.407 INFO:teuthology.orchestra.run.smithi070.stdout:1359 write 0xda8ad70 thru 0xda99f8b (0xf21c bytes) 2024-09-11T06:17:28.410 INFO:teuthology.orchestra.run.smithi070.stdout:1360 read 0x62a89d4 thru 0x62b1605 (0x8c32 bytes) 2024-09-11T06:17:28.410 INFO:teuthology.orchestra.run.smithi070.stdout:1362 write 0x5d3468e thru 0x5d3c98b (0x82fe bytes) 2024-09-11T06:17:28.414 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:28.415 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:28.421 INFO:teuthology.orchestra.run.smithi070.stdout:1363 trunc from 0xed11553 to 0x89dfd9d 2024-09-11T06:17:28.454 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:28.454 INFO:teuthology.orchestra.run.smithi070.stdout:1365 trunc from 0x89dfd9d to 0x89f9d86 2024-09-11T06:17:28.458 INFO:teuthology.orchestra.run.smithi070.stdout:1366 read 0x51f9a49 thru 0x5200f57 (0x750f bytes) 2024-09-11T06:17:28.459 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:28.459 INFO:teuthology.orchestra.run.smithi070.stdout:1369 write 0x2b55d9 thru 0x2baed8 (0x5900 bytes) 2024-09-11T06:17:28.461 INFO:teuthology.orchestra.run.smithi070.stdout:1371 read 0x1c04363 thru 0x1c09f71 (0x5c0f bytes) 2024-09-11T06:17:28.461 INFO:teuthology.orchestra.run.smithi070.stdout:1372 read 0x8312d21 thru 0x8313ec9 (0x11a9 bytes) 2024-09-11T06:17:28.467 INFO:teuthology.orchestra.run.smithi070.stdout:1373 write 0x8deb1ab thru 0x8df3fda (0x8e30 bytes) 2024-09-11T06:17:28.471 INFO:teuthology.orchestra.run.smithi070.stdout:1375 trunc from 0x8df3fdb to 0x954dad8 2024-09-11T06:17:28.476 INFO:teuthology.orchestra.run.smithi070.stdout:1376 read 0x8c54601 thru 0x8c5a632 (0x6032 bytes) 2024-09-11T06:17:28.476 INFO:teuthology.orchestra.run.smithi070.stdout:1377 writesame 0x1f85188 thru 0x1f85f36 data_size 0x1(0xdaf bytes) 2024-09-11T06:17:28.478 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:28.477+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:28.479 INFO:teuthology.orchestra.run.smithi070.stdout:1378 punch from 0x30a057b to 0x30a9f0f, (0x9994 bytes) 2024-09-11T06:17:28.479 INFO:teuthology.orchestra.run.smithi070.stdout:1379 read 0x410bb34 thru 0x411152a (0x59f7 bytes) 2024-09-11T06:17:28.479 INFO:teuthology.orchestra.run.smithi070.stdout:1381 read 0x432902f thru 0x432ccf6 (0x3cc8 bytes) 2024-09-11T06:17:28.479 INFO:teuthology.orchestra.run.smithi070.stdout:1382 punch from 0x6d087de to 0x6d0db8e, (0x53b0 bytes) 2024-09-11T06:17:28.489 INFO:teuthology.orchestra.run.smithi070.stdout:1383 writesame 0xc726935 thru 0xc72b340 data_size 0xe(0x4a0c bytes) 2024-09-11T06:17:28.489 INFO:teuthology.orchestra.run.smithi070.stdout:1384 read 0x72536c thru 0x72e461 (0x90f6 bytes) 2024-09-11T06:17:28.489 INFO:teuthology.orchestra.run.smithi070.stdout:1386 punch from 0xc1b9430 to 0xc1baa55, (0x1625 bytes) 2024-09-11T06:17:28.489 INFO:teuthology.orchestra.run.smithi070.stdout:1388 writesame 0x3eae3e9 thru 0x3eb8b0b data_size 0x1(0xa723 bytes) 2024-09-11T06:17:28.509 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:28.509 INFO:teuthology.orchestra.run.smithi070.stdout:1391 punch from 0x5f2849c to 0x5f3419f, (0xbd03 bytes) 2024-09-11T06:17:28.509 INFO:teuthology.orchestra.run.smithi070.stdout:1392 writesame 0x3737f59 thru 0x3738f37 data_size 0x1(0xfdf bytes) 2024-09-11T06:17:28.512 INFO:teuthology.orchestra.run.smithi070.stdout:1394 punch from 0x91a25a9 to 0x91a2cae, (0x705 bytes) 2024-09-11T06:17:28.512 INFO:teuthology.orchestra.run.smithi070.stdout:1395 read 0x6750682 thru 0x675caf8 (0xc477 bytes) 2024-09-11T06:17:28.513 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:28.513 INFO:teuthology.orchestra.run.smithi070.stdout:1398 write 0x5d0ddac thru 0x5d0f024 (0x1279 bytes) 2024-09-11T06:17:28.515 INFO:teuthology.orchestra.run.smithi070.stdout:1399 read 0xadc50ad thru 0xadc9548 (0x449c bytes) 2024-09-11T06:17:28.519 INFO:teuthology.orchestra.run.smithi070.stdout:1401 trunc from 0xc72b341 to 0x97474b6 2024-09-11T06:17:28.525 INFO:teuthology.orchestra.run.smithi070.stdout:1404 writesame 0x2393d23 thru 0x23a3c11 data_size 0x11(0xfeef bytes) 2024-09-11T06:17:28.530 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:28.530 INFO:teuthology.orchestra.run.smithi070.stdout:1406 clone 4 order 18 su 2048 sc 2 2024-09-11T06:17:28.561 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:28.561 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:28.561 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:28.569 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:28.612 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:28.612+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:28.674 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:28.674 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:28.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:28.674 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:13 3.b 3:d5a55ce5:::rbd_object_map.116d6cc70d0:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:11.704330+0000", 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 16.968536629999999, 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051895129999999998, 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 13 2024-09-11T06:17:28.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704330+0000", 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704330+0000", 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704331+0000", 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4920000000000001e-06 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704338+0000", 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5459999999999997e-06 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704347+0000", 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3780000000000007e-06 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704356+0000", 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0089999999999996e-06 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704426+0000", 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9994999999999996e-05 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.704431+0000", 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3359999999999997e-06 2024-09-11T06:17:28.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706054+0000", 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016233389999999999 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706155+0000", 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100626 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.706318+0000", 2024-09-11T06:17:28.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016297100000000001 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.707187+0000", 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00086985000000000003 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.709417+0000", 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002229759 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:28.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.709471+0000", 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3499999999999999e-05 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:11.709519+0000", 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8711999999999997e-05 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:260 3.b 3:d7f57357:::rbd_data.116dc3b5629f.0000000000000027:head [write 655360~48084 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.726824+0000", 2024-09-11T06:17:28.681 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.946042350999999, 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046184629999999997, 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 260 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726824+0000", 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726824+0000", 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726826+0000", 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3240000000000001e-06 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726949+0000", 2024-09-11T06:17:28.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012277499999999999 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726967+0000", 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7482e-05 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.726978+0000", 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.152e-05 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.727050+0000", 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2088000000000005e-05 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.727056+0000", 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0460000000000002e-06 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728994+0000", 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019377520000000001 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729143+0000", 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014853499999999999 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729302+0000", 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015944700000000001 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731295+0000", 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019926229999999998 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731371+0000", 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6695999999999999e-05 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731416+0000", 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4169999999999999e-05 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.731443+0000", 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7005e-05 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:485 3.b 3:d7f57357:::rbd_data.116dc3b5629f.0000000000000027:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.781750605999999, 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0079083450000000007, 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 485 2024-09-11T06:17:28.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891116+0000", 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891118+0000", 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.057e-06 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891127+0000", 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8729999999999996e-06 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891145+0000", 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8566000000000001e-05 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891155+0000", 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7289999999999995e-06 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891223+0000", 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7589000000000006e-05 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891229+0000", 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5309999999999998e-06 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897038+0000", 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0058083919999999999 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897130+0000", 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2645000000000005e-05 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897240+0000", 2024-09-11T06:17:28.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110198 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898693+0000", 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014520990000000001 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898924+0000", 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023185600000000001 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898972+0000", 2024-09-11T06:17:28.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7858000000000002e-05 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.899024+0000", 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1952e-05 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:491 3.b 3:d76613ba:::rbd_data.116dc3b5629f.0000000000000041:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.891206+0000", 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.781660663, 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0080977770000000004, 2024-09-11T06:17:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 491 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891206+0000", 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891206+0000", 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891206+0000", 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-07 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891212+0000", 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2630000000000003e-06 2024-09-11T06:17:28.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891220+0000", 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7409999999999998e-06 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891226+0000", 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.049e-06 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891282+0000", 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5138e-05 2024-09-11T06:17:28.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.891286+0000", 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7369999999999997e-06 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897569+0000", 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0062831359999999999 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897691+0000", 2024-09-11T06:17:28.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000121462 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.899304+0000", 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016126420000000001 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:503 3.b 3:d6f6946e:::rbd_data.116dc3b5629f.000000000000004d:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.894359+0000", 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.778507642999999, 2024-09-11T06:17:28.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0056785109999999998, 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 503 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894359+0000", 2024-09-11T06:17:28.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894359+0000", 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894360+0000", 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.78e-07 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894364+0000", 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2050000000000004e-06 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894375+0000", 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1134e-05 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894382+0000", 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2679999999999997e-06 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894690+0000", 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00030741399999999999 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894693+0000", 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3830000000000001e-06 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897956+0000", 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0032631000000000001 2024-09-11T06:17:28.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.898081+0000", 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124516 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.900037+0000", 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0019566129999999998 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.6 epoch 32/24 rep_tid 6 entries 32'1 (0'0) error 3:62f2cdc7:::rbd_data.116dc3b5629f.000000000000004a:head by client.4461.0:500 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:16.894410+0000", 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.77845634, 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026537750000000001, 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894410+0000", 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894410+0000", 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894410+0000", 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.74e-07 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894416+0000", 2024-09-11T06:17:28.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0750000000000003e-06 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894443+0000", 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6896000000000001e-05 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894460+0000", 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6285000000000001e-05 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.894536+0000", 2024-09-11T06:17:28.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5957999999999993e-05 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:16.897064+0000", 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002528387 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2523 3.c e33/24 3:3632f484:::rbd_data.116dc3b5629f.0000000000000024:head v 33'21, mlcod=33'19)", 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.633533+0000", 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.0393335320000006, 2024-09-11T06:17:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024261220000000002, 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633533+0000", 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633533+0000", 2024-09-11T06:17:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633534+0000", 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0299999999999998e-07 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633590+0000", 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6149000000000001e-05 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633600+0000", 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0327e-05 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633606+0000", 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0950000000000001e-06 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633648+0000", 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1965999999999998e-05 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.633663+0000", 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4657999999999999e-05 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.635920+0000", 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002256704 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.635959+0000", 2024-09-11T06:17:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9520000000000001e-05 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2542 3.b 3:d244c7ed:::rbd_data.116dc3b5629f.00000000000000be:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.661703+0000", 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.0111632920000009, 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0053168549999999997, 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:28.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2542 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661703+0000", 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661703+0000", 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661705+0000", 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9819999999999998e-06 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661711+0000", 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0290000000000002e-06 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661727+0000", 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5945000000000001e-05 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661743+0000", 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6007000000000001e-05 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661817+0000", 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3817000000000002e-05 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661894+0000", 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7510999999999997e-05 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.661999+0000", 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104934 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.664026+0000", 2024-09-11T06:17:28.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002026922 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666924+0000", 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002897878 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.666977+0000", 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2676999999999997e-05 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.667020+0000", 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3152999999999998e-05 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2560 3.0 e33/24 3:01819d14:::rbd_data.116dc3b5629f.0000000000000053:head v 33'24, mlcod=33'22)", 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.678135+0000", 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9947318480000007, 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023013370000000001, 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.719 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678135+0000", 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678135+0000", 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678135+0000", 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8999999999999995e-07 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678158+0000", 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2537000000000001e-05 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678170+0000", 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1843e-05 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678176+0000", 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4999999999999996e-06 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678226+0000", 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9359e-05 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.678247+0000", 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1670000000000001e-05 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.680405+0000", 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0021578230000000001 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.680436+0000", 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0815000000000002e-05 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:4506 3.8 e38/24 3:144ea2fb:::rbd_header.116df69fa911:head v 38'59, mlcod=38'57)", 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.067285+0000", 2024-09-11T06:17:28.723 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.6055814050000001, 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0030464429999999998, 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067285+0000", 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067285+0000", 2024-09-11T06:17:28.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067286+0000", 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.33e-06 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067298+0000", 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2046e-05 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067315+0000", 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6064000000000001e-05 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067323+0000", 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5199999999999997e-06 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067389+0000", 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6293999999999999e-05 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.067415+0000", 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5239e-05 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.070286+0000", 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0028717920000000002 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.070332+0000", 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5157999999999997e-05 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.8 epoch 42/24 rep_tid 241 entries 42'92 (0'0) error 3:112946a0:::rbd_data.116d497c8375.0000000000000148:head by client.4461.0:7577 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 41'89)", 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.424456+0000", 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.24841092100000001, 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0027773910000000001, 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.424456+0000", 2024-09-11T06:17:28.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.424456+0000", 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.424456+0000", 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9800000000000003e-07 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.424464+0000", 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.695e-06 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.424480+0000", 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6129000000000001e-05 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.424492+0000", 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2136e-05 2024-09-11T06:17:28.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.424586+0000", 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3752999999999995e-05 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.427233+0000", 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00264708 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.6 epoch 42/24 rep_tid 247 entries 42'24 (0'0) error 3:64757e50:::rbd_data.116d497c8375.0000000000000168:head by client.4461.0:7598 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 41'21)", 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.431112+0000", 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.24175465300000001, 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002522804, 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431112+0000", 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431112+0000", 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431112+0000", 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2799999999999996e-07 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431120+0000", 2024-09-11T06:17:28.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4850000000000003e-06 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431138+0000", 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8175000000000001e-05 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431158+0000", 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9457999999999999e-05 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431243+0000", 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5628000000000001e-05 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.433635+0000", 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0023914299999999999 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.6 epoch 42/24 rep_tid 249 entries 42'25 (0'0) error 3:65183072:::rbd_data.116d497c8375.0000000000000169:head by client.4461.0:7599 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 41'21)", 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.431487+0000", 2024-09-11T06:17:28.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.241379443, 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047702140000000001, 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431487+0000", 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431487+0000", 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431488+0000", 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7199999999999999e-07 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431495+0000", 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9999999999999999e-06 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431507+0000", 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2680000000000001e-05 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431515+0000", 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9589999999999995e-06 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431568+0000", 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2790000000000001e-05 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436257+0000", 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046892130000000002 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:7601 3.6 e42/24 3:64ae98f8:::rbd_data.116d497c8375.00000000000001b6:head v 42'26, mlcod=42'22)", 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.431813+0000", 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.24105388899999999, 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004476407, 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:28.739 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431813+0000", 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431813+0000", 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431813+0000", 2024-09-11T06:17:28.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8100000000000002e-07 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431820+0000", 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6560000000000003e-06 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431832+0000", 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139e-05 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431838+0000", 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.314e-06 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431920+0000", 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1759000000000001e-05 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.431940+0000", 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9833000000000001e-05 2024-09-11T06:17:28.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436259+0000", 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0043193119999999996 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436289+0000", 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9713000000000002e-05 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.8 epoch 42/24 rep_tid 251 entries 42'93 (0'0) error 3:1594c181:::rbd_data.116d497c8375.00000000000001b9:head by client.4461.0:7604 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 42'91)", 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.432167+0000", 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.240699887, 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041785950000000002, 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432167+0000", 2024-09-11T06:17:28.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432167+0000", 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432167+0000", 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6199999999999997e-07 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432175+0000", 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4039999999999998e-06 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432191+0000", 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6523000000000001e-05 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432204+0000", 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2347000000000001e-05 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432261+0000", 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7299000000000001e-05 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436345+0000", 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040843600000000004 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.6 epoch 42/24 rep_tid 253 entries 42'27 (0'0) error 3:63f13c64:::rbd_data.116d497c8375.00000000000001ba:head by client.4461.0:7605 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 42'22)", 2024-09-11T06:17:28.747 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.432299+0000", 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.240567272, 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0040032460000000002, 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432299+0000", 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432299+0000", 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432300+0000", 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1799999999999995e-07 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432305+0000", 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7620000000000001e-06 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432318+0000", 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2879e-05 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432330+0000", 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1182000000000001e-05 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.432391+0000", 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1495999999999995e-05 2024-09-11T06:17:28.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436302+0000", 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039114090000000002 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.c epoch 42/24 rep_tid 319 entries 42'31 (0'0) error 3:37d62a9b:::rbd_data.116d497c8375.00000000000001c0:head by client.4461.0:7611 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 41'29)", 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.434103+0000", 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.238763634, 2024-09-11T06:17:28.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048345990000000002, 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.434103+0000", 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.434103+0000", 2024-09-11T06:17:28.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.434104+0000", 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6700000000000003e-07 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.434113+0000", 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9460000000000004e-06 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.434133+0000", 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9990999999999999e-05 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.434156+0000", 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3139e-05 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.434218+0000", 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2003999999999998e-05 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.438937+0000", 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047197519999999998 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.c epoch 42/24 rep_tid 321 entries 42'32 (0'0) error 3:3048ccfb:::rbd_data.116d497c8375.00000000000001c5:head by client.4461.0:7616 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 41'29)", 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.436830+0000", 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.23603638699999999, 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048676459999999998, 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.755 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436830+0000", 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436830+0000", 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436831+0000", 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8199999999999999e-07 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436839+0000", 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8979999999999996e-06 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436854+0000", 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5753e-05 2024-09-11T06:17:28.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436867+0000", 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2989999999999999e-05 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.436942+0000", 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4089000000000002e-05 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.441698+0000", 2024-09-11T06:17:28.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047562339999999998 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.6 epoch 42/24 rep_tid 256 entries 42'28 (0'0) error 3:67d2e431:::rbd_data.116d497c8375.00000000000001c4:head by client.4461.0:7615 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 42'26)", 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.437096+0000", 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.23577068900000001, 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046259819999999998, 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.437096+0000", 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.437096+0000", 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.437096+0000", 2024-09-11T06:17:28.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8299999999999996e-07 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.437105+0000", 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2649999999999996e-06 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.437120+0000", 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4888999999999999e-05 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.437130+0000", 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9189999999999994e-06 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.437201+0000", 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1237999999999998e-05 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.441722+0000", 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0045209880000000001 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "pg_update_log_missing(3.c epoch 42/24 rep_tid 323 entries 42'33 (0'0) error 3:34665162:::rbd_data.116d497c8375.00000000000001d4:head by client.4461.0:7628 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 41'30)", 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.439514+0000", 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.23335244799999999, 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052383389999999998, 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.439514+0000", 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.439514+0000", 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.439515+0000", 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.75e-07 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.439522+0000", 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4610000000000002e-06 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.439544+0000", 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1435000000000001e-05 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.439558+0000", 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4338999999999999e-05 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.439612+0000", 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.376e-05 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.444752+0000", 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0051406689999999996 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:28.766 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:28.767 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:28.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:28.768 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:28.767+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:28.868 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:28.868+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:28.872 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:28.872 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:28.872 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:28.872 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:28.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:28.969 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:28.968+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:29.024 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:29.024 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:29.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:29.074 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:29.073+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.f pg_upmap mapping to [7,2] 2024-09-11T06:17:29.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:17:29.171 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:29.170+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:29.183 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:169 3.3 3:c5565208:::rbd_header.116dc3b5629f:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.472579382999999, 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028354740000000002, 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 169 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708934+0000", 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0590000000000001e-06 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708944+0000", 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115999999999999e-05 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708962+0000", 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8501000000000001e-05 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708973+0000", 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.709034+0000", 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0751000000000002e-05 2024-09-11T06:17:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.709039+0000", 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710519+0000", 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014800530000000001 2024-09-11T06:17:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710578+0000", 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9370999999999998e-05 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710812+0000", 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023360199999999999 2024-09-11T06:17:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711346+0000", 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053434000000000001 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711705+0000", 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035856499999999998 2024-09-11T06:17:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711738+0000", 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2817000000000001e-05 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711767+0000", 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9458000000000002e-05 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:444 3.3 3:c5565208:::rbd_header.116dc3b5629f:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.466695712, 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003423368, 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 444 2024-09-11T06:17:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714817+0000", 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9309999999999998e-06 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714824+0000", 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4200000000000004e-06 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714838+0000", 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4171999999999999e-05 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714849+0000", 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1505000000000001e-05 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714910+0000", 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0594999999999998e-05 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714919+0000", 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7180000000000002e-06 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.716614+0000", 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001694936 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.716710+0000", 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6496000000000006e-05 2024-09-11T06:17:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.717111+0000", 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040113200000000001 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.717718+0000", 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060639799999999996 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718151+0000", 2024-09-11T06:17:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043355800000000001 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718205+0000", 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4048999999999997e-05 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718239+0000", 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3457999999999997e-05 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:499 3.15 3:aab7007a:::rbd_data.116dc3b5629f.0000000000000049:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.288021864999999, 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047301069999999999, 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 499 2024-09-11T06:17:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893490+0000", 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893494+0000", 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000001e-06 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893503+0000", 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3719999999999994e-06 2024-09-11T06:17:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893510+0000", 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6800000000000004e-06 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893558+0000", 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8078000000000003e-05 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893683+0000", 2024-09-11T06:17:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012479599999999999 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898219+0000", 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045364539999999997 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:501 3.15 3:ad1ccdb6:::rbd_data.116dc3b5629f.000000000000004b:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.287428802999999, 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042345639999999997, 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 501 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894083+0000", 2024-09-11T06:17:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4399999999999999e-07 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894087+0000", 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4530000000000004e-06 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894098+0000", 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0892e-05 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894105+0000", 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0949999999999998e-06 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894148+0000", 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2330000000000003e-05 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894246+0000", 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7820999999999997e-05 2024-09-11T06:17:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898317+0000", 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040711289999999997 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2339 3.15 3:ab55ab8e:::rbd_data.116dc3b5629f.00000000000000a2:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.8034730900000007, 2024-09-11T06:17:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036876579999999999, 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2339 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378040+0000", 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378047+0000", 2024-09-11T06:17:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378064+0000", 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6490999999999998e-05 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378073+0000", 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0820000000000005e-06 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378152+0000", 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9116999999999995e-05 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378248+0000", 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6522999999999997e-05 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378384+0000", 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013565499999999999 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379558+0000", 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011737169999999999 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381646+0000", 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020887200000000001 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381683+0000", 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6641999999999999e-05 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381726+0000", 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2521999999999997e-05 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2523 3.c 3:3632f484:::rbd_data.116dc3b5629f.0000000000000024:head [set-alloc-hint object_size 1048576 write_size 1048576,write 229064~33080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.5482739859999999, 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029321939999999999, 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2523 2024-09-11T06:17:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633238+0000", 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633255+0000", 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7257000000000001e-05 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633270+0000", 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4884e-05 2024-09-11T06:17:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633278+0000", 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8970000000000008e-06 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633324+0000", 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6300000000000001e-05 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633375+0000", 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0358000000000001e-05 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633462+0000", 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7462999999999999e-05 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.634030+0000", 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056805799999999997 2024-09-11T06:17:29.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636091+0000", 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020603370000000002 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636126+0000", 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4962999999999997e-05 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636169+0000", 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3509e-05 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4980932679999999, 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:17:29.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2562 3.3 e33/24 ondisk, result = 0)", 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4825893689999994, 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074132119999999998, 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698923+0000", 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698928+0000", 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698942+0000", 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4399999999999999e-05 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698953+0000", 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0463e-05 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706238+0000", 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072859140000000001 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706246+0000", 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706335+0000", 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9016000000000003e-05 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2592 3.c 3:37e72c44:::rbd_data.116dc3b5629f.0000000000000051:head [set-alloc-hint object_size 1048576 write_size 1048576,write 610943~44417] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4432893510000007, 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026217329999999998, 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2592 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738223+0000", 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8369999999999999e-06 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738247+0000", 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3178000000000001e-05 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738265+0000", 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8133000000000001e-05 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738273+0000", 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7980000000000006e-06 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738328+0000", 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5597000000000003e-05 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738438+0000", 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010934600000000001 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738543+0000", 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010534100000000001 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.739285+0000", 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074247799999999997 2024-09-11T06:17:29.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740770+0000", 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014848909999999999 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740806+0000", 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5714999999999999e-05 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740843+0000", 2024-09-11T06:17:29.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7419000000000002e-05 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2593 3.15 3:afcf008c:::rbd_data.116dc3b5629f.0000000000000052:head [set-alloc-hint object_size 1048576 write_size 1048576,write 524288~13920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4407560749999995, 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022544399999999999, 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2593 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740756+0000", 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4700000000000001e-07 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740772+0000", 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6396999999999999e-05 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740778+0000", 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2489999999999998e-06 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740783+0000", 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740827+0000", 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4641000000000002e-05 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740876+0000", 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8748999999999997e-05 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740964+0000", 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8577000000000003e-05 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.741455+0000", 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049060399999999995 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.742951+0000", 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014960030000000001 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.742984+0000", 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2842000000000002e-05 2024-09-11T06:17:29.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.743009+0000", 2024-09-11T06:17:29.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5426999999999999e-05 2024-09-11T06:17:29.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.244 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2616 3.c 3:348363dc:::rbd_data.116dc3b5629f.0000000000000098:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4124898189999993, 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024901509999999999, 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2616 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769022+0000", 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-07 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769025+0000", 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2260000000000001e-06 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769033+0000", 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7249999999999997e-06 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769038+0000", 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0900000000000004e-06 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769113+0000", 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5154000000000006e-05 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769209+0000", 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6560999999999999e-05 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769312+0000", 2024-09-11T06:17:29.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102872 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.770316+0000", 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001003531 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771432+0000", 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001116641 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771479+0000", 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6523000000000002e-05 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771511+0000", 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2342999999999998e-05 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.3780970299999993, 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:17:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:17:29.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2651 3.3 e33/24 ondisk, result = 0)", 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1570145969999999, 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031677519999999998, 2024-09-11T06:17:29.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024497+0000", 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5300000000000003e-07 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024500+0000", 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.269e-06 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024511+0000", 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024518+0000", 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.114e-06 2024-09-11T06:17:29.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027574+0000", 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030561249999999998 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027581+0000", 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5080000000000002e-06 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027664+0000", 2024-09-11T06:17:29.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3143e-05 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2691 3.c 3:37e72c44:::rbd_data.116dc3b5629f.0000000000000051:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1048948289999991, 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022947499999999999, 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2691 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076618+0000", 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076624+0000", 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.127e-06 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076641+0000", 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6898e-05 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076648+0000", 2024-09-11T06:17:29.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076716+0000", 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7836999999999994e-05 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076815+0000", 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8825000000000003e-05 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076939+0000", 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012387800000000001 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078187+0000", 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012486050000000001 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078816+0000", 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062893599999999997 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078864+0000", 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7809999999999998e-05 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078911+0000", 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6876999999999999e-05 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2695 3.c 3:3177d100:::rbd_data.116dc3b5629f.0000000000000059:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1048090550000005, 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022989870000000002, 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076705+0000", 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.649e-06 2024-09-11T06:17:29.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076712+0000", 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5880000000000003e-06 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076716+0000", 2024-09-11T06:17:29.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.882e-06 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077215+0000", 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049831500000000004 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077281+0000", 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000003e-05 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:29.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077380+0000", 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9135999999999994e-05 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078397+0000", 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010168589999999999 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078917+0000", 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052007599999999996 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078955+0000", 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7821000000000003e-05 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079001+0000", 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6196999999999998e-05 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.276 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2708 3.15 3:a82ef535:::rbd_data.116dc3b5629f.0000000000000089:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1019524989999994, 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024258830000000002, 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2708 2024-09-11T06:17:29.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079560+0000", 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.111e-06 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079565+0000", 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0690000000000001e-06 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079579+0000", 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4433999999999999e-05 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079587+0000", 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9449999999999993e-06 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079642+0000", 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5220000000000003e-05 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079718+0000", 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079816+0000", 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7684999999999997e-05 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080811+0000", 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099504099999999989 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081866+0000", 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001055194 2024-09-11T06:17:29.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081931+0000", 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455000000000005e-05 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081984+0000", 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3621e-05 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2711 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1015545519999996, 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020553699999999999, 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2711 2024-09-11T06:17:29.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:29.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079957+0000", 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079962+0000", 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.702e-06 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079974+0000", 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1821000000000001e-05 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079981+0000", 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3100000000000003e-06 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080403+0000", 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042168000000000001 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080482+0000", 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9072000000000005e-05 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080660+0000", 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017823599999999999 2024-09-11T06:17:29.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081865+0000", 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012044740000000001 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081884+0000", 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9099000000000001e-05 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081967+0000", 2024-09-11T06:17:29.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3107000000000002e-05 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082012+0000", 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4957999999999999e-05 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7611 3.c 3:37d62a9b:::rbd_data.116d497c8375.00000000000001c0:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.74779737199999996, 2024-09-11T06:17:29.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054268129999999999, 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7611 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433715+0000", 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4300000000000001e-07 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433718+0000", 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9230000000000004e-06 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433729+0000", 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433734+0000", 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6509999999999998e-06 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433789+0000", 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433913+0000", 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123411 2024-09-11T06:17:29.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439140+0000", 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052277319999999997 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7616 3.c 3:3048ccfb:::rbd_data.116d497c8375.00000000000001c5:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.74496620099999999, 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053875420000000004, 2024-09-11T06:17:29.295 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7616 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436546+0000", 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5000000000000002e-07 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436550+0000", 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2590000000000002e-06 2024-09-11T06:17:29.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436558+0000", 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0989999999999999e-06 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436564+0000", 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0939999999999996e-06 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436602+0000", 2024-09-11T06:17:29.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7956e-05 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436671+0000", 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8804000000000001e-05 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.441932+0000", 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052615800000000001 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7628 3.c 3:34665162:::rbd_data.116d497c8375.00000000000001d4:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.74227814400000003, 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057029460000000004, 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7628 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439234+0000", 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1500000000000003e-07 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439239+0000", 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439251+0000", 2024-09-11T06:17:29.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2142e-05 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439260+0000", 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4020000000000008e-06 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439300+0000", 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9578e-05 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439373+0000", 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3716999999999999e-05 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.444936+0000", 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005562338 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.304 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:29.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:29.306 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:29.305+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:29.407 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:29.406+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:29.449 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:29.450 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:29.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:29.544 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:29.543+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:29.603 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:29.603 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:29.603 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:29.603 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:29.603 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:29.609 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:29.608+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:29.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:29.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:29.709+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:29.757 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:29.757 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:29.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:29.757 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:29.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.757 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:29.757 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.286727423000002, 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.033646662000000001, 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468221+0000", 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8980000000000001e-06 2024-09-11T06:17:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468228+0000", 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6199999999999999e-06 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468240+0000", 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.203e-05 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468251+0000", 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1055e-05 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468324+0000", 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2313999999999999e-05 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468333+0000", 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.268e-06 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.498835+0000", 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030502224000000001 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.498990+0000", 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015499700000000001 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.499128+0000", 2024-09-11T06:17:29.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013830599999999999 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.499645+0000", 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051640400000000004 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501797+0000", 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021517260000000001 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501837+0000", 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0229999999999999e-05 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501865+0000", 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8589999999999999e-05 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:29.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.229709163999999, 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070729950000000003, 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 35 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:29.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.75e-07 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525293+0000", 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5958000000000002e-05 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525302+0000", 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525310+0000", 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9910000000000002e-06 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527653+0000", 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023429869999999999 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527703+0000", 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0297000000000003e-05 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527800+0000", 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7048999999999999e-05 2024-09-11T06:17:29.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528893+0000", 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001093105 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532256+0000", 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033627280000000002 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532286+0000", 2024-09-11T06:17:29.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0035e-05 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532310+0000", 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3932000000000001e-05 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:29.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.229624458000004, 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070648619999999999, 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6000000000000003e-07 2024-09-11T06:17:29.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525328+0000", 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3850000000000001e-06 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525335+0000", 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1810000000000004e-06 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525340+0000", 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2360000000000004e-06 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528201+0000", 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028612630000000002 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528257+0000", 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5121999999999998e-05 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528330+0000", 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2988e-05 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528918+0000", 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058871300000000004 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532338+0000", 2024-09-11T06:17:29.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034194070000000002 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532365+0000", 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7203999999999999e-05 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532387+0000", 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1702999999999999e-05 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.229596594, 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097079330000000002, 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 37 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525354+0000", 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1819999999999999e-06 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525365+0000", 2024-09-11T06:17:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0984e-05 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525371+0000", 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528586+0000", 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032157240000000001 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528635+0000", 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8426e-05 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528717+0000", 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2531e-05 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.529194+0000", 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047665199999999999 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.534996+0000", 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058021319999999998 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.535030+0000", 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3841999999999999e-05 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.535057+0000", 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7441e-05 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.879357452000001, 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070818540000000003, 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875593+0000", 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.54e-06 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875600+0000", 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.165e-06 2024-09-11T06:17:29.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875605+0000", 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.702e-06 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880930+0000", 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053258730000000001 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880973+0000", 2024-09-11T06:17:29.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3106999999999999e-05 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881055+0000", 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1613000000000006e-05 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881418+0000", 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000362553 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882579+0000", 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011616700000000001 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882633+0000", 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3494e-05 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882671+0000", 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725000000000002e-05 2024-09-11T06:17:29.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:144 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.537892477, 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007057191, 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217090+0000", 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5488999999999999e-05 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217094+0000", 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0419999999999996e-06 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217097+0000", 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9380000000000001e-06 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217790+0000", 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069392200000000003 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217834+0000", 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3198000000000002e-05 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217906+0000", 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2194999999999996e-05 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218629+0000", 2024-09-11T06:17:29.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072349100000000004 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224059+0000", 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054295790000000003 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224089+0000", 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9886000000000002e-05 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224111+0000", 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2033000000000001e-05 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:145 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.537844358999997, 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070969580000000004, 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 145 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217140+0000", 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8330000000000001e-05 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217144+0000", 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217147+0000", 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218177+0000", 2024-09-11T06:17:29.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010300210000000001 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218228+0000", 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0284999999999997e-05 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218309+0000", 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0990999999999998e-05 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218747+0000", 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043851300000000002 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224139+0000", 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053918730000000002 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224170+0000", 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0605000000000003e-05 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224199+0000", 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9190999999999999e-05 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.079337209000002, 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086769610000000004, 2024-09-11T06:17:29.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 158 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-07 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675636+0000", 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6585999999999999e-05 2024-09-11T06:17:29.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675640+0000", 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675644+0000", 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.155e-06 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678391+0000", 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027472210000000002 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678465+0000", 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3613000000000001e-05 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678587+0000", 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122021 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679562+0000", 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097518400000000003 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684201+0000", 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046387779999999997 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684249+0000", 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8554000000000003e-05 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684286+0000", 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6529000000000002e-05 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.079296546000002, 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087271420000000002, 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 159 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.65e-07 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675652+0000", 2024-09-11T06:17:29.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-06 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675655+0000", 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2899999999999998e-06 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675658+0000", 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6199999999999999e-06 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679082+0000", 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034247219999999998 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679158+0000", 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5807000000000001e-05 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679285+0000", 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012634500000000001 2024-09-11T06:17:29.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679765+0000", 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048002899999999998 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684315+0000", 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045503439999999996 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684354+0000", 2024-09-11T06:17:29.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8575999999999998e-05 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684377+0000", 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3144000000000001e-05 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:227 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.721579+0000", 2024-09-11T06:17:29.813 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.033367104, 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070214429999999996, 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721579+0000", 2024-09-11T06:17:29.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721579+0000", 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721580+0000", 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5499999999999998e-07 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721583+0000", 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6569999999999999e-06 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721590+0000", 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.443e-06 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721594+0000", 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.722854+0000", 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001260178 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.722919+0000", 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5140000000000003e-05 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.723126+0000", 2024-09-11T06:17:29.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020719600000000001 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.724435+0000", 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001309373 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.728552+0000", 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041166079999999999 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.728579+0000", 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7208000000000001e-05 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.728600+0000", 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.126e-05 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:259 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.725613+0000", 2024-09-11T06:17:29.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.029333508000001, 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070389169999999996, 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 259 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725613+0000", 2024-09-11T06:17:29.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725613+0000", 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725613+0000", 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725615+0000", 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725619+0000", 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1779999999999996e-06 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725622+0000", 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:17:29.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.726134+0000", 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051158599999999996 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.726184+0000", 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0832999999999999e-05 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.726392+0000", 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020781099999999999 2024-09-11T06:17:29.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.726879+0000", 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048646300000000002 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732591+0000", 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005712445 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732617+0000", 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6336999999999999e-05 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732652+0000", 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4093e-05 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:274 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.729491+0000", 2024-09-11T06:17:29.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.025455178, 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080249889999999997, 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 274 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729491+0000", 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729491+0000", 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729492+0000", 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5099999999999998e-07 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729497+0000", 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729508+0000", 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1412e-05 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729515+0000", 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7730000000000002e-06 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731304+0000", 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001788942 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731360+0000", 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5569999999999998e-05 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731588+0000", 2024-09-11T06:17:29.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022791 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732670+0000", 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001082625 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737417+0000", 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047472249999999999 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737475+0000", 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7673000000000002e-05 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737516+0000", 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.091e-05 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:275 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.729949+0000", 2024-09-11T06:17:29.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.024996870000001, 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077007610000000004, 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 275 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729949+0000", 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729949+0000", 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729950+0000", 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9999999999999997e-07 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729955+0000", 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0050000000000004e-06 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729963+0000", 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8110000000000003e-06 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729974+0000", 2024-09-11T06:17:29.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.132e-05 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731925+0000", 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019504279999999999 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731969+0000", 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732200+0000", 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231666 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.733696+0000", 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001495595 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737562+0000", 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003866211 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737614+0000", 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2351000000000001e-05 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737650+0000", 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5602999999999998e-05 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.837 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:276 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.730373+0000", 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.024572944000001, 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074003699999999999, 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 276 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730373+0000", 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730373+0000", 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730374+0000", 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6400000000000001e-07 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730378+0000", 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3749999999999996e-06 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730388+0000", 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1649999999999995e-06 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730394+0000", 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1129999999999997e-06 2024-09-11T06:17:29.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.733126+0000", 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002732099 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.733204+0000", 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8150000000000002e-05 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.733446+0000", 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000242112 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.734299+0000", 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085276000000000004 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737697+0000", 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033983059999999998 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737739+0000", 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1696000000000002e-05 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737774+0000", 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4730000000000001e-05 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:375 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:29.843 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.742948+0000", 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.011997776999999, 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070156109999999997, 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 375 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742948+0000", 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742948+0000", 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742949+0000", 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999996e-07 2024-09-11T06:17:29.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742952+0000", 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4599999999999999e-06 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742969+0000", 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6082e-05 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742975+0000", 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2929999999999997e-06 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.744389+0000", 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001414039 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.744442+0000", 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3292999999999999e-05 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.744645+0000", 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020331599999999999 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.745848+0000", 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012029510000000001 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.749870+0000", 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040213849999999997 2024-09-11T06:17:29.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.749927+0000", 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7166000000000001e-05 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.749964+0000", 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7021999999999999e-05 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2494 3.1a 3:59eb9dad:::rbd_data.116dc3b5629f.00000000000000b1:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.573427+0000", 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.18151903, 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.026631734000000001, 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2494 2024-09-11T06:17:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573427+0000", 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573427+0000", 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573428+0000", 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257e-06 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573433+0000", 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573444+0000", 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0961000000000001e-05 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573450+0000", 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3700000000000003e-06 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573498+0000", 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7979999999999998e-05 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573552+0000", 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4453000000000002e-05 2024-09-11T06:17:29.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.577856+0000", 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043034869999999999 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.599940+0000", 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022084553999999999 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.599978+0000", 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7886000000000003e-05 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.600019+0000", 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000001e-05 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.600059+0000", 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9793999999999999e-05 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2494 3.1a e33/24 ondisk, result = 0)", 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.591558+0000", 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.163387898, 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085070849999999993, 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591558+0000", 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591558+0000", 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591559+0000", 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0270000000000001e-06 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591563+0000", 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1200000000000004e-06 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591578+0000", 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4769999999999999e-05 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591587+0000", 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1710000000000008e-06 2024-09-11T06:17:29.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.599965+0000", 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083777460000000002 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.599973+0000", 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9030000000000004e-06 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.600065+0000", 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2348000000000004e-05 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:4626 3.1c 3:3b6bf5c5:::rbd_data.116df69fa911.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:25.217821+0000", 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5371254920000004, 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023441388000000001, 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.860 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4626 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217821+0000", 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217821+0000", 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217823+0000", 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2129999999999998e-06 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217830+0000", 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4540000000000001e-06 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217848+0000", 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7717e-05 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217855+0000", 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-06 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217918+0000", 2024-09-11T06:17:29.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2873000000000006e-05 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.218004+0000", 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6088000000000007e-05 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.221962+0000", 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039584299999999998 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241102+0000", 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019139382 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241141+0000", 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8819999999999998e-05 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241179+0000", 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8084999999999999e-05 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241262+0000", 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3275999999999993e-05 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:4626 3.1c e39/24 ondisk, result = 0)", 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:25.233681+0000", 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5212651939999997, 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075874180000000003, 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233681+0000", 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233681+0000", 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233682+0000", 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3600000000000002e-07 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233685+0000", 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.281e-06 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233697+0000", 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1542999999999999e-05 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233703+0000", 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7150000000000001e-06 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241129+0000", 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074258869999999999 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241137+0000", 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3300000000000001e-06 2024-09-11T06:17:29.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241268+0000", 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013182600000000001 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:4690 3.1c 3:3b6bf5c5:::rbd_data.116df69fa911.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:25.309304+0000", 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4456421840000004, 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015071049, 2024-09-11T06:17:29.870 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4690 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309304+0000", 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309304+0000", 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309305+0000", 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.367e-06 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309312+0000", 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6749999999999996e-06 2024-09-11T06:17:29.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309325+0000", 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3317e-05 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309334+0000", 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2770000000000005e-06 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:29.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309384+0000", 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0492999999999999e-05 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309436+0000", 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2315000000000003e-05 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.311809+0000", 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023728220000000001 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.324245+0000", 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012435681000000001 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.324265+0000", 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9675999999999999e-05 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.324322+0000", 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6943e-05 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:29.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.324375+0000", 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3483000000000003e-05 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:29.876 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:29.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:29.878 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:29.877+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:29.978 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:29.977+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:30.022 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:30.022 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:30.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:30.079 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:30.079+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:30.089 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:17:30.177 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:30.178 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:30.178 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:30.181 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:30.180+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:30.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:30.281 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:30.281+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:30.289 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:114 3.e 3:71ed46f3:::rbd_object_map.116d6cc70d0.0000000000000003:head [writefull 0~49] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.57839736, 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036205959999999998, 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 114 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709653+0000", 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.033e-06 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709668+0000", 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5432999999999999e-05 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709695+0000", 2024-09-11T06:17:30.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6743000000000001e-05 2024-09-11T06:17:30.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709708+0000", 2024-09-11T06:17:30.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3224000000000001e-05 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709781+0000", 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3203999999999999e-05 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709786+0000", 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5249999999999999e-06 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.711855+0000", 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020689440000000001 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.711945+0000", 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0247999999999994e-05 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.712027+0000", 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1848999999999995e-05 2024-09-11T06:17:30.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.712788+0000", 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076103399999999995 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713172+0000", 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038437900000000001 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713225+0000", 2024-09-11T06:17:30.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2729999999999998e-05 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713270+0000", 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5250000000000002e-05 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:341 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1835008~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:30.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.549338058, 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020185530000000002, 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 341 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738720+0000", 2024-09-11T06:17:30.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0738e-05 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738726+0000", 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4339999999999997e-06 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738732+0000", 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4809999999999997e-06 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740558+0000", 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018259719999999999 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740621+0000", 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3230000000000003e-05 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740727+0000", 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106319 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:342 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.549220332999999, 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002047924, 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 342 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738827+0000", 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738831+0000", 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3390000000000001e-06 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738838+0000", 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738843+0000", 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4489999999999998e-06 2024-09-11T06:17:30.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740768+0000", 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001924533 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740812+0000", 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4325e-05 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740874+0000", 2024-09-11T06:17:30.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2544000000000003e-05 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:348 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1966080~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.548360280000001, 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018858169999999999, 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 348 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3499999999999996e-07 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739690+0000", 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0079999999999998e-06 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739697+0000", 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0330000000000003e-06 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739703+0000", 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2090000000000002e-06 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741373+0000", 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016699760000000001 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741456+0000", 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2781999999999994e-05 2024-09-11T06:17:30.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741572+0000", 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011627400000000001 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:349 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 524288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.548211264000001, 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019399529999999999, 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739837+0000", 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.17e-06 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739842+0000", 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.809e-06 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739853+0000", 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569000000000001e-05 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739872+0000", 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8525999999999998e-05 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741611+0000", 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017397090000000001 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741674+0000", 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2652999999999998e-05 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741776+0000", 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101517 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:350 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1310720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:30.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.548140655999999, 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002086142, 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 350 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739907+0000", 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-07 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739910+0000", 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1200000000000002e-06 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739918+0000", 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3180000000000007e-06 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739932+0000", 2024-09-11T06:17:30.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3436e-05 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741807+0000", 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018748689999999999 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741882+0000", 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5042000000000004e-05 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741992+0000", 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011073699999999999 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:351 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.548105725999999, 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022443649999999999, 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 351 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739942+0000", 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739944+0000", 2024-09-11T06:17:30.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739950+0000", 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.314e-06 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739956+0000", 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5999999999999997e-06 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742021+0000", 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020649409999999998 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742097+0000", 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6322000000000006e-05 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742185+0000", 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8244000000000004e-05 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2271 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.03004488, 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012468982999999999, 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271 2024-09-11T06:17:30.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258004+0000", 2024-09-11T06:17:30.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6419999999999999e-06 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258011+0000", 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4599999999999997e-06 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258025+0000", 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3804e-05 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258033+0000", 2024-09-11T06:17:30.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4239999999999993e-06 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258089+0000", 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.588e-05 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258147+0000", 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000002e-05 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.260204+0000", 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020570269999999999 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270393+0000", 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010188657 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270403+0000", 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:17:30.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270437+0000", 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3373e-05 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270471+0000", 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4073999999999999e-05 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2271 3.16 e33/24 ondisk, result = 0)", 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.266389+0000", 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.021657499, 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040086480000000001, 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266389+0000", 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266389+0000", 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266391+0000", 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.263e-06 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266396+0000", 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8289999999999996e-06 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266412+0000", 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5466000000000001e-05 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266421+0000", 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270380+0000", 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039589960000000002 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270388+0000", 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9480000000000008e-06 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270398+0000", 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5580000000000006e-06 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2403 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.846407979, 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018324528999999999, 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2403 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.334 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441640+0000", 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:17:30.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441646+0000", 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441656+0000", 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0257e-05 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441661+0000", 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0549999999999999e-06 2024-09-11T06:17:30.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441710+0000", 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8446999999999999e-05 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441761+0000", 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1060999999999998e-05 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.444470+0000", 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027092539999999999 2024-09-11T06:17:30.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459870+0000", 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015399629 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459881+0000", 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1382e-05 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459926+0000", 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4505000000000002e-05 2024-09-11T06:17:30.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459963+0000", 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7759999999999998e-05 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2403 3.e e33/24 ondisk, result = 0)", 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.453427+0000", 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.834619459000001, 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064472449999999999, 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453427+0000", 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453427+0000", 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453428+0000", 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453432+0000", 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7929999999999999e-06 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453444+0000", 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1960000000000001e-05 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453453+0000", 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5469999999999997e-06 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459858+0000", 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064053189999999996 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459865+0000", 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0550000000000002e-06 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459875+0000", 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6809999999999993e-06 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2416 3.5 3:a294777f:::rbd_data.116dc3b5629f.0000000000000069:head [set-alloc-hint object_size 1048576 write_size 1048576,write 655360~28123] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.470586+0000", 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.817460611, 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028135949999999999, 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2416 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470586+0000", 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470586+0000", 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470588+0000", 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3459999999999999e-06 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470601+0000", 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3657e-05 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470612+0000", 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896e-05 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470619+0000", 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5470000000000002e-06 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470669+0000", 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0509e-05 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470756+0000", 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6658999999999998e-05 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470840+0000", 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4254999999999999e-05 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.471369+0000", 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052851500000000002 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.473327+0000", 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001958128 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.473358+0000", 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1695000000000001e-05 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.473400+0000", 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1387999999999997e-05 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2460 3.e 3:72eb80ea:::rbd_data.116dc3b5629f.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.537366+0000", 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.750681263000001, 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031611019999999998, 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2460 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.349 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537366+0000", 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537366+0000", 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537368+0000", 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2409999999999998e-06 2024-09-11T06:17:30.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537377+0000", 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4860000000000003e-06 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537397+0000", 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9446e-05 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537407+0000", 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0635999999999999e-05 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537471+0000", 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3989e-05 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537556+0000", 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4333999999999996e-05 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.538110+0000", 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055421500000000005 2024-09-11T06:17:30.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.540455+0000", 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023447120000000001 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.540466+0000", 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.116e-05 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.540496+0000", 2024-09-11T06:17:30.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0167000000000001e-05 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.540527+0000", 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0716000000000002e-05 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2543 3.16 3:6ea59b58:::rbd_data.116dc3b5629f.00000000000000c4:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.661704+0000", 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.62634291, 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018977480000000001, 2024-09-11T06:17:30.354 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2543 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661704+0000", 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661704+0000", 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661704+0000", 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661708+0000", 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2150000000000001e-06 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661716+0000", 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9400000000000002e-06 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661722+0000", 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.241e-06 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.662464+0000", 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074192699999999997 2024-09-11T06:17:30.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.662538+0000", 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3858999999999999e-05 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.662635+0000", 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7478000000000004e-05 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.663184+0000", 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054853300000000003 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.663533+0000", 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034914100000000002 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.663566+0000", 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2879999999999997e-05 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.663602+0000", 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6025000000000002e-05 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2607 3.5 3:a3a676bb:::rbd_data.116dc3b5629f.00000000000000e3:head [set-alloc-hint object_size 1048576 write_size 1048576,write 917504~10842] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.755346+0000", 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.532701077, 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029452979999999998, 2024-09-11T06:17:30.360 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2607 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755346+0000", 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755346+0000", 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755347+0000", 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2950000000000001e-06 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755356+0000", 2024-09-11T06:17:30.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0790000000000007e-06 2024-09-11T06:17:30.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755367+0000", 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1144999999999999e-05 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755373+0000", 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3859999999999998e-06 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755418+0000", 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4962000000000001e-05 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755469+0000", 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1306e-05 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755559+0000", 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0468000000000002e-05 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.756145+0000", 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058586800000000002 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.758200+0000", 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020547439999999998 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.758250+0000", 2024-09-11T06:17:30.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9926000000000003e-05 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.758291+0000", 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1118999999999997e-05 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2621 3.5 3:a3a676bb:::rbd_data.116dc3b5629f.00000000000000e3:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.769069+0000", 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.518977870000001, 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023916340000000001, 2024-09-11T06:17:30.367 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2621 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769069+0000", 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769069+0000", 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769069+0000", 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000001e-07 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769075+0000", 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-11T06:17:30.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769081+0000", 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6930000000000004e-06 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769084+0000", 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9809999999999999e-06 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769144+0000", 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9548e-05 2024-09-11T06:17:30.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769223+0000", 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9537999999999996e-05 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769324+0000", 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100504 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.770026+0000", 2024-09-11T06:17:30.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070187699999999995 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771388+0000", 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001362343 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771435+0000", 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7030999999999997e-05 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771461+0000", 2024-09-11T06:17:30.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5588999999999998e-05 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2704 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079196+0000", 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.208850363, 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002773845, 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2704 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079196+0000", 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079196+0000", 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079197+0000", 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079201+0000", 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9110000000000003e-06 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079211+0000", 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0008e-05 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079218+0000", 2024-09-11T06:17:30.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0720000000000002e-06 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079428+0000", 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000209934 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079512+0000", 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4299e-05 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079641+0000", 2024-09-11T06:17:30.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012843199999999999 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080491+0000", 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085044500000000002 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081873+0000", 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013821619999999999 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081931+0000", 2024-09-11T06:17:30.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7797000000000002e-05 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081970+0000", 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9150000000000003e-05 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2705 3.e 3:72eb80ea:::rbd_data.116dc3b5629f.0000000000000070:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079340+0000", 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.208706648, 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027571290000000001, 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2705 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079340+0000", 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079340+0000", 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079341+0000", 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1699999999999997e-07 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079344+0000", 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.45e-06 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079353+0000", 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3999999999999992e-06 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079357+0000", 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5589999999999999e-06 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079894+0000", 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053666300000000005 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079974+0000", 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0519000000000006e-05 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080075+0000", 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010006899999999999 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080935+0000", 2024-09-11T06:17:30.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00086062200000000001 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082021+0000", 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010858930000000001 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082066+0000", 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4634e-05 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082097+0000", 2024-09-11T06:17:30.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1603000000000002e-05 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7596 3.5 3:a3f8e3c9:::rbd_data.116d497c8375.0000000000000166:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.430370+0000", 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.8576767379999999, 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033356430000000001, 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7596 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430370+0000", 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430370+0000", 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430372+0000", 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-06 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430378+0000", 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9089999999999997e-06 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430393+0000", 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5724000000000001e-05 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430401+0000", 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5159999999999997e-06 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430472+0000", 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1079000000000002e-05 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430602+0000", 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130345 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433706+0000", 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031035530000000002 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7696 3.5 3:a1e89456:::rbd_data.116d497c8375.000000000000007a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.491616+0000", 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7964309250000001, 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003477075, 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:30.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7696 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491616+0000", 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491616+0000", 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491618+0000", 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.699e-06 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491625+0000", 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8620000000000003e-06 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491640+0000", 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4824000000000001e-05 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491647+0000", 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.024e-06 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491698+0000", 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0791000000000002e-05 2024-09-11T06:17:30.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491840+0000", 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000141676 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.492459+0000", 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061961999999999998 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.495007+0000", 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002547896 2024-09-11T06:17:30.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.495018+0000", 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0444e-05 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.495047+0000", 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.495093+0000", 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6136e-05 2024-09-11T06:17:30.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:30.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:30.394 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:30.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:30.396 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:30.395+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:30.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:30.497 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:30.496+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:30.543 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:30.543 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:30.543 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:30.543 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:30.553 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:30.559 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:30.560 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:30.576 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:30.577 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:30.592 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:30.597 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:30.596+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:30.609 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:30.626 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:30.626 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:30.643 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:30.658 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:30.658 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:30.660 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:30.661 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:30.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:30.678 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:30.730 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:30.730+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:30.782 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:30.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:30.833 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:30.832+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:30.900 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:30.899+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:30.907 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:30.908 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:30.916 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:31.001 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:31.001+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:31.020 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:31.020 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:31.028 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:31.102 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:31.101+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:31.132 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:31.132 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:31.143 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:31.202 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:31.202+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:31.287 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:31.287 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:31.298 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:31.303 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:31.302+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:31.404 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:31.403+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:31.442 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:31.442 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:31.454 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:31.504 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:31.504+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:31.605 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:31.604+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:31.618 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:31.618 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:31.628 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:31.711 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:31.711+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:31.770 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:31.770 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:31.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:31.807 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:31.807+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:31.908 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:31.908+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:31.920 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:31.920 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:31.929 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:32.012 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:32.009+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:32.032 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:32.032 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:32.041 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:32.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:17:32.151 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:32.150+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:32.187 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:32.188 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:32.195 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:32.211 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:32.210+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:32.247 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-11T06:17:32.300 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:32.300 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:32.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:32.311 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:32.310+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:32.412 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:32.412 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:32.413 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:32.412+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:32.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:32.514 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:32.513+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:1408 writesame 0xaec69a8 thru 0xaec71d6 data_size 0x1(0x82f bytes) 2024-09-11T06:17:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:1409 write 0x472612e thru 0x4734d47 (0xec1a bytes) 2024-09-11T06:17:32.524 INFO:teuthology.orchestra.run.smithi070.stdout:1410 write 0x44ed619 thru 0x44f0ac9 (0x34b1 bytes) 2024-09-11T06:17:32.528 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.534 INFO:teuthology.orchestra.run.smithi070.stdout:1413 write 0xb6d57eb thru 0xb6da4c0 (0x4cd6 bytes) 2024-09-11T06:17:32.535 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:32.536 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:32.537 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.538 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.538 INFO:teuthology.orchestra.run.smithi070.stdout:1418 punch from 0x8dd5b9e to 0x8dda5ad, (0x4a0f bytes) 2024-09-11T06:17:32.538 INFO:teuthology.orchestra.run.smithi070.stdout:1419 punch from 0x3ec0c44 to 0x3eca52a, (0x98e6 bytes) 2024-09-11T06:17:32.538 INFO:teuthology.orchestra.run.smithi070.stdout:1420 write 0x80990e6 thru 0x80a0ba4 (0x7abf bytes) 2024-09-11T06:17:32.541 INFO:teuthology.orchestra.run.smithi070.stdout:1421 read 0xa143ea1 thru 0xa14af6b (0x70cb bytes) 2024-09-11T06:17:32.541 INFO:teuthology.orchestra.run.smithi070.stdout:1423 read 0xaafaf93 thru 0xaaffab0 (0x4b1e bytes) 2024-09-11T06:17:32.541 INFO:teuthology.orchestra.run.smithi070.stdout:1424 write 0x3962874 thru 0x3967572 (0x4cff bytes) 2024-09-11T06:17:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:1427 write 0x2636c6c thru 0x263ddea (0x717f bytes) 2024-09-11T06:17:32.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:32.556 INFO:teuthology.orchestra.run.smithi070.stdout:1428 trunc from 0xb6da4c1 to 0x462e870 2024-09-11T06:17:32.582 INFO:teuthology.orchestra.run.smithi070.stdout:1429 read 0x6f3284 thru 0x6f9114 (0x5e91 bytes) 2024-09-11T06:17:32.600 INFO:teuthology.orchestra.run.smithi070.stdout:1431 write 0xea7a29a thru 0xea7e63f (0x43a6 bytes) 2024-09-11T06:17:32.604 INFO:teuthology.orchestra.run.smithi070.stdout:1433 writesame 0x620b6df thru 0x620e968 data_size 0x1(0x328a bytes) 2024-09-11T06:17:32.610 INFO:teuthology.orchestra.run.smithi070.stdout:1434 write 0x777c75e thru 0x777da5c (0x12ff bytes) 2024-09-11T06:17:32.613 INFO:teuthology.orchestra.run.smithi070.stdout:1435 punch from 0xa7280da to 0xa72b1d1, (0x30f7 bytes) 2024-09-11T06:17:32.613 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.614 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:32.614+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:32.627 INFO:teuthology.orchestra.run.smithi070.stdout:1440 trunc from 0xea7e640 to 0x312884f 2024-09-11T06:17:32.660 INFO:teuthology.orchestra.run.smithi070.stdout:1441 write 0xc7eb45f thru 0xc7f50a0 (0x9c42 bytes) 2024-09-11T06:17:32.665 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.665 INFO:teuthology.orchestra.run.smithi070.stdout:1443 write 0x6bcf00f thru 0x6bd7e18 (0x8e0a bytes) 2024-09-11T06:17:32.668 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.668 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.668 INFO:teuthology.orchestra.run.smithi070.stdout:1447 write 0x18b4baa thru 0x18c4afe (0xff55 bytes) 2024-09-11T06:17:32.672 INFO:teuthology.orchestra.run.smithi070.stdout:1448 read 0x266a471 thru 0x2671143 (0x6cd3 bytes) 2024-09-11T06:17:32.672 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.672 INFO:teuthology.orchestra.run.smithi070.stdout:1450 write 0x6933e39 thru 0x693f695 (0xb85d bytes) 2024-09-11T06:17:32.683 INFO:teuthology.orchestra.run.smithi070.stdout:1452 write 0xd4b0aa0 thru 0xd4b7c36 (0x7197 bytes) 2024-09-11T06:17:32.686 INFO:teuthology.orchestra.run.smithi070.stdout:1453 read 0x1c1c1d1 thru 0x1c1d60e (0x143e bytes) 2024-09-11T06:17:32.686 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:32.686 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:32.687 INFO:teuthology.orchestra.run.smithi070.stdout:1454 write 0x983a9d thru 0x99218c (0xe6f0 bytes) 2024-09-11T06:17:32.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:32.691 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:32.691 INFO:teuthology.orchestra.run.smithi070.stdout:1456 read 0xb40fd61 thru 0xb414e6f (0x510f bytes) 2024-09-11T06:17:32.691 INFO:teuthology.orchestra.run.smithi070.stdout:1458 read 0x599ca6b thru 0x59a5305 (0x889b bytes) 2024-09-11T06:17:32.691 INFO:teuthology.orchestra.run.smithi070.stdout:1459 clone 5 order 21 su 8192 sc 9 2024-09-11T06:17:32.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:32.715 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:32.715+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:32.816 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:32.816+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:32.825 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:32.826 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:32.858 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:32.859 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:169 3.3 3:c5565208:::rbd_header.116dc3b5629f:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.163042904000001, 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028354740000000002, 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 169 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708932+0000", 2024-09-11T06:17:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708934+0000", 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0590000000000001e-06 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708944+0000", 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0115999999999999e-05 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708962+0000", 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8501000000000001e-05 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.708973+0000", 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1167e-05 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.709034+0000", 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0751000000000002e-05 2024-09-11T06:17:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.709039+0000", 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710519+0000", 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014800530000000001 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710578+0000", 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9370999999999998e-05 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.710812+0000", 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023360199999999999 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711346+0000", 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053434000000000001 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711705+0000", 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035856499999999998 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711738+0000", 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2817000000000001e-05 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.711767+0000", 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9458000000000002e-05 2024-09-11T06:17:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:444 3.3 3:c5565208:::rbd_header.116dc3b5629f:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.157159233000002, 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003423368, 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 444 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714817+0000", 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9309999999999998e-06 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714824+0000", 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4200000000000004e-06 2024-09-11T06:17:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714838+0000", 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4171999999999999e-05 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714849+0000", 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1505000000000001e-05 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714910+0000", 2024-09-11T06:17:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0594999999999998e-05 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714919+0000", 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7180000000000002e-06 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.716614+0000", 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001694936 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.716710+0000", 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6496000000000006e-05 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.717111+0000", 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040113200000000001 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.717718+0000", 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060639799999999996 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718151+0000", 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043355800000000001 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718205+0000", 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4048999999999997e-05 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718239+0000", 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3457999999999997e-05 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:499 3.15 3:aab7007a:::rbd_data.116dc3b5629f.0000000000000049:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.978485385999999, 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047301069999999999, 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 499 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893490+0000", 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893494+0000", 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000001e-06 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893503+0000", 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3719999999999994e-06 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893510+0000", 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6800000000000004e-06 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893558+0000", 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8078000000000003e-05 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893683+0000", 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012479599999999999 2024-09-11T06:17:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898219+0000", 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045364539999999997 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:501 3.15 3:ad1ccdb6:::rbd_data.116dc3b5629f.000000000000004b:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.977892324000001, 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042345639999999997, 2024-09-11T06:17:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 501 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894083+0000", 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4399999999999999e-07 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894087+0000", 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4530000000000004e-06 2024-09-11T06:17:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894098+0000", 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0892e-05 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894105+0000", 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0949999999999998e-06 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894148+0000", 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2330000000000003e-05 2024-09-11T06:17:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894246+0000", 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7820999999999997e-05 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898317+0000", 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040711289999999997 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2339 3.15 3:ab55ab8e:::rbd_data.116dc3b5629f.00000000000000a2:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.493936611000001, 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036876579999999999, 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2339 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378040+0000", 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T06:17:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378047+0000", 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378064+0000", 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6490999999999998e-05 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378073+0000", 2024-09-11T06:17:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0820000000000005e-06 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378152+0000", 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9116999999999995e-05 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378248+0000", 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6522999999999997e-05 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378384+0000", 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013565499999999999 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379558+0000", 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011737169999999999 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381646+0000", 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020887200000000001 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381683+0000", 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6641999999999999e-05 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381726+0000", 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2521999999999997e-05 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2523 3.c 3:3632f484:::rbd_data.116dc3b5629f.0000000000000024:head [set-alloc-hint object_size 1048576 write_size 1048576,write 229064~33080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.238737507, 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029321939999999999, 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2523 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633237+0000", 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633238+0000", 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633255+0000", 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7257000000000001e-05 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633270+0000", 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4884e-05 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633278+0000", 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8970000000000008e-06 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633324+0000", 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6300000000000001e-05 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633375+0000", 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0358000000000001e-05 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.633462+0000", 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7462999999999999e-05 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.634030+0000", 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056805799999999997 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636091+0000", 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020603370000000002 2024-09-11T06:17:32.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636126+0000", 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4962999999999997e-05 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.636169+0000", 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3509e-05 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.188556789, 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:17:32.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:17:32.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2562 3.3 e33/24 ondisk, result = 0)", 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.173052889999999, 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074132119999999998, 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698923+0000", 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698928+0000", 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:17:32.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698942+0000", 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4399999999999999e-05 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698953+0000", 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0463e-05 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706238+0000", 2024-09-11T06:17:32.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072859140000000001 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706246+0000", 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706335+0000", 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9016000000000003e-05 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2592 3.c 3:37e72c44:::rbd_data.116dc3b5629f.0000000000000051:head [set-alloc-hint object_size 1048576 write_size 1048576,write 610943~44417] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.133752872000001, 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026217329999999998, 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2592 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738222+0000", 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738223+0000", 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8369999999999999e-06 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738247+0000", 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3178000000000001e-05 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738265+0000", 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8133000000000001e-05 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738273+0000", 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7980000000000006e-06 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738328+0000", 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5597000000000003e-05 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738438+0000", 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010934600000000001 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.738543+0000", 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010534100000000001 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.739285+0000", 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074247799999999997 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740770+0000", 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014848909999999999 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740806+0000", 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5714999999999999e-05 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740843+0000", 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7419000000000002e-05 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.924 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2593 3.15 3:afcf008c:::rbd_data.116dc3b5629f.0000000000000052:head [set-alloc-hint object_size 1048576 write_size 1048576,write 524288~13920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.131219595999999, 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022544399999999999, 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2593 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740755+0000", 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740756+0000", 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4700000000000001e-07 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740772+0000", 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6396999999999999e-05 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740778+0000", 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2489999999999998e-06 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740783+0000", 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2039999999999999e-06 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740827+0000", 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4641000000000002e-05 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740876+0000", 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8748999999999997e-05 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.740964+0000", 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8577000000000003e-05 2024-09-11T06:17:32.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.741455+0000", 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049060399999999995 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.742951+0000", 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014960030000000001 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.742984+0000", 2024-09-11T06:17:32.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2842000000000002e-05 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.743009+0000", 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5426999999999999e-05 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2616 3.c 3:348363dc:::rbd_data.116dc3b5629f.0000000000000098:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.102953339999999, 2024-09-11T06:17:32.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024901509999999999, 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2616 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769021+0000", 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769022+0000", 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-07 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769025+0000", 2024-09-11T06:17:32.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2260000000000001e-06 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769033+0000", 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7249999999999997e-06 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769038+0000", 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0900000000000004e-06 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769113+0000", 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5154000000000006e-05 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769209+0000", 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6560999999999999e-05 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769312+0000", 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102872 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.770316+0000", 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001003531 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771432+0000", 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001116641 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771479+0000", 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6523000000000002e-05 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771511+0000", 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2342999999999998e-05 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.068560550999999, 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:17:32.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:17:32.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2651 3.3 e33/24 ondisk, result = 0)", 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.847478118, 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031677519999999998, 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024496+0000", 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024497+0000", 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5300000000000003e-07 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024500+0000", 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.269e-06 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024511+0000", 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.024518+0000", 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.114e-06 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027574+0000", 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030561249999999998 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027581+0000", 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5080000000000002e-06 2024-09-11T06:17:32.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027664+0000", 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3143e-05 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2691 3.c 3:37e72c44:::rbd_data.116dc3b5629f.0000000000000051:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.795358350000001, 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022947499999999999, 2024-09-11T06:17:32.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2691 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076616+0000", 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076618+0000", 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076624+0000", 2024-09-11T06:17:32.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.127e-06 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076641+0000", 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6898e-05 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076648+0000", 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076716+0000", 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7836999999999994e-05 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076815+0000", 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8825000000000003e-05 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076939+0000", 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012387800000000001 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078187+0000", 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012486050000000001 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078816+0000", 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062893599999999997 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078864+0000", 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7809999999999998e-05 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078911+0000", 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6876999999999999e-05 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2695 3.c 3:3177d100:::rbd_data.116dc3b5629f.0000000000000059:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.795272576, 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022989870000000002, 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076702+0000", 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076705+0000", 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.649e-06 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076712+0000", 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5880000000000003e-06 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.076716+0000", 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.882e-06 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077215+0000", 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049831500000000004 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077281+0000", 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6030000000000003e-05 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.077380+0000", 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9135999999999994e-05 2024-09-11T06:17:32.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078397+0000", 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010168589999999999 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078917+0000", 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052007599999999996 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.078955+0000", 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7821000000000003e-05 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079001+0000", 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6196999999999998e-05 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2708 3.15 3:a82ef535:::rbd_data.116dc3b5629f.0000000000000089:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:32.958 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.792416019999999, 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024258830000000002, 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2708 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:32.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079558+0000", 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079560+0000", 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.111e-06 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079565+0000", 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0690000000000001e-06 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079579+0000", 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4433999999999999e-05 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079587+0000", 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9449999999999993e-06 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079642+0000", 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5220000000000003e-05 2024-09-11T06:17:32.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079718+0000", 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079816+0000", 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7684999999999997e-05 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080811+0000", 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00099504099999999989 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081866+0000", 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001055194 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081931+0000", 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455000000000005e-05 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081984+0000", 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3621e-05 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2711 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.792018072999999, 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020553699999999999, 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2711 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079956+0000", 2024-09-11T06:17:32.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079957+0000", 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079962+0000", 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.702e-06 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079974+0000", 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1821000000000001e-05 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079981+0000", 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3100000000000003e-06 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080403+0000", 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042168000000000001 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080482+0000", 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9072000000000005e-05 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080660+0000", 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017823599999999999 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081865+0000", 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012044740000000001 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081884+0000", 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9099000000000001e-05 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081967+0000", 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3107000000000002e-05 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082012+0000", 2024-09-11T06:17:32.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4957999999999999e-05 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7611 3.c 3:37d62a9b:::rbd_data.116d497c8375.00000000000001c0:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4382608929999998, 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054268129999999999, 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:32.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7611 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433715+0000", 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4300000000000001e-07 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433718+0000", 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9230000000000004e-06 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433729+0000", 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433734+0000", 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6509999999999998e-06 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433789+0000", 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-11T06:17:32.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433913+0000", 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123411 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439140+0000", 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052277319999999997 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7616 3.c 3:3048ccfb:::rbd_data.116d497c8375.00000000000001c5:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4354297220000003, 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053875420000000004, 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7616 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.976 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436546+0000", 2024-09-11T06:17:32.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5000000000000002e-07 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436550+0000", 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2590000000000002e-06 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436558+0000", 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0989999999999999e-06 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436564+0000", 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0939999999999996e-06 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436602+0000", 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7956e-05 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436671+0000", 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8804000000000001e-05 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.441932+0000", 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052615800000000001 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7628 3.c 3:34665162:::rbd_data.116d497c8375.00000000000001d4:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.432741665, 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057029460000000004, 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:32.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7628 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439234+0000", 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1500000000000003e-07 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439239+0000", 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:17:32.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439251+0000", 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2142e-05 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439260+0000", 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4020000000000008e-06 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439300+0000", 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9578e-05 2024-09-11T06:17:32.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439373+0000", 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3716999999999999e-05 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.444936+0000", 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005562338 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:32.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:32.985 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:32.985 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:32.986 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:32.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:32.987 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:32.987 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:32.988 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:32.988 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:32.989 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:32.989 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:32.989 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:32.990 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:32.985+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:33.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:33.086+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:33.130 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:33.130 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:33.139 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:17:33.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:33.197 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:33.196+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:33.247 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:33.248 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:33.256 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:33.298 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:33.297+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:33.390 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:33.389+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:33.402 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:33.402 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:33.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:33.403 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:33.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:33.403 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:33.403 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.931411724999997, 2024-09-11T06:17:33.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.033646662000000001, 2024-09-11T06:17:33.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:33.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.405 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:33.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468219+0000", 2024-09-11T06:17:33.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468221+0000", 2024-09-11T06:17:33.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8980000000000001e-06 2024-09-11T06:17:33.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468228+0000", 2024-09-11T06:17:33.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6199999999999999e-06 2024-09-11T06:17:33.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468240+0000", 2024-09-11T06:17:33.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.203e-05 2024-09-11T06:17:33.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468251+0000", 2024-09-11T06:17:33.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1055e-05 2024-09-11T06:17:33.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468324+0000", 2024-09-11T06:17:33.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2313999999999999e-05 2024-09-11T06:17:33.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:33.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.468333+0000", 2024-09-11T06:17:33.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.268e-06 2024-09-11T06:17:33.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.498835+0000", 2024-09-11T06:17:33.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030502224000000001 2024-09-11T06:17:33.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.498990+0000", 2024-09-11T06:17:33.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015499700000000001 2024-09-11T06:17:33.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.499128+0000", 2024-09-11T06:17:33.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013830599999999999 2024-09-11T06:17:33.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.499645+0000", 2024-09-11T06:17:33.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051640400000000004 2024-09-11T06:17:33.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501797+0000", 2024-09-11T06:17:33.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021517260000000001 2024-09-11T06:17:33.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501837+0000", 2024-09-11T06:17:33.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0229999999999999e-05 2024-09-11T06:17:33.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.501865+0000", 2024-09-11T06:17:33.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8589999999999999e-05 2024-09-11T06:17:33.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.417 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.417 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:33.418 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:33.418 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.874393466000001, 2024-09-11T06:17:33.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070729950000000003, 2024-09-11T06:17:33.418 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 35 2024-09-11T06:17:33.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.419 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:33.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:33.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525237+0000", 2024-09-11T06:17:33.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.75e-07 2024-09-11T06:17:33.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525293+0000", 2024-09-11T06:17:33.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5958000000000002e-05 2024-09-11T06:17:33.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525302+0000", 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525310+0000", 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9910000000000002e-06 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527653+0000", 2024-09-11T06:17:33.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023429869999999999 2024-09-11T06:17:33.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527703+0000", 2024-09-11T06:17:33.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0297000000000003e-05 2024-09-11T06:17:33.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.527800+0000", 2024-09-11T06:17:33.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7048999999999999e-05 2024-09-11T06:17:33.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528893+0000", 2024-09-11T06:17:33.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001093105 2024-09-11T06:17:33.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532256+0000", 2024-09-11T06:17:33.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033627280000000002 2024-09-11T06:17:33.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532286+0000", 2024-09-11T06:17:33.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0035e-05 2024-09-11T06:17:33.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532310+0000", 2024-09-11T06:17:33.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3932000000000001e-05 2024-09-11T06:17:33.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.874308759999998, 2024-09-11T06:17:33.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070648619999999999, 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 36 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:33.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525322+0000", 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6000000000000003e-07 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525328+0000", 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3850000000000001e-06 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525335+0000", 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1810000000000004e-06 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525340+0000", 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2360000000000004e-06 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528201+0000", 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028612630000000002 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528257+0000", 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5121999999999998e-05 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528330+0000", 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2988e-05 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528918+0000", 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058871300000000004 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532338+0000", 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034194070000000002 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532365+0000", 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7203999999999999e-05 2024-09-11T06:17:33.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.532387+0000", 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1702999999999999e-05 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.874280896000002, 2024-09-11T06:17:33.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097079330000000002, 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 37 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525350+0000", 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525354+0000", 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1819999999999999e-06 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525365+0000", 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0984e-05 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.525371+0000", 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5029999999999997e-06 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528586+0000", 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032157240000000001 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528635+0000", 2024-09-11T06:17:33.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8426e-05 2024-09-11T06:17:33.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.528717+0000", 2024-09-11T06:17:33.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2531e-05 2024-09-11T06:17:33.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.529194+0000", 2024-09-11T06:17:33.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047665199999999999 2024-09-11T06:17:33.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.534996+0000", 2024-09-11T06:17:33.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058021319999999998 2024-09-11T06:17:33.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.535030+0000", 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3841999999999999e-05 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.535057+0000", 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7441e-05 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.524041754000002, 2024-09-11T06:17:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070818540000000003, 2024-09-11T06:17:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 117 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875589+0000", 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875593+0000", 2024-09-11T06:17:33.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.54e-06 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875600+0000", 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.165e-06 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.875605+0000", 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.702e-06 2024-09-11T06:17:33.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880930+0000", 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053258730000000001 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.880973+0000", 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3106999999999999e-05 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881055+0000", 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1613000000000006e-05 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.881418+0000", 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000362553 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882579+0000", 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011616700000000001 2024-09-11T06:17:33.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882633+0000", 2024-09-11T06:17:33.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3494e-05 2024-09-11T06:17:33.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:53.882671+0000", 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725000000000002e-05 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:144 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.182576779000001, 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007057191, 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:33.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217054+0000", 2024-09-11T06:17:33.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:17:33.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217090+0000", 2024-09-11T06:17:33.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5488999999999999e-05 2024-09-11T06:17:33.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217094+0000", 2024-09-11T06:17:33.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0419999999999996e-06 2024-09-11T06:17:33.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217097+0000", 2024-09-11T06:17:33.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9380000000000001e-06 2024-09-11T06:17:33.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217790+0000", 2024-09-11T06:17:33.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069392200000000003 2024-09-11T06:17:33.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217834+0000", 2024-09-11T06:17:33.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3198000000000002e-05 2024-09-11T06:17:33.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217906+0000", 2024-09-11T06:17:33.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2194999999999996e-05 2024-09-11T06:17:33.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218629+0000", 2024-09-11T06:17:33.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072349100000000004 2024-09-11T06:17:33.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224059+0000", 2024-09-11T06:17:33.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054295790000000003 2024-09-11T06:17:33.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224089+0000", 2024-09-11T06:17:33.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9886000000000002e-05 2024-09-11T06:17:33.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224111+0000", 2024-09-11T06:17:33.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2033000000000001e-05 2024-09-11T06:17:33.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:145 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-11T06:17:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.182528660999999, 2024-09-11T06:17:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070969580000000004, 2024-09-11T06:17:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 145 2024-09-11T06:17:33.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.465 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:33.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:33.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217102+0000", 2024-09-11T06:17:33.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:17:33.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217140+0000", 2024-09-11T06:17:33.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8330000000000001e-05 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217144+0000", 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.217147+0000", 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218177+0000", 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010300210000000001 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218228+0000", 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0284999999999997e-05 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218309+0000", 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0990999999999998e-05 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.218747+0000", 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043851300000000002 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224139+0000", 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053918730000000002 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224170+0000", 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0605000000000003e-05 2024-09-11T06:17:33.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.224199+0000", 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9190999999999999e-05 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.724021510999997, 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086769610000000004, 2024-09-11T06:17:33.472 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 158 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675609+0000", 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-07 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675636+0000", 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6585999999999999e-05 2024-09-11T06:17:33.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675640+0000", 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675644+0000", 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.155e-06 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678391+0000", 2024-09-11T06:17:33.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027472210000000002 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678465+0000", 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3613000000000001e-05 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.678587+0000", 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122021 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679562+0000", 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097518400000000003 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684201+0000", 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046387779999999997 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684249+0000", 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8554000000000003e-05 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684286+0000", 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6529000000000002e-05 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4181.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.723980847999997, 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087271420000000002, 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4181", 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/227847653", 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 159 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:33.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675650+0000", 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.65e-07 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675652+0000", 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-06 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675655+0000", 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2899999999999998e-06 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.675658+0000", 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6199999999999999e-06 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679082+0000", 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034247219999999998 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679158+0000", 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5807000000000001e-05 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679285+0000", 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012634500000000001 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.679765+0000", 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048002899999999998 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684315+0000", 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045503439999999996 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684354+0000", 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8575999999999998e-05 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:54.684377+0000", 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3144000000000001e-05 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:227 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.721579+0000", 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.678051406000002, 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070214429999999996, 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721579+0000", 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721579+0000", 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721580+0000", 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5499999999999998e-07 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721583+0000", 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6569999999999999e-06 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721590+0000", 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.443e-06 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.721594+0000", 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7249999999999999e-06 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.722854+0000", 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001260178 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.722919+0000", 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5140000000000003e-05 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.723126+0000", 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020719600000000001 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.724435+0000", 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001309373 2024-09-11T06:17:33.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.728552+0000", 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041166079999999999 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.728579+0000", 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7208000000000001e-05 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.728600+0000", 2024-09-11T06:17:33.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.126e-05 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:259 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.725613+0000", 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.674017809999999, 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070389169999999996, 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 259 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725613+0000", 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725613+0000", 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725613+0000", 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725615+0000", 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8470000000000001e-06 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725619+0000", 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1779999999999996e-06 2024-09-11T06:17:33.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.725622+0000", 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.726134+0000", 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051158599999999996 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.726184+0000", 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0832999999999999e-05 2024-09-11T06:17:33.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.726392+0000", 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020781099999999999 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.726879+0000", 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048646300000000002 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732591+0000", 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005712445 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732617+0000", 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6336999999999999e-05 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732652+0000", 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4093e-05 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:274 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.729491+0000", 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.67013948, 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080249889999999997, 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 274 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.496 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729491+0000", 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729491+0000", 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729492+0000", 2024-09-11T06:17:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5099999999999998e-07 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729497+0000", 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729508+0000", 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1412e-05 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729515+0000", 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7730000000000002e-06 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731304+0000", 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001788942 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731360+0000", 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5569999999999998e-05 2024-09-11T06:17:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731588+0000", 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022791 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732670+0000", 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001082625 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737417+0000", 2024-09-11T06:17:33.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047472249999999999 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737475+0000", 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7673000000000002e-05 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737516+0000", 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.091e-05 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:275 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.729949+0000", 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.669681172000001, 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077007610000000004, 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 275 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.502 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729949+0000", 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729949+0000", 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729950+0000", 2024-09-11T06:17:33.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9999999999999997e-07 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729955+0000", 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0050000000000004e-06 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729963+0000", 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8110000000000003e-06 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.729974+0000", 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.132e-05 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731925+0000", 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019504279999999999 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.731969+0000", 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070999999999999e-05 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.732200+0000", 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000231666 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.733696+0000", 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001495595 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737562+0000", 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003866211 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737614+0000", 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2351000000000001e-05 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737650+0000", 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5602999999999998e-05 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.507 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:276 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.730373+0000", 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.669257246000001, 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074003699999999999, 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 276 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730373+0000", 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730373+0000", 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730374+0000", 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6400000000000001e-07 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730378+0000", 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3749999999999996e-06 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730388+0000", 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1649999999999995e-06 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.730394+0000", 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1129999999999997e-06 2024-09-11T06:17:33.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.733126+0000", 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002732099 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.733204+0000", 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8150000000000002e-05 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.733446+0000", 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000242112 2024-09-11T06:17:33.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.734299+0000", 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085276000000000004 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737697+0000", 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033983059999999998 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737739+0000", 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1696000000000002e-05 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.737774+0000", 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4730000000000001e-05 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:375 3.1a 3:5891e8b1:::rbd_object_map.116dc3b5629f.0000000000000004:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.742948+0000", 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.656682078999999, 2024-09-11T06:17:33.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070156109999999997, 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 375 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742948+0000", 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742948+0000", 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742949+0000", 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999996e-07 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742952+0000", 2024-09-11T06:17:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4599999999999999e-06 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742969+0000", 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6082e-05 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742975+0000", 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2929999999999997e-06 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.744389+0000", 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001414039 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.744442+0000", 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3292999999999999e-05 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.744645+0000", 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020331599999999999 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.745848+0000", 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012029510000000001 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.749870+0000", 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040213849999999997 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.749927+0000", 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7166000000000001e-05 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.749964+0000", 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7021999999999999e-05 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2494 3.1a 3:59eb9dad:::rbd_data.116dc3b5629f.00000000000000b1:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.573427+0000", 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.826203332, 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.026631734000000001, 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2494 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573427+0000", 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573427+0000", 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573428+0000", 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257e-06 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573433+0000", 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573444+0000", 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0961000000000001e-05 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573450+0000", 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3700000000000003e-06 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573498+0000", 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7979999999999998e-05 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.573552+0000", 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4453000000000002e-05 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.577856+0000", 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043034869999999999 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.599940+0000", 2024-09-11T06:17:33.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022084553999999999 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.599978+0000", 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7886000000000003e-05 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.600019+0000", 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000001e-05 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.600059+0000", 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9793999999999999e-05 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2494 3.1a e33/24 ondisk, result = 0)", 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.591558+0000", 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.8080722, 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085070849999999993, 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.525 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591558+0000", 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591558+0000", 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591559+0000", 2024-09-11T06:17:33.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0270000000000001e-06 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591563+0000", 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1200000000000004e-06 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591578+0000", 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4769999999999999e-05 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.591587+0000", 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1710000000000008e-06 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.599965+0000", 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083777460000000002 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.599973+0000", 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9030000000000004e-06 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.600065+0000", 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2348000000000004e-05 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:4626 3.1c 3:3b6bf5c5:::rbd_data.116df69fa911.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:25.217821+0000", 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.1818097939999994, 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023441388000000001, 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4626 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217821+0000", 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217821+0000", 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217823+0000", 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2129999999999998e-06 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217830+0000", 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4540000000000001e-06 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217848+0000", 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7717e-05 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217855+0000", 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-06 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.217918+0000", 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2873000000000006e-05 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.218004+0000", 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6088000000000007e-05 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.221962+0000", 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039584299999999998 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241102+0000", 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019139382 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241141+0000", 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8819999999999998e-05 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241179+0000", 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8084999999999999e-05 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241262+0000", 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3275999999999993e-05 2024-09-11T06:17:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:4626 3.1c e39/24 ondisk, result = 0)", 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:25.233681+0000", 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.1659494959999996, 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075874180000000003, 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233681+0000", 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233681+0000", 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233682+0000", 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3600000000000002e-07 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233685+0000", 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.281e-06 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233697+0000", 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1542999999999999e-05 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.233703+0000", 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7150000000000001e-06 2024-09-11T06:17:33.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241129+0000", 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074258869999999999 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241137+0000", 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3300000000000001e-06 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.241268+0000", 2024-09-11T06:17:33.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013182600000000001 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:4690 3.1c 3:3b6bf5c5:::rbd_data.116df69fa911.000000000000000e:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:25.309304+0000", 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.0903264860000004, 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015071049, 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4690 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309304+0000", 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309304+0000", 2024-09-11T06:17:33.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309305+0000", 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.367e-06 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309312+0000", 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6749999999999996e-06 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309325+0000", 2024-09-11T06:17:33.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3317e-05 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309334+0000", 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2770000000000005e-06 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309384+0000", 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0492999999999999e-05 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.309436+0000", 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2315000000000003e-05 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.311809+0000", 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023728220000000001 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.324245+0000", 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012435681000000001 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.324265+0000", 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9675999999999999e-05 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.324322+0000", 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6943e-05 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:25.324375+0000", 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3483000000000003e-05 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.545 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:33.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:33.547 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:33.545+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:33.647 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:33.646+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:33.648 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:33.649 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:33.649 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:33.649 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:33.657 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:33.748 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:33.747+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:33.760 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:33.761 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:33.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:33.849 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:33.848+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:33.873 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:114 3.e 3:71ed46f3:::rbd_object_map.116d6cc70d0.0000000000000003:head [writefull 0~49] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.162356566, 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036205959999999998, 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 114 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709649+0000", 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709653+0000", 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.033e-06 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709668+0000", 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5432999999999999e-05 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709695+0000", 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6743000000000001e-05 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709708+0000", 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3224000000000001e-05 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709781+0000", 2024-09-11T06:17:33.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3203999999999999e-05 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.709786+0000", 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5249999999999999e-06 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.711855+0000", 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020689440000000001 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.711945+0000", 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0247999999999994e-05 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.712027+0000", 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1848999999999995e-05 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.712788+0000", 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076103399999999995 2024-09-11T06:17:33.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713172+0000", 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038437900000000001 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713225+0000", 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2729999999999998e-05 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:14.713270+0000", 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5250000000000002e-05 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:341 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1835008~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.133297263999999, 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020185530000000002, 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 341 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738709+0000", 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738720+0000", 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0738e-05 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738726+0000", 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4339999999999997e-06 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738732+0000", 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4809999999999997e-06 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740558+0000", 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018259719999999999 2024-09-11T06:17:33.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740621+0000", 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3230000000000003e-05 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740727+0000", 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106319 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:342 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.133179539, 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002047924, 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 342 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738826+0000", 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738827+0000", 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738831+0000", 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3390000000000001e-06 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738838+0000", 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.738843+0000", 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4489999999999998e-06 2024-09-11T06:17:33.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740768+0000", 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001924533 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740812+0000", 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4325e-05 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.740874+0000", 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2544000000000003e-05 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:348 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1966080~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.132319486, 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018858169999999999, 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 348 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:33.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739687+0000", 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3499999999999996e-07 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739690+0000", 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0079999999999998e-06 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739697+0000", 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0330000000000003e-06 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739703+0000", 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2090000000000002e-06 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741373+0000", 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016699760000000001 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741456+0000", 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2781999999999994e-05 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741572+0000", 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011627400000000001 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.894 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:349 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 524288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.132170469999998, 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019399529999999999, 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739836+0000", 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739837+0000", 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.17e-06 2024-09-11T06:17:33.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739842+0000", 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.809e-06 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739853+0000", 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569000000000001e-05 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739872+0000", 2024-09-11T06:17:33.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8525999999999998e-05 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741611+0000", 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017397090000000001 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741674+0000", 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2652999999999998e-05 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741776+0000", 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101517 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:350 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 1310720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.132099862, 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002086142, 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 350 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739906+0000", 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739907+0000", 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1999999999999999e-07 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739910+0000", 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1200000000000002e-06 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739918+0000", 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3180000000000007e-06 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739932+0000", 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3436e-05 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741807+0000", 2024-09-11T06:17:33.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018748689999999999 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741882+0000", 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5042000000000004e-05 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.741992+0000", 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011073699999999999 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:351 3.5 3:a08c8c23:::rbd_data.116d6cc70d0.000000000000001b:3 [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.132064931999999, 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022443649999999999, 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 351 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739941+0000", 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739942+0000", 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739944+0000", 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739950+0000", 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.314e-06 2024-09-11T06:17:33.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.739956+0000", 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5999999999999997e-06 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742021+0000", 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020649409999999998 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742097+0000", 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6322000000000006e-05 2024-09-11T06:17:33.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:15.742185+0000", 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8244000000000004e-05 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2271 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.614004086, 2024-09-11T06:17:33.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012468982999999999, 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258004+0000", 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6419999999999999e-06 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258011+0000", 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4599999999999997e-06 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258025+0000", 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3804e-05 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258033+0000", 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4239999999999993e-06 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258089+0000", 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.588e-05 2024-09-11T06:17:33.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258147+0000", 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000002e-05 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.260204+0000", 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020570269999999999 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270393+0000", 2024-09-11T06:17:33.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010188657 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270403+0000", 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270437+0000", 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3373e-05 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270471+0000", 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4073999999999999e-05 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2271 3.16 e33/24 ondisk, result = 0)", 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.266389+0000", 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.605616704999999, 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040086480000000001, 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266389+0000", 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266389+0000", 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266391+0000", 2024-09-11T06:17:33.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.263e-06 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266396+0000", 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8289999999999996e-06 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266412+0000", 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5466000000000001e-05 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.266421+0000", 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5880000000000004e-06 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270380+0000", 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039589960000000002 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270388+0000", 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9480000000000008e-06 2024-09-11T06:17:33.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270398+0000", 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5580000000000006e-06 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2403 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.430367185, 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018324528999999999, 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2403 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441640+0000", 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441646+0000", 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:17:33.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441656+0000", 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0257e-05 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441661+0000", 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0549999999999999e-06 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441710+0000", 2024-09-11T06:17:33.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8446999999999999e-05 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441761+0000", 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1060999999999998e-05 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.444470+0000", 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027092539999999999 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459870+0000", 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015399629 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459881+0000", 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1382e-05 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459926+0000", 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4505000000000002e-05 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459963+0000", 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7759999999999998e-05 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2403 3.e e33/24 ondisk, result = 0)", 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.453427+0000", 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.418578665, 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064472449999999999, 2024-09-11T06:17:33.924 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453427+0000", 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453427+0000", 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453428+0000", 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453432+0000", 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7929999999999999e-06 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453444+0000", 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1960000000000001e-05 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.453453+0000", 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5469999999999997e-06 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459858+0000", 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064053189999999996 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459865+0000", 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0550000000000002e-06 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459875+0000", 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6809999999999993e-06 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2416 3.5 3:a294777f:::rbd_data.116dc3b5629f.0000000000000069:head [set-alloc-hint object_size 1048576 write_size 1048576,write 655360~28123] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.470586+0000", 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.401419817000001, 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028135949999999999, 2024-09-11T06:17:33.928 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2416 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470586+0000", 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470586+0000", 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470588+0000", 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3459999999999999e-06 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470601+0000", 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3657e-05 2024-09-11T06:17:33.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470612+0000", 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896e-05 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470619+0000", 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5470000000000002e-06 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470669+0000", 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0509e-05 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470756+0000", 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6658999999999998e-05 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.470840+0000", 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4254999999999999e-05 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.471369+0000", 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00052851500000000002 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.473327+0000", 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001958128 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.473358+0000", 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1695000000000001e-05 2024-09-11T06:17:33.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.473400+0000", 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1387999999999997e-05 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2460 3.e 3:72eb80ea:::rbd_data.116dc3b5629f.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.537366+0000", 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.334640469, 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031611019999999998, 2024-09-11T06:17:33.934 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2460 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537366+0000", 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537366+0000", 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537368+0000", 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2409999999999998e-06 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537377+0000", 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4860000000000003e-06 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537397+0000", 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9446e-05 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537407+0000", 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0635999999999999e-05 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537471+0000", 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3989e-05 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.537556+0000", 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4333999999999996e-05 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.538110+0000", 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055421500000000005 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.540455+0000", 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023447120000000001 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.540466+0000", 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.116e-05 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.540496+0000", 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0167000000000001e-05 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.540527+0000", 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0716000000000002e-05 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2543 3.16 3:6ea59b58:::rbd_data.116dc3b5629f.00000000000000c4:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.661704+0000", 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.210302115999999, 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018977480000000001, 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2543 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.940 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661704+0000", 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661704+0000", 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661704+0000", 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:17:33.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661708+0000", 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2150000000000001e-06 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661716+0000", 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9400000000000002e-06 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.661722+0000", 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.241e-06 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.662464+0000", 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074192699999999997 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.662538+0000", 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3858999999999999e-05 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.662635+0000", 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7478000000000004e-05 2024-09-11T06:17:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.663184+0000", 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054853300000000003 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.663533+0000", 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034914100000000002 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.663566+0000", 2024-09-11T06:17:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2879999999999997e-05 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.663602+0000", 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6025000000000002e-05 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2607 3.5 3:a3a676bb:::rbd_data.116dc3b5629f.00000000000000e3:head [set-alloc-hint object_size 1048576 write_size 1048576,write 917504~10842] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.755346+0000", 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.116660283, 2024-09-11T06:17:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029452979999999998, 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2607 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755346+0000", 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755346+0000", 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755347+0000", 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2950000000000001e-06 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755356+0000", 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0790000000000007e-06 2024-09-11T06:17:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755367+0000", 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1144999999999999e-05 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755373+0000", 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3859999999999998e-06 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755418+0000", 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4962000000000001e-05 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755469+0000", 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1306e-05 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.755559+0000", 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0468000000000002e-05 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.756145+0000", 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058586800000000002 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.758200+0000", 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020547439999999998 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.758250+0000", 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9926000000000003e-05 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.758291+0000", 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1118999999999997e-05 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2621 3.5 3:a3a676bb:::rbd_data.116dc3b5629f.00000000000000e3:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.769069+0000", 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.102937076, 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023916340000000001, 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2621 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769069+0000", 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769069+0000", 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769069+0000", 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000001e-07 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769075+0000", 2024-09-11T06:17:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769081+0000", 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6930000000000004e-06 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769084+0000", 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9809999999999999e-06 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769144+0000", 2024-09-11T06:17:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9548e-05 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769223+0000", 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9537999999999996e-05 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.769324+0000", 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100504 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.770026+0000", 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070187699999999995 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771388+0000", 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001362343 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771435+0000", 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7030999999999997e-05 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.771461+0000", 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5588999999999998e-05 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2704 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079196+0000", 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.792809568999999, 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002773845, 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2704 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079196+0000", 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079196+0000", 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079197+0000", 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079201+0000", 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9110000000000003e-06 2024-09-11T06:17:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079211+0000", 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0008e-05 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079218+0000", 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0720000000000002e-06 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079428+0000", 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000209934 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079512+0000", 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4299e-05 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079641+0000", 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012843199999999999 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080491+0000", 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085044500000000002 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081873+0000", 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013821619999999999 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081931+0000", 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7797000000000002e-05 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.081970+0000", 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9150000000000003e-05 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2705 3.e 3:72eb80ea:::rbd_data.116dc3b5629f.0000000000000070:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:20.079340+0000", 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.792665853999999, 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027571290000000001, 2024-09-11T06:17:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2705 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079340+0000", 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079340+0000", 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079341+0000", 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1699999999999997e-07 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079344+0000", 2024-09-11T06:17:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.45e-06 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079353+0000", 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3999999999999992e-06 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079357+0000", 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5589999999999999e-06 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079894+0000", 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053666300000000005 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.079974+0000", 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0519000000000006e-05 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080075+0000", 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010006899999999999 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.080935+0000", 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00086062200000000001 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082021+0000", 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010858930000000001 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082066+0000", 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4634e-05 2024-09-11T06:17:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.082097+0000", 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1603000000000002e-05 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7596 3.5 3:a3f8e3c9:::rbd_data.116d497c8375.0000000000000166:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.430370+0000", 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.4416359439999997, 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033356430000000001, 2024-09-11T06:17:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7596 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430370+0000", 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430370+0000", 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430372+0000", 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-06 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430378+0000", 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9089999999999997e-06 2024-09-11T06:17:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430393+0000", 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5724000000000001e-05 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430401+0000", 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5159999999999997e-06 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430472+0000", 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1079000000000002e-05 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.430602+0000", 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130345 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433706+0000", 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031035530000000002 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7696 3.5 3:a1e89456:::rbd_data.116d497c8375.000000000000007a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.491616+0000", 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.3803901310000004, 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003477075, 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7696 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491616+0000", 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491616+0000", 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491618+0000", 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.699e-06 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491625+0000", 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8620000000000003e-06 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491640+0000", 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4824000000000001e-05 2024-09-11T06:17:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491647+0000", 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.024e-06 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491698+0000", 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0791000000000002e-05 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.491840+0000", 2024-09-11T06:17:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000141676 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.492459+0000", 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061961999999999998 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.495007+0000", 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002547896 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.495018+0000", 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0444e-05 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.495047+0000", 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9102999999999999e-05 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.495093+0000", 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6136e-05 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:33.980 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:33.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:33.982 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:33.981+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:34.082 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:34.081+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:34.126 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:34.126 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:34.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:34.140 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T06:17:34.140 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:17:34.140 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T06:17:34.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:17:34.220 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:34.219+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:34.283 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:34.282+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:34.355 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:34.355 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:34.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:34.384 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:34.384+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:34.486 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:34.485+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:34.513 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:34.513 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:34.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:34.513 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.892029954999998, 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:17:34.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.597594377, 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:34.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:34.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:17:34.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:17:34.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16806 3.9 3:933a7220:::rbd_data.116d3c8aaf0c.0000000000000018:b [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.324733206, 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036862515999999998, 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16806 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186927+0000", 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9400000000000005e-07 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187820+0000", 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089324900000000004 2024-09-11T06:17:34.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187832+0000", 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1494e-05 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187839+0000", 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.486e-06 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223214+0000", 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035374783999999999 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223280+0000", 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6157999999999999e-05 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223789+0000", 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050865100000000005 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16818 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32378210499999999, 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036928510999999997, 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16818 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187878+0000", 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187880+0000", 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3649999999999998e-06 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187887+0000", 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4019999999999999e-06 2024-09-11T06:17:34.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187892+0000", 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.091e-06 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224245+0000", 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036352885000000001 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224532+0000", 2024-09-11T06:17:34.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028740800000000001 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224806+0000", 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027381999999999998 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16819 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.323754506, 2024-09-11T06:17:34.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037215051999999998, 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16819 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187907+0000", 2024-09-11T06:17:34.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1679999999999998e-06 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187914+0000", 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5409999999999997e-06 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187919+0000", 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224841+0000", 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036922117999999997 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225021+0000", 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180173 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225120+0000", 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8987000000000006e-05 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16820 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.323733628, 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037628920000000003, 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16820 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187928+0000", 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9599999999999999e-06 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187944+0000", 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6293000000000001e-05 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187950+0000", 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3149999999999999e-06 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225172+0000", 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037222435999999998 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225258+0000", 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5908000000000005e-05 2024-09-11T06:17:34.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225555+0000", 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029660999999999999 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16821 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.323702351, 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037879496999999998, 2024-09-11T06:17:34.543 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16821 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187958+0000", 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187960+0000", 2024-09-11T06:17:34.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3269999999999999e-06 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187966+0000", 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-06 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187971+0000", 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0830000000000003e-06 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225612+0000", 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037640831 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225734+0000", 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122104 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225837+0000", 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010223800000000001 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16822 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 163840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32368148899999999, 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038088416999999999, 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16822 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187980+0000", 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187987+0000", 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0809999999999999e-06 2024-09-11T06:17:34.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187991+0000", 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2420000000000002e-06 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225884+0000", 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037893139999999999 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225957+0000", 2024-09-11T06:17:34.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3306000000000006e-05 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226066+0000", 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109103 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16823 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:34.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32366276900000002, 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038574642999999999, 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16823 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:34.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187999+0000", 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.12e-06 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188005+0000", 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188010+0000", 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-06 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226107+0000", 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03809676 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226463+0000", 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035599299999999998 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226571+0000", 2024-09-11T06:17:34.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108725 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16824 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32364404099999999, 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039232345000000002, 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16824 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188016+0000", 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188018+0000", 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.933e-06 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188024+0000", 2024-09-11T06:17:34.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2310000000000001e-06 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188038+0000", 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3837e-05 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226631+0000", 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038593589999999997 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226743+0000", 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111192 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227248+0000", 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050521599999999996 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.561 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16915 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.323172495, 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038728892000000001, 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16915 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188489+0000", 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9190000000000002e-06 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188495+0000", 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6930000000000004e-06 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188505+0000", 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0203999999999999e-05 2024-09-11T06:17:34.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226603+0000", 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038097497000000001 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226680+0000", 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7115999999999998e-05 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227216+0000", 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000536123 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16916 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32314402599999997, 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03972564, 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.566 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16916 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:34.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188516+0000", 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188518+0000", 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.058e-06 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188524+0000", 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.015e-06 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188528+0000", 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739999999999999e-06 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227244+0000", 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038716172 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227328+0000", 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3120000000000004e-05 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228241+0000", 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091343800000000003 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16917 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.570 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32312506699999999, 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039912402999999999, 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16917 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:34.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188535+0000", 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-07 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188539+0000", 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8940000000000003e-06 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188544+0000", 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6250000000000004e-06 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188553+0000", 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2359999999999993e-06 2024-09-11T06:17:34.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228275+0000", 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039721226999999998 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228354+0000", 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370999999999996e-05 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228447+0000", 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2692e-05 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16918 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32309988899999997, 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040097763000000002, 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16918 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2e-07 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188562+0000", 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188568+0000", 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1419999999999998e-06 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188573+0000", 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6940000000000003e-06 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228491+0000", 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039918355000000003 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228564+0000", 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2621999999999997e-05 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228657+0000", 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517000000000006e-05 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16919 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.323081059, 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040276407, 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16919 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188579+0000", 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188581+0000", 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188586+0000", 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8409999999999996e-06 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188601+0000", 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4545999999999999e-05 2024-09-11T06:17:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228687+0000", 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040086418999999998 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228761+0000", 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3761000000000001e-05 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228855+0000", 2024-09-11T06:17:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3628000000000005e-05 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16920 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32305122600000002, 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040512056999999997, 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16920 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188609+0000", 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999996e-07 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188611+0000", 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.176e-06 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188618+0000", 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4769999999999997e-06 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188623+0000", 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8060000000000002e-06 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228884+0000", 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040261107999999997 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228959+0000", 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5100999999999998e-05 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229120+0000", 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016078500000000001 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16927 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.588 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.322944063, 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040618147, 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16927 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:34.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188716+0000", 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:17:34.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188717+0000", 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.283e-06 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188721+0000", 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9020000000000001e-06 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188723+0000", 2024-09-11T06:17:34.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5950000000000001e-06 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229151+0000", 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040427053999999997 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229230+0000", 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9467000000000003e-05 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229334+0000", 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010351799999999999 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16928 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32293307199999999, 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040816636000000003, 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16928 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188727+0000", 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188728+0000", 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0690000000000001e-06 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188731+0000", 2024-09-11T06:17:34.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.982e-06 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188733+0000", 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.458e-06 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229364+0000", 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040631035000000003 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229445+0000", 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0925000000000002e-05 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229543+0000", 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7956999999999997e-05 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16929 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:34.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32292331299999999, 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041025210999999999, 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16929 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188737+0000", 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0380000000000001e-06 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188740+0000", 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188744+0000", 2024-09-11T06:17:34.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229575+0000", 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040831329 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229656+0000", 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0924e-05 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229761+0000", 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105171 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16930 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.32290964999999999, 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041241585999999997, 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:34.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16930 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188752+0000", 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188758+0000", 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188762+0000", 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229808+0000", 2024-09-11T06:17:34.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041046760000000002 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229854+0000", 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5365999999999999e-05 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229991+0000", 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013750200000000001 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.609 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:34.610 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:34.611 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 48, 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:17:34.136629+0000", 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:16:51.453603+0000", 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:16:42.356322+0000", 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5801984, 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:17:34.612 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 5, 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:17:34.613 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:17:34.614 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:17:34.615 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:17:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:17:34.617 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:17:34.618 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.619 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.96165657043457031, 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.95999997854232788, 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.95999997854232788 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.620 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:17:34.621 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:17:34.622 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:17:34.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:17:34.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:17:34.625 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.96165657043457031, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.95999997854232788, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.95999997854232788 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.626 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:17:34.627 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:17:34.628 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "48", 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 12, 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 48, 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:17:34.629 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:17:34.630 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:17:34.631 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.96165657043457031, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.95999997854232788, 2024-09-11T06:17:34.632 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.95999997854232788 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:34.633 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.634 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:34.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:17:34.637 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:17:34.638 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.6932525634765625, 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:34.639 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:34.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:34.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 569448355 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/569448355", 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/569448355", 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/569448355", 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/569448355", 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:34.644 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:34.645 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:17:34.646 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.647 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.648 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.649 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/720689704", 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/720689704", 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/720689704", 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/720689704", 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:34.651 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.652 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.654 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:17:34.656 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.657 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.658 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.659 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.660 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:17:34.661 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:34.662 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 36, 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:34.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:17:34.664 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:17:34.665 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.666 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 24, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:34.668 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.669 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.670 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.671 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.672 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:17:34.673 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 43, 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:34.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:34.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:34.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:17:34.678 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:34.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:17:34.680 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:34.681 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:34.683 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:17:34.684 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.f", 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: 7, 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2024-09-11T06:17:34.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.686 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 8, 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 10, 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.687 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:34.688 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:34.689 INFO:tasks.thrashosds.thrasher:j is {'epoch': 48, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:17:34.136629+0000', 'last_up_change': '2024-09-11T06:16:51.453603+0000', 'last_in_change': '2024-09-11T06:16:42.356322+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9616565704345703, 'average_primary_affinity': 0.9599999785423279, 'average_primary_affinity_weighted': 0.9599999785423279}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 0.9616565704345703, 'average_primary_affinity': 0.9599999785423279, 'average_primary_affinity_weighted': 0.9599999785423279}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 12, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9616565704345703, 'average_primary_affinity': 0.9599999785423279, 'average_primary_affinity_weighted': 0.9599999785423279}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6932525634765625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 569448355}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 569448355}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 569448355}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 569448355}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 569448355}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 569448355}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 569448355}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 569448355}]}, 'public_addr': '172.21.15.70:6817/569448355', 'cluster_addr': '172.21.15.70:6819/569448355', 'heartbeat_back_addr': '172.21.15.70:6823/569448355', 'heartbeat_front_addr': '172.21.15.70:6821/569448355', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 720689704}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 720689704}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 720689704}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 720689704}]}, 'public_addr': '172.21.15.70:6809/720689704', 'cluster_addr': '172.21.15.70:6811/720689704', 'heartbeat_back_addr': '172.21.15.70:6815/720689704', 'heartbeat_front_addr': '172.21.15.70:6813/720689704', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 36, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 43, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.f', 'osds': [7, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 8, 'length': 1}, {'begin': 10, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:17:34.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:34.690 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:34.609+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:34.735 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:34.734+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:34.793 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:34.794 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:34.794 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:34.802 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:34.843 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:34.842+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:34.913 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:34.912+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:34.944 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:34.944 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:34.944 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:34.944 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:34.944 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:34.953 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:34.967 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:34.968 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:34.979 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-11T06:17:34.421804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":118163119,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":9,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":17050,"num_read_kb":19991,"num_write":3766,"num_write_kb":25821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2870,"ondisk_log_size":2870,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262236,"kb_used_data":8520,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712484,"statfs":{"total":773094113280,"available":772825583616,"internally_reserved":0,"allocated":8724480,"data_stored":18471794,"data_compressed":412507,"data_compressed_allocated":1695744,"data_compressed_original":14428894,"omap_allocated":12750,"internal_metadata":259575346},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24768442,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":6164,"num_read_kb":9507,"num_write":1004,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000549"},"pg_stats":[{"pgid":"3.1f","version":"46'84","reported_seq":856,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.304660+0000","last_change":"2024-09-11T06:17:32.142328+0000","last_active":"2024-09-11T06:17:32.304660+0000","last_peered":"2024-09-11T06:17:32.304660+0000","last_clean":"2024-09-11T06:17:32.304660+0000","last_became_active":"2024-09-11T06:17:09.686692+0000","last_became_peered":"2024-09-11T06:17:09.686692+0000","last_unstale":"2024-09-11T06:17:32.304660+0000","last_undegraded":"2024-09-11T06:17:32.304660+0000","last_fullsized":"2024-09-11T06:17:32.304660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:16.742227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032756700000000002,"stat_sum":{"num_bytes":20267399,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":889,"num_read_kb":824,"num_write":71,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.1e","version":"46'28","reported_seq":516,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.143095+0000","last_change":"2024-09-11T06:17:32.143095+0000","last_active":"2024-09-11T06:17:32.143095+0000","last_peered":"2024-09-11T06:17:32.143095+0000","last_clean":"2024-09-11T06:17:32.143095+0000","last_became_active":"2024-09-11T06:17:09.686913+0000","last_became_peered":"2024-09-11T06:17:09.686913+0000","last_unstale":"2024-09-11T06:17:32.143095+0000","last_undegraded":"2024-09-11T06:17:32.143095+0000","last_fullsized":"2024-09-11T06:17:32.143095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:47.667273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088653099999999997,"stat_sum":{"num_bytes":1636041,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":415,"num_read_kb":773,"num_write":25,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.1d","version":"45'240","reported_seq":607,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134891+0000","last_change":"2024-09-11T06:17:32.135307+0000","last_active":"2024-09-11T06:17:32.134891+0000","last_peered":"2024-09-11T06:17:32.134891+0000","last_clean":"2024-09-11T06:17:32.134891+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:17:32.134891+0000","last_undegraded":"2024-09-11T06:17:32.134891+0000","last_fullsized":"2024-09-11T06:17:32.134891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:40:15.216224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001040228,"stat_sum":{"num_bytes":2020757,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1416,"num_read_kb":1453,"num_write":393,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.1c","version":"45'47","reported_seq":414,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134965+0000","last_change":"2024-09-11T06:17:32.134965+0000","last_active":"2024-09-11T06:17:32.134965+0000","last_peered":"2024-09-11T06:17:32.134965+0000","last_clean":"2024-09-11T06:17:32.134965+0000","last_became_active":"2024-09-11T06:17:09.680193+0000","last_became_peered":"2024-09-11T06:17:09.680193+0000","last_unstale":"2024-09-11T06:17:32.134965+0000","last_undegraded":"2024-09-11T06:17:32.134965+0000","last_fullsized":"2024-09-11T06:17:32.134965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:08.954990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080059399999999996,"stat_sum":{"num_bytes":14348583,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":327,"num_write":42,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.1b","version":"45'203","reported_seq":390,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135668+0000","last_change":"2024-09-11T06:17:32.135668+0000","last_active":"2024-09-11T06:17:32.135668+0000","last_peered":"2024-09-11T06:17:32.135668+0000","last_clean":"2024-09-11T06:17:32.135668+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:17:32.135668+0000","last_undegraded":"2024-09-11T06:17:32.135668+0000","last_fullsized":"2024-09-11T06:17:32.135668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:28.895819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062704299999999998,"stat_sum":{"num_bytes":4248555,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":844,"num_read_kb":648,"num_write":346,"num_write_kb":1309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.1a","version":"45'92","reported_seq":566,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.245119+0000","last_change":"2024-09-11T06:17:32.142355+0000","last_active":"2024-09-11T06:17:32.245119+0000","last_peered":"2024-09-11T06:17:32.245119+0000","last_clean":"2024-09-11T06:17:32.245119+0000","last_became_active":"2024-09-11T06:17:23.112505+0000","last_became_peered":"2024-09-11T06:17:23.112505+0000","last_unstale":"2024-09-11T06:17:32.245119+0000","last_undegraded":"2024-09-11T06:17:32.245119+0000","last_fullsized":"2024-09-11T06:17:32.245119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:50.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039104899999999998,"stat_sum":{"num_bytes":4577004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":649,"num_write":111,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.19","version":"42'47","reported_seq":139,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135720+0000","last_change":"2024-09-11T06:17:32.135871+0000","last_active":"2024-09-11T06:17:32.135720+0000","last_peered":"2024-09-11T06:17:32.135720+0000","last_clean":"2024-09-11T06:17:32.135720+0000","last_became_active":"2024-09-11T06:17:09.680455+0000","last_became_peered":"2024-09-11T06:17:09.680455+0000","last_unstale":"2024-09-11T06:17:32.135720+0000","last_undegraded":"2024-09-11T06:17:32.135720+0000","last_fullsized":"2024-09-11T06:17:32.135720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:02:54.091606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076201399999999999,"stat_sum":{"num_bytes":524288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":33,"num_write":44,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.18","version":"45'575","reported_seq":992,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.142815+0000","last_change":"2024-09-11T06:17:32.142815+0000","last_active":"2024-09-11T06:17:32.142815+0000","last_peered":"2024-09-11T06:17:32.142815+0000","last_clean":"2024-09-11T06:17:32.142815+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:17:32.142815+0000","last_undegraded":"2024-09-11T06:17:32.142815+0000","last_fullsized":"2024-09-11T06:17:32.142815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:40.714182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071330700000000005,"stat_sum":{"num_bytes":5186664,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3047,"num_read_kb":2594,"num_write":953,"num_write_kb":1764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.17","version":"45'31","reported_seq":116,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.142492+0000","last_change":"2024-09-11T06:17:32.142682+0000","last_active":"2024-09-11T06:17:32.142492+0000","last_peered":"2024-09-11T06:17:32.142492+0000","last_clean":"2024-09-11T06:17:32.142492+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:17:32.142492+0000","last_undegraded":"2024-09-11T06:17:32.142492+0000","last_fullsized":"2024-09-11T06:17:32.142492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:21.664894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061587800000000004,"stat_sum":{"num_bytes":1422503,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.16","version":"45'52","reported_seq":399,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.140301+0000","last_change":"2024-09-11T06:17:32.140484+0000","last_active":"2024-09-11T06:17:32.140301+0000","last_peered":"2024-09-11T06:17:32.140301+0000","last_clean":"2024-09-11T06:17:32.140301+0000","last_became_active":"2024-09-11T06:17:09.686021+0000","last_became_peered":"2024-09-11T06:17:09.686021+0000","last_unstale":"2024-09-11T06:17:32.140301+0000","last_undegraded":"2024-09-11T06:17:32.140301+0000","last_fullsized":"2024-09-11T06:17:32.140301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:14.740581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036561800000000001,"stat_sum":{"num_bytes":1812611,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":686,"num_write":51,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.15","version":"45'56","reported_seq":157,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.137762+0000","last_change":"2024-09-11T06:17:32.137950+0000","last_active":"2024-09-11T06:17:32.137762+0000","last_peered":"2024-09-11T06:17:32.137762+0000","last_clean":"2024-09-11T06:17:32.137762+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:17:32.137762+0000","last_undegraded":"2024-09-11T06:17:32.137762+0000","last_fullsized":"2024-09-11T06:17:32.137762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:26.354850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039767600000000002,"stat_sum":{"num_bytes":2266639,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":16,"num_read_kb":219,"num_write":53,"num_write_kb":881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.14","version":"45'19","reported_seq":110,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135318+0000","last_change":"2024-09-11T06:17:32.135515+0000","last_active":"2024-09-11T06:17:32.135318+0000","last_peered":"2024-09-11T06:17:32.135318+0000","last_clean":"2024-09-11T06:17:32.135318+0000","last_became_active":"2024-09-11T06:17:09.682654+0000","last_became_peered":"2024-09-11T06:17:09.682654+0000","last_unstale":"2024-09-11T06:17:32.135318+0000","last_undegraded":"2024-09-11T06:17:32.135318+0000","last_fullsized":"2024-09-11T06:17:32.135318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:28.627229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011229339999999999,"stat_sum":{"num_bytes":1853440,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":6,"num_read_kb":26,"num_write":17,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134757+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:32.134757+0000","last_peered":"2024-09-11T06:17:32.134757+0000","last_clean":"2024-09-11T06:17:32.134757+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:32.134757+0000","last_undegraded":"2024-09-11T06:17:32.134757+0000","last_fullsized":"2024-09-11T06:17:32.134757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"45'34","reported_seq":381,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135829+0000","last_change":"2024-09-11T06:17:32.135973+0000","last_active":"2024-09-11T06:17:32.135829+0000","last_peered":"2024-09-11T06:17:32.135829+0000","last_clean":"2024-09-11T06:17:32.135829+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:17:32.135829+0000","last_undegraded":"2024-09-11T06:17:32.135829+0000","last_fullsized":"2024-09-11T06:17:32.135829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:04.774756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075339099999999996,"stat_sum":{"num_bytes":1168220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":262,"num_read_kb":507,"num_write":29,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135287+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:32.135287+0000","last_peered":"2024-09-11T06:17:32.135287+0000","last_clean":"2024-09-11T06:17:32.135287+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:32.135287+0000","last_undegraded":"2024-09-11T06:17:32.135287+0000","last_fullsized":"2024-09-11T06:17:32.135287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"45'34","reported_seq":371,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135745+0000","last_change":"2024-09-11T06:17:32.135745+0000","last_active":"2024-09-11T06:17:32.135745+0000","last_peered":"2024-09-11T06:17:32.135745+0000","last_clean":"2024-09-11T06:17:32.135745+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:17:32.135745+0000","last_undegraded":"2024-09-11T06:17:32.135745+0000","last_fullsized":"2024-09-11T06:17:32.135745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:22.294243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065704399999999997,"stat_sum":{"num_bytes":2190503,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":355,"num_write":32,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134517+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:32.134517+0000","last_peered":"2024-09-11T06:17:32.134517+0000","last_clean":"2024-09-11T06:17:32.134517+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:32.134517+0000","last_undegraded":"2024-09-11T06:17:32.134517+0000","last_fullsized":"2024-09-11T06:17:32.134517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"45'35","reported_seq":373,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T06:17:31.367112+0000","last_change":"2024-09-11T06:17:28.133453+0000","last_active":"2024-09-11T06:17:31.367112+0000","last_peered":"2024-09-11T06:17:31.367112+0000","last_clean":"2024-09-11T06:17:31.367112+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:17:31.367112+0000","last_undegraded":"2024-09-11T06:17:31.367112+0000","last_fullsized":"2024-09-11T06:17:31.367112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:42.631858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034511699999999998,"stat_sum":{"num_bytes":1350391,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":542,"num_write":33,"num_write_kb":796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.141895+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:32.141895+0000","last_peered":"2024-09-11T06:17:32.141895+0000","last_clean":"2024-09-11T06:17:32.141895+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:32.141895+0000","last_undegraded":"2024-09-11T06:17:32.141895+0000","last_fullsized":"2024-09-11T06:17:32.141895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"45'19","reported_seq":424,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.139974+0000","last_change":"2024-09-11T06:17:32.140186+0000","last_active":"2024-09-11T06:17:32.139974+0000","last_peered":"2024-09-11T06:17:32.139974+0000","last_clean":"2024-09-11T06:17:32.139974+0000","last_became_active":"2024-09-11T06:17:09.680887+0000","last_became_peered":"2024-09-11T06:17:09.680887+0000","last_unstale":"2024-09-11T06:17:32.139974+0000","last_undegraded":"2024-09-11T06:17:32.139974+0000","last_fullsized":"2024-09-11T06:17:32.139974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:20.160793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038323600000000002,"stat_sum":{"num_bytes":3723759,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":325,"num_read_kb":619,"num_write":18,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.3","version":"46'219","reported_seq":1253,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.237451+0000","last_change":"2024-09-11T06:17:32.138848+0000","last_active":"2024-09-11T06:17:32.237451+0000","last_peered":"2024-09-11T06:17:32.237451+0000","last_clean":"2024-09-11T06:17:32.237451+0000","last_became_active":"2024-09-11T06:17:09.676881+0000","last_became_peered":"2024-09-11T06:17:09.676881+0000","last_unstale":"2024-09-11T06:17:32.237451+0000","last_undegraded":"2024-09-11T06:17:32.237451+0000","last_fullsized":"2024-09-11T06:17:32.237451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:05.017934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012381029999999999,"stat_sum":{"num_bytes":2182462,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2710,"num_read_kb":2471,"num_write":216,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":69,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134472+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:32.134472+0000","last_peered":"2024-09-11T06:17:32.134472+0000","last_clean":"2024-09-11T06:17:32.134472+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:32.134472+0000","last_undegraded":"2024-09-11T06:17:32.134472+0000","last_fullsized":"2024-09-11T06:17:32.134472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"45'34","reported_seq":396,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.241856+0000","last_change":"2024-09-11T06:17:32.142583+0000","last_active":"2024-09-11T06:17:32.241856+0000","last_peered":"2024-09-11T06:17:32.241856+0000","last_clean":"2024-09-11T06:17:32.241856+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:17:32.241856+0000","last_undegraded":"2024-09-11T06:17:32.241856+0000","last_fullsized":"2024-09-11T06:17:32.241856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:56.607682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056471899999999998,"stat_sum":{"num_bytes":1190354,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":285,"num_read_kb":539,"num_write":33,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T06:17:29.127018+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:29.127018+0000","last_peered":"2024-09-11T06:17:29.127018+0000","last_clean":"2024-09-11T06:17:29.127018+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:29.127018+0000","last_undegraded":"2024-09-11T06:17:29.127018+0000","last_fullsized":"2024-09-11T06:17:29.127018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"45'283","reported_seq":417,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T06:17:31.161701+0000","last_change":"2024-09-11T06:17:28.133407+0000","last_active":"2024-09-11T06:17:31.161701+0000","last_peered":"2024-09-11T06:17:31.161701+0000","last_clean":"2024-09-11T06:17:31.161701+0000","last_became_active":"2024-09-11T06:17:09.679986+0000","last_became_peered":"2024-09-11T06:17:09.679986+0000","last_unstale":"2024-09-11T06:17:31.161701+0000","last_undegraded":"2024-09-11T06:17:31.161701+0000","last_fullsized":"2024-09-11T06:17:31.161701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:23.163184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035717300000000002,"stat_sum":{"num_bytes":4586146,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1361,"num_write":518,"num_write_kb":1188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134211+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:32.134211+0000","last_peered":"2024-09-11T06:17:32.134211+0000","last_clean":"2024-09-11T06:17:32.134211+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:32.134211+0000","last_undegraded":"2024-09-11T06:17:32.134211+0000","last_fullsized":"2024-09-11T06:17:32.134211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"45'30","reported_seq":132,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135284+0000","last_change":"2024-09-11T06:17:32.135444+0000","last_active":"2024-09-11T06:17:32.135284+0000","last_peered":"2024-09-11T06:17:32.135284+0000","last_clean":"2024-09-11T06:17:32.135284+0000","last_became_active":"2024-09-11T06:17:09.675683+0000","last_became_peered":"2024-09-11T06:17:09.675683+0000","last_unstale":"2024-09-11T06:17:32.135284+0000","last_undegraded":"2024-09-11T06:17:32.135284+0000","last_fullsized":"2024-09-11T06:17:32.135284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:51.832682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042652100000000002,"stat_sum":{"num_bytes":1736720,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":80,"num_read_kb":120,"num_write":35,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134576+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:32.134576+0000","last_peered":"2024-09-11T06:17:32.134576+0000","last_clean":"2024-09-11T06:17:32.134576+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:32.134576+0000","last_undegraded":"2024-09-11T06:17:32.134576+0000","last_fullsized":"2024-09-11T06:17:32.134576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":218,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134059+0000","last_change":"2024-09-11T06:16:53.499469+0000","last_active":"2024-09-11T06:17:32.134059+0000","last_peered":"2024-09-11T06:17:32.134059+0000","last_clean":"2024-09-11T06:17:32.134059+0000","last_became_active":"2024-09-11T06:16:53.498584+0000","last_became_peered":"2024-09-11T06:16:53.498584+0000","last_unstale":"2024-09-11T06:17:32.134059+0000","last_undegraded":"2024-09-11T06:17:32.134059+0000","last_fullsized":"2024-09-11T06:17:32.134059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:54.729518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"46'99","reported_seq":816,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.247310+0000","last_change":"2024-09-11T06:17:32.135447+0000","last_active":"2024-09-11T06:17:32.247310+0000","last_peered":"2024-09-11T06:17:32.247310+0000","last_clean":"2024-09-11T06:17:32.247310+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:17:32.247310+0000","last_undegraded":"2024-09-11T06:17:32.247310+0000","last_fullsized":"2024-09-11T06:17:32.247310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:23.451874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043192000000000003,"stat_sum":{"num_bytes":911214,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1470,"num_read_kb":1452,"num_write":94,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.9","version":"45'47","reported_seq":498,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.136098+0000","last_change":"2024-09-11T06:17:32.136098+0000","last_active":"2024-09-11T06:17:32.136098+0000","last_peered":"2024-09-11T06:17:32.136098+0000","last_clean":"2024-09-11T06:17:32.136098+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:17:32.136098+0000","last_undegraded":"2024-09-11T06:17:32.136098+0000","last_fullsized":"2024-09-11T06:17:32.136098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:42.226803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001241151,"stat_sum":{"num_bytes":7243776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":366,"num_read_kb":473,"num_write":43,"num_write_kb":1279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.a","version":"45'23","reported_seq":168,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134969+0000","last_change":"2024-09-11T06:17:32.135201+0000","last_active":"2024-09-11T06:17:32.134969+0000","last_peered":"2024-09-11T06:17:32.134969+0000","last_clean":"2024-09-11T06:17:32.134969+0000","last_became_active":"2024-09-11T06:17:09.684600+0000","last_became_peered":"2024-09-11T06:17:09.684600+0000","last_unstale":"2024-09-11T06:17:32.134969+0000","last_undegraded":"2024-09-11T06:17:32.134969+0000","last_fullsized":"2024-09-11T06:17:32.134969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:24.124314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086025499999999998,"stat_sum":{"num_bytes":1036824,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":134,"num_write":19,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.b","version":"41'45","reported_seq":121,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-11T06:17:29.127104+0000","last_change":"2024-09-11T06:17:28.121919+0000","last_active":"2024-09-11T06:17:29.127104+0000","last_peered":"2024-09-11T06:17:29.127104+0000","last_clean":"2024-09-11T06:17:29.127104+0000","last_became_active":"2024-09-11T06:17:09.681406+0000","last_became_peered":"2024-09-11T06:17:09.681406+0000","last_unstale":"2024-09-11T06:17:29.127104+0000","last_undegraded":"2024-09-11T06:17:29.127104+0000","last_fullsized":"2024-09-11T06:17:29.127104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:16.555217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036633299999999999,"stat_sum":{"num_bytes":51087,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":52,"num_write":50,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.c","version":"45'36","reported_seq":410,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.137705+0000","last_change":"2024-09-11T06:17:32.137894+0000","last_active":"2024-09-11T06:17:32.137705+0000","last_peered":"2024-09-11T06:17:32.137705+0000","last_clean":"2024-09-11T06:17:32.137705+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:17:32.137705+0000","last_undegraded":"2024-09-11T06:17:32.137705+0000","last_fullsized":"2024-09-11T06:17:32.137705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:54.028967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000342939,"stat_sum":{"num_bytes":1032432,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":289,"num_read_kb":538,"num_write":35,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.d","version":"45'44","reported_seq":199,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135882+0000","last_change":"2024-09-11T06:17:32.135882+0000","last_active":"2024-09-11T06:17:32.135882+0000","last_peered":"2024-09-11T06:17:32.135882+0000","last_clean":"2024-09-11T06:17:32.135882+0000","last_became_active":"2024-09-11T06:17:09.684618+0000","last_became_peered":"2024-09-11T06:17:09.684618+0000","last_unstale":"2024-09-11T06:17:32.135882+0000","last_undegraded":"2024-09-11T06:17:32.135882+0000","last_fullsized":"2024-09-11T06:17:32.135882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:48.691631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014102979999999999,"stat_sum":{"num_bytes":2700892,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":115,"num_write":42,"num_write_kb":981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.e","version":"45'21","reported_seq":294,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.140526+0000","last_change":"2024-09-11T06:17:32.140685+0000","last_active":"2024-09-11T06:17:32.140526+0000","last_peered":"2024-09-11T06:17:32.140526+0000","last_clean":"2024-09-11T06:17:32.140526+0000","last_became_active":"2024-09-11T06:17:09.679886+0000","last_became_peered":"2024-09-11T06:17:09.679886+0000","last_unstale":"2024-09-11T06:17:32.140526+0000","last_undegraded":"2024-09-11T06:17:32.140526+0000","last_fullsized":"2024-09-11T06:17:32.140526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:48:24.148832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043049100000000002,"stat_sum":{"num_bytes":610835,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":190,"num_read_kb":341,"num_write":16,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.f","version":"42'64","reported_seq":2,"reported_epoch":43,"state":"peering","last_fresh":"2024-09-11T06:17:28.527737+0000","last_change":"2024-09-11T06:17:29.439675+0000","last_active":"2024-09-11T06:17:29.439675+0000","last_peered":"2024-09-11T06:17:28.527737+0000","last_clean":"2024-09-11T06:17:28.527737+0000","last_became_active":"2024-09-11T06:17:09.679342+0000","last_became_peered":"2024-09-11T06:17:09.679342+0000","last_unstale":"2024-09-11T06:17:28.527737+0000","last_undegraded":"2024-09-11T06:17:28.527737+0000","last_fullsized":"2024-09-11T06:17:28.527737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001015803,"stat_sum":{"num_bytes":548774,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":9,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":374,"num_read_kb":311,"num_write":74,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.10","version":"45'59","reported_seq":477,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.134664+0000","last_change":"2024-09-11T06:17:32.135521+0000","last_active":"2024-09-11T06:17:32.134664+0000","last_peered":"2024-09-11T06:17:32.134664+0000","last_clean":"2024-09-11T06:17:32.134664+0000","last_became_active":"2024-09-11T06:17:09.687700+0000","last_became_peered":"2024-09-11T06:17:09.687700+0000","last_unstale":"2024-09-11T06:17:32.134664+0000","last_undegraded":"2024-09-11T06:17:32.134664+0000","last_fullsized":"2024-09-11T06:17:32.134664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:05.735608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001496795,"stat_sum":{"num_bytes":5958928,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":333,"num_read_kb":917,"num_write":54,"num_write_kb":1418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.11","version":"45'29","reported_seq":115,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.135700+0000","last_change":"2024-09-11T06:17:32.135892+0000","last_active":"2024-09-11T06:17:32.135700+0000","last_peered":"2024-09-11T06:17:32.135700+0000","last_clean":"2024-09-11T06:17:32.135700+0000","last_became_active":"2024-09-11T06:17:09.683890+0000","last_became_peered":"2024-09-11T06:17:09.683890+0000","last_unstale":"2024-09-11T06:17:32.135700+0000","last_undegraded":"2024-09-11T06:17:32.135700+0000","last_fullsized":"2024-09-11T06:17:32.135700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:50.996877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012232930000000001,"stat_sum":{"num_bytes":1010146,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":27,"num_write_kb":472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]},{"pgid":"3.12","version":"42'46","reported_seq":249,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T06:17:31.189913+0000","last_change":"2024-09-11T06:17:28.133620+0000","last_active":"2024-09-11T06:17:31.189913+0000","last_peered":"2024-09-11T06:17:31.189913+0000","last_clean":"2024-09-11T06:17:31.189913+0000","last_became_active":"2024-09-11T06:17:09.685538+0000","last_became_peered":"2024-09-11T06:17:09.685538+0000","last_unstale":"2024-09-11T06:17:31.189913+0000","last_undegraded":"2024-09-11T06:17:31.189913+0000","last_fullsized":"2024-09-11T06:17:31.189913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:45.657203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000440488,"stat_sum":{"num_bytes":1210411,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":307,"num_write":43,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"8","length":"1"}]},{"pgid":"3.13","version":"45'75","reported_seq":579,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T06:17:32.304623+0000","last_change":"2024-09-11T06:17:32.135579+0000","last_active":"2024-09-11T06:17:32.304623+0000","last_peered":"2024-09-11T06:17:32.304623+0000","last_clean":"2024-09-11T06:17:32.304623+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:17:32.304623+0000","last_undegraded":"2024-09-11T06:17:32.304623+0000","last_fullsized":"2024-09-11T06:17:32.304623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:59.326929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011386910000000001,"stat_sum":{"num_bytes":16964374,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":419,"num_read_kb":505,"num_write":56,"num_write_kb":1283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"8","length":"1"},{"start":"a","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":117572732,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":9,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":16934,"num_read_kb":19891,"num_write":3605,"num_write_kb":23403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4771840,"data_stored":16934679,"data_compressed":447765,"data_compressed_allocated":1769472,"data_compressed_original":14605022,"omap_allocated":0,"internal_metadata":0},"log_size":2750,"ondisk_log_size":2750,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1269760,"data_stored":3152329,"data_compressed":92269,"data_compressed_allocated":315392,"data_compressed_original":2592768,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1003520,"data_stored":2627428,"data_compressed":54512,"data_compressed_allocated":262144,"data_compressed_original":2248704,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1294336,"data_stored":3494378,"data_compressed":58347,"data_compressed_allocated":315392,"data_compressed_original":2905455,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":2909795,"data_compressed":59773,"data_compressed_allocated":249856,"data_compressed_original":2285568,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1032192,"data_stored":2187877,"data_compressed":47086,"data_compressed_allocated":188416,"data_compressed_original":1708032,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1179648,"data_stored":2866578,"data_compressed":98935,"data_compressed_allocated":323584,"data_compressed_original":2397551,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1040384,"data_stored":816360,"data_compressed":903,"data_compressed_allocated":24576,"data_compressed_original":167936,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":622592,"data_stored":417049,"data_compressed":682,"data_compressed_allocated":16384,"data_compressed_original":122880,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":663552,"data_stored":2646215,"data_compressed":98935,"data_compressed_allocated":323584,"data_compressed_original":2397551,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":1522682,"data_compressed":39066,"data_compressed_allocated":163840,"data_compressed_original":1273856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":778240,"data_stored":2695704,"data_compressed":59773,"data_compressed_allocated":249856,"data_compressed_original":2285568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":786432,"data_stored":3280268,"data_compressed":58347,"data_compressed_allocated":315392,"data_compressed_original":2905455,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":2519610,"data_compressed":54982,"data_compressed_allocated":270336,"data_compressed_original":2351104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":2347870,"data_compressed":83600,"data_compressed_allocated":278528,"data_compressed_original":2019328,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":1680948,"data_compressed":52281,"data_compressed_allocated":147456,"data_compressed_original":1232896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":241382,"data_compressed":781,"data_compressed_allocated":20480,"data_compressed_original":139264,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:34.981 INFO:tasks.thrashosds.thrasher:Setting 3.12 to [3, 4, 1, 2] 2024-09-11T06:17:34.982 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.12', '3', '4', '1', '2'] 2024-09-11T06:17:34.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.12 3 4 1 2 2024-09-11T06:17:34.991 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:35.021 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:35.020+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:35.057 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:35.057 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:35.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:35.057 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.739598689999999, 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.058 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:17:35.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:17:35.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4270254720000004, 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:17:35.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:17:35.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16520 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 77824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.88019074799999997, 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093324900000000006, 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16520 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175413+0000", 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9800000000000001e-06 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175419+0000", 2024-09-11T06:17:35.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3519999999999997e-06 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175423+0000", 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.561e-06 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184591+0000", 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091677200000000007 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184672+0000", 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1107999999999997e-05 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184743+0000", 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1339000000000003e-05 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16521 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 114688~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.88017202000000005, 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095026380000000008, 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16521 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175432+0000", 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175438+0000", 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175445+0000", 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2219999999999996e-06 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184800+0000", 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009354322 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184848+0000", 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8398e-05 2024-09-11T06:17:35.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184932+0000", 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4132e-05 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16522 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 151552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.88008081800000004, 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096235079999999994, 2024-09-11T06:17:35.079 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16522 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175522+0000", 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1099999999999995e-07 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175525+0000", 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.619e-06 2024-09-11T06:17:35.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175535+0000", 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6590000000000002e-06 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175542+0000", 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2570000000000001e-06 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184976+0000", 2024-09-11T06:17:35.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094335619999999995 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185064+0000", 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8530999999999997e-05 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185144+0000", 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0168999999999998e-05 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16523 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 188416~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.880049356, 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099147300000000001, 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16523 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.084 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175553+0000", 2024-09-11T06:17:35.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175561+0000", 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5369999999999997e-06 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175571+0000", 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7480000000000005e-06 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175577+0000", 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-06 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185174+0000", 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095965570000000004 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185253+0000", 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8889999999999999e-05 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185467+0000", 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021430099999999999 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16524 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.88001535900000005, 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010599717999999999, 2024-09-11T06:17:35.088 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16524 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175587+0000", 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175589+0000", 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:17:35.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175596+0000", 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175601+0000", 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185553+0000", 2024-09-11T06:17:35.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099520630000000006 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185649+0000", 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6086000000000001e-05 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186186+0000", 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053697800000000002 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16553 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87926596899999998, 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010060193, 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16553 2024-09-11T06:17:35.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176340+0000", 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.405e-06 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176348+0000", 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8199999999999997e-06 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176354+0000", 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186219+0000", 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098650109999999999 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186298+0000", 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9383999999999998e-05 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186396+0000", 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7387999999999997e-05 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16554 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87923885300000004, 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010247795000000001, 2024-09-11T06:17:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16554 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176364+0000", 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5799999999999998e-07 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176366+0000", 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:17:35.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176373+0000", 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4289999999999998e-06 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176377+0000", 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186427+0000", 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010049742 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186511+0000", 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3991000000000003e-05 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186611+0000", 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9565e-05 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16555 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87921663900000002, 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010729601, 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.102 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16555 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176386+0000", 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176388+0000", 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176395+0000", 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:17:35.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176400+0000", 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186644+0000", 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010244052 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186742+0000", 2024-09-11T06:17:35.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8159999999999995e-05 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187115+0000", 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037263900000000002 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16593 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87916631999999995, 2024-09-11T06:17:35.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011057091, 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16593 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176436+0000", 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176439+0000", 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4509999999999999e-06 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176443+0000", 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6240000000000001e-06 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176446+0000", 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0649999999999999e-06 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187152+0000", 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010706194 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187231+0000", 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8234999999999999e-05 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187492+0000", 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026178300000000002 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16594 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87914722199999995, 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011362636000000001, 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16594 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.111 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176455+0000", 2024-09-11T06:17:35.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176457+0000", 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176463+0000", 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176469+0000", 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187542+0000", 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011073037000000001 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187615+0000", 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3013e-05 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187817+0000", 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020221099999999999 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16595 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87912815700000002, 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011570079, 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16595 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:35.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176478+0000", 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176482+0000", 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176485+0000", 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9050000000000001e-06 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187855+0000", 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011370066999999999 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187951+0000", 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5435999999999999e-05 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188044+0000", 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3010000000000006e-05 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16596 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.119 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87910608700000004, 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011742973, 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16596 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176498+0000", 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0889999999999998e-06 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176504+0000", 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176509+0000", 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:17:35.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188070+0000", 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01156101 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188138+0000", 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7527999999999994e-05 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188239+0000", 2024-09-11T06:17:35.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100725 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16597 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87908617, 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011917311999999999, 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16597 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176516+0000", 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176517+0000", 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.658e-06 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176521+0000", 2024-09-11T06:17:35.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9269999999999998e-06 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176526+0000", 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1110000000000001e-06 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188263+0000", 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011737632 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188340+0000", 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7113000000000005e-05 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188433+0000", 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2538000000000001e-05 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16598 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.128 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.879066813, 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012870312, 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16598 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176538+0000", 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176546+0000", 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176550+0000", 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.797e-06 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188466+0000", 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011915965000000001 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188550+0000", 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3446e-05 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189405+0000", 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085535500000000003 2024-09-11T06:17:35.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16619 3.6 3:6708c1ee:::rbd_data.116d3c8aaf0c.000000000000002e:b [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87881608700000002, 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012975781, 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16619 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7199999999999998e-07 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176789+0000", 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-06 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176797+0000", 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6310000000000003e-06 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176803+0000", 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6710000000000004e-06 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189440+0000", 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012637438000000001 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189511+0000", 2024-09-11T06:17:35.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1421000000000006e-05 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189761+0000", 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024988799999999998 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16675 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 196608~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.87281062099999995, 2024-09-11T06:17:35.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0092789550000000002, 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16675 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182792+0000", 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3399999999999998e-07 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182794+0000", 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182802+0000", 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4240000000000004e-06 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182807+0000", 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3800000000000002e-06 2024-09-11T06:17:35.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.191714+0000", 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0089070399999999997 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.191797+0000", 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2863999999999998e-05 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.192070+0000", 2024-09-11T06:17:35.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000272792 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:17472 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.82472884800000001, 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013625929, 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.142 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 17472 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230874+0000", 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2999999999999999e-07 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230878+0000", 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4209999999999997e-06 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230888+0000", 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0356e-05 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230895+0000", 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9530000000000002e-06 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230940+0000", 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4589000000000003e-05 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230995+0000", 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5390000000000003e-05 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231196+0000", 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020024499999999999 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231787+0000", 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059133700000000005 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244412+0000", 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012624803 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244460+0000", 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7802000000000001e-05 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244499+0000", 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9202999999999997e-05 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.147 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18219 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.80070217200000005, 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011081077, 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:35.148 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18219 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254900+0000", 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-07 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254905+0000", 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254916+0000", 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0949e-05 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254925+0000", 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254972+0000", 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6826999999999997e-05 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255031+0000", 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9364000000000003e-05 2024-09-11T06:17:35.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255240+0000", 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020845600000000001 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255893+0000", 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00065294500000000004 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265665+0000", 2024-09-11T06:17:35.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097724279999999997 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265932+0000", 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267197 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265981+0000", 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8083e-05 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:35.154 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:35.154 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:35.154 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:35.155 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:35.156 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:35.156 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:35.154+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:35.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:17:35.165 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:35.184 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:35.184 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:35.202 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:35.202 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:35.219 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:35.219 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:35.237 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:35.237 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:35.253 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:35.254 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:35.256 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:35.255+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:35.271 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:35.272 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:35.300 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:35.300 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:35.305 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-11T06:17:35.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:35.357 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:35.357+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:35.417 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:35.417 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:35.425 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:35.458 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:35.457+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:35.481 INFO:teuthology.orchestra.run.smithi070.stdout:1460 writesame 0x2a56450 thru 0x2a5a2eb data_size 0x2(0x3e9c bytes) 2024-09-11T06:17:35.492 INFO:teuthology.orchestra.run.smithi070.stdout:1463 write 0x69a8faa thru 0x69a9762 (0x7b9 bytes) 2024-09-11T06:17:35.496 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:35.496 INFO:teuthology.orchestra.run.smithi070.stdout:1467 write 0x11d94e1 thru 0x11de9a5 (0x54c5 bytes) 2024-09-11T06:17:35.496 INFO:teuthology.orchestra.run.smithi070.stdout:1468 read 0xabd4a62 thru 0xabdbcab (0x724a bytes) 2024-09-11T06:17:35.505 INFO:teuthology.orchestra.run.smithi070.stdout:1472 trunc from 0xd4b7c37 to 0x584e788 2024-09-11T06:17:35.517 INFO:teuthology.orchestra.run.smithi070.stdout:1473 punch from 0x387115d to 0x3875882, (0x4725 bytes) 2024-09-11T06:17:35.517 INFO:teuthology.orchestra.run.smithi070.stdout:1474 writesame 0x18a5216 thru 0x18ad6d6 data_size 0x7(0x84c1 bytes) 2024-09-11T06:17:35.529 INFO:teuthology.orchestra.run.smithi070.stdout:1475 write 0x81cd841 thru 0x81d39bf (0x617f bytes) 2024-09-11T06:17:35.534 INFO:teuthology.orchestra.run.smithi070.stdout:1476 write 0x4681571 thru 0x4683692 (0x2122 bytes) 2024-09-11T06:17:35.538 INFO:teuthology.orchestra.run.smithi070.stdout:1477 write 0x6d824e2 thru 0x6d88e01 (0x6920 bytes) 2024-09-11T06:17:35.549 INFO:teuthology.orchestra.run.smithi070.stdout:1478 writesame 0x8a89738 thru 0x8a8cb3c data_size 0x3(0x3405 bytes) 2024-09-11T06:17:35.557 INFO:teuthology.orchestra.run.smithi070.stdout:1479 write 0xa2d9950 thru 0xa2dffbe (0x666f bytes) 2024-09-11T06:17:35.558 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:35.557+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:35.572 INFO:teuthology.orchestra.run.smithi070.stdout:1480 write 0xdf44cf8 thru 0xdf53cd2 (0xefdb bytes) 2024-09-11T06:17:35.579 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:35.579 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:35.581 INFO:teuthology.orchestra.run.smithi070.stdout:1481 writesame 0xb0055ce thru 0xb013601 data_size 0x6(0xe034 bytes) 2024-09-11T06:17:35.590 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:35.591 INFO:teuthology.orchestra.run.smithi070.stdout:1482 punch from 0x756c56d to 0x75739fb, (0x748e bytes) 2024-09-11T06:17:35.591 INFO:teuthology.orchestra.run.smithi070.stdout:1483 read 0xded8138 thru 0xdedd01b (0x4ee4 bytes) 2024-09-11T06:17:35.591 INFO:teuthology.orchestra.run.smithi070.stdout:1484 punch from 0x917fb2 to 0x91f47c, (0x74ca bytes) 2024-09-11T06:17:35.591 INFO:teuthology.orchestra.run.smithi070.stdout:1485 read 0x69f7435 thru 0x6a06e7d (0xfa49 bytes) 2024-09-11T06:17:35.591 INFO:teuthology.orchestra.run.smithi070.stdout:1486 read 0x3b57e65 thru 0x3b58467 (0x603 bytes) 2024-09-11T06:17:35.591 INFO:teuthology.orchestra.run.smithi070.stdout:1487 read 0xbe52094 thru 0xbe61cc9 (0xfc36 bytes) 2024-09-11T06:17:35.592 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:35.592 INFO:teuthology.orchestra.run.smithi070.stdout:1489 write 0x83f3381 thru 0x83f6fa8 (0x3c28 bytes) 2024-09-11T06:17:35.594 INFO:teuthology.orchestra.run.smithi070.stdout:1490 write 0x1bd4c26 thru 0x1bdb374 (0x674f bytes) 2024-09-11T06:17:35.596 INFO:teuthology.orchestra.run.smithi070.stdout:1491 read 0x13373af thru 0x1339fcf (0x2c21 bytes) 2024-09-11T06:17:35.597 INFO:teuthology.orchestra.run.smithi070.stdout:1495 write 0x7ea64ea thru 0x7eabc58 (0x576f bytes) 2024-09-11T06:17:35.600 INFO:teuthology.orchestra.run.smithi070.stdout:1496 read 0xc8bcb29 thru 0xc8c23dc (0x58b4 bytes) 2024-09-11T06:17:35.600 INFO:teuthology.orchestra.run.smithi070.stdout:1497 read 0x688b132 thru 0x688c741 (0x1610 bytes) 2024-09-11T06:17:35.600 INFO:teuthology.orchestra.run.smithi070.stdout:1498 read 0x965a6ca thru 0x966192d (0x7264 bytes) 2024-09-11T06:17:35.600 INFO:teuthology.orchestra.run.smithi070.stdout:1500 punch from 0xdc8867b to 0xdc91fbb, (0x9940 bytes) 2024-09-11T06:17:35.600 INFO:teuthology.orchestra.run.smithi070.stdout:1502 write 0x9b04786 thru 0x9b1010c (0xb987 bytes) 2024-09-11T06:17:35.610 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:35.610 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0xe9eac60 2024-09-11T06:17:35.610 INFO:teuthology.orchestra.run.smithi070.stdout:1504 trunc from 0xdf53cd3 to 0xe9eac60 2024-09-11T06:17:35.616 INFO:teuthology.orchestra.run.smithi070.stdout:1507 read 0xd446561 thru 0xd44c55e (0x5ffe bytes) 2024-09-11T06:17:35.616 INFO:teuthology.orchestra.run.smithi070.stdout:1509 punch from 0x16a9a45 to 0x16b0c2d, (0x71e8 bytes) 2024-09-11T06:17:35.616 INFO:teuthology.orchestra.run.smithi070.stdout:1510 read 0x9da9f49 thru 0x9daff32 (0x5fea bytes) 2024-09-11T06:17:35.616 INFO:teuthology.orchestra.run.smithi070.stdout:1511 read 0x9b72ffe thru 0x9b738ab (0x8ae bytes) 2024-09-11T06:17:35.617 INFO:teuthology.orchestra.run.smithi070.stdout:1512 read 0xd64ce46 thru 0xd653d4d (0x6f08 bytes) 2024-09-11T06:17:35.617 INFO:teuthology.orchestra.run.smithi070.stdout:1513 punch from 0xcf3dcc to 0xcfeaf1, (0xad25 bytes) 2024-09-11T06:17:35.617 INFO:teuthology.orchestra.run.smithi070.stdout:1514 punch from 0xcbd84ef to 0xcbde3e1, (0x5ef2 bytes) 2024-09-11T06:17:35.617 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:35.620 INFO:teuthology.orchestra.run.smithi070.stdout:1516 trunc from 0xe9eac60 to 0xb31ad6f 2024-09-11T06:17:35.637 INFO:teuthology.orchestra.run.smithi070.stdout:1517 write 0x52a10a9 thru 0x52a275d (0x16b5 bytes) 2024-09-11T06:17:35.640 INFO:teuthology.orchestra.run.smithi070.stdout:1518 write 0x4d3d6ad thru 0x4d3e5e5 (0xf39 bytes) 2024-09-11T06:17:35.643 INFO:teuthology.orchestra.run.smithi070.stdout:1519 read 0x5528cbb thru 0x5530e6f (0x81b5 bytes) 2024-09-11T06:17:35.644 INFO:teuthology.orchestra.run.smithi070.stdout:1520 write 0x20d1ad0 thru 0x20da8a4 (0x8dd5 bytes) 2024-09-11T06:17:35.649 INFO:teuthology.orchestra.run.smithi070.stdout:1521 punch from 0x164ed0b to 0x165b2e4, (0xc5d9 bytes) 2024-09-11T06:17:35.649 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:35.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:35.658+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:35.659 INFO:teuthology.orchestra.run.smithi070.stdout:1525 trunc from 0xb31ad6f to 0x1f389ea 2024-09-11T06:17:35.687 INFO:teuthology.orchestra.run.smithi070.stdout:1526 clone 6 order 25 su 4194304 sc 8 2024-09-11T06:17:35.704 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:35.704 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:35.713 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:35.760 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:35.760+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:35.857 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:35.857 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:35.861 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:35.861+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:35.865 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:35.962 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:35.962+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:35.967 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:35.967 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:35.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:36.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:36.062+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:36.079 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:36.079 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:36.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:36.154 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.12 pg_upmap_items mapping to [3->4,1->2] 2024-09-11T06:17:36.157 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:17:36.164 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:36.163+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:36.234 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:36.234 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:36.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:36.266 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:36.265+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:36.346 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:36.346 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:36.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:36.367 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:36.366+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:36.462 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:36.462 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:36.467 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:36.467+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:36.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:36.568 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:36.567+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:36.572 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:36.572 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:36.581 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:36.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:36.668+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:36.684 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:36.684 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:36.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:36.770 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:36.769+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:36.795 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:36.795 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:36.803 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:36.871 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:36.870+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:36.905 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:36.905 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:36.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:36.998 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:36.997+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:37.056 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:37.056 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:37.065 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:37.073 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:37.073+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:37.175 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:37.175+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:37.232 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:37.232 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:37.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:37.283 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:37.282+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:37.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:37.376 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:37.376+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:37.387 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:37.387 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:37.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:37.447 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:37.447 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:37.464 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:37.464 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:37.478 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:37.477+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:37.480 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:37.480 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:37.496 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:37.497 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:37.514 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:37.514 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:37.531 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:37.531 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:37.545 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2271 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.285412974, 2024-09-11T06:17:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012468982999999999, 2024-09-11T06:17:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258004+0000", 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6419999999999999e-06 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258011+0000", 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4599999999999997e-06 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258025+0000", 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3804e-05 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258033+0000", 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4239999999999993e-06 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258089+0000", 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.588e-05 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258147+0000", 2024-09-11T06:17:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000002e-05 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.260204+0000", 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020570269999999999 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270393+0000", 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010188657 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270403+0000", 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270437+0000", 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3373e-05 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270471+0000", 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4073999999999999e-05 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2403 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.101776073, 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018324528999999999, 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2403 2024-09-11T06:17:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441640+0000", 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441646+0000", 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441656+0000", 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0257e-05 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441661+0000", 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0549999999999999e-06 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441710+0000", 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8446999999999999e-05 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441761+0000", 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1060999999999998e-05 2024-09-11T06:17:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.444470+0000", 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027092539999999999 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459870+0000", 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015399629 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459881+0000", 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1382e-05 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459926+0000", 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4505000000000002e-05 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459963+0000", 2024-09-11T06:17:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7759999999999998e-05 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:19858 3.16 3:68c4e96c:::rbd_data.116d3c8aaf0c.00000000000000a4:b [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.331742+0000", 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.2116729880000001, 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094078459999999992, 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 19858 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.331742+0000", 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.331742+0000", 2024-09-11T06:17:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.331742+0000", 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.331744+0000", 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9379999999999999e-06 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.331753+0000", 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9700000000000005e-06 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.331758+0000", 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6360000000000002e-06 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.339918+0000", 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081603950000000008 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.339998+0000", 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-05 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.341150+0000", 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001151956 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21955 3.e 3:746369b5:::rbd_data.116d3c8aaf0c.0000000000000353:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.615872+0000", 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9275424509999999, 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091808629999999992, 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21955 2024-09-11T06:17:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615872+0000", 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615872+0000", 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615873+0000", 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.96e-07 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615875+0000", 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615881+0000", 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:17:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615886+0000", 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8280000000000002e-06 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.624879+0000", 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089934639999999996 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.624962+0000", 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2978000000000004e-05 2024-09-11T06:17:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625053+0000", 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1236999999999994e-05 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21956 3.e 3:746369b5:::rbd_data.116d3c8aaf0c.0000000000000353:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.615892+0000", 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9275231050000001, 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093875750000000004, 2024-09-11T06:17:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21956 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615892+0000", 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615892+0000", 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615892+0000", 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999996e-07 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615894+0000", 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0490000000000002e-06 2024-09-11T06:17:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615908+0000", 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3791000000000001e-05 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615913+0000", 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7389999999999999e-06 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625110+0000", 2024-09-11T06:17:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091973760000000002 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625189+0000", 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8626000000000002e-05 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625279+0000", 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-05 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21957 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.615921+0000", 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.927494383, 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093243119999999995, 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21957 2024-09-11T06:17:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615921+0000", 2024-09-11T06:17:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615921+0000", 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615921+0000", 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999996e-07 2024-09-11T06:17:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615923+0000", 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.277e-06 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615930+0000", 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615934+0000", 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5090000000000004e-06 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625083+0000", 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091490159999999994 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625157+0000", 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4213000000000002e-05 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625245+0000", 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7603999999999997e-05 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21959 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.616401+0000", 2024-09-11T06:17:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.927014072, 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091956009999999994, 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21959 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616401+0000", 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616401+0000", 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616401+0000", 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8299999999999998e-07 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616404+0000", 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.272e-06 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616410+0000", 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616414+0000", 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7859999999999996e-06 2024-09-11T06:17:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625491+0000", 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090765069999999993 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625537+0000", 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6164e-05 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625596+0000", 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9339999999999998e-05 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21960 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.616421+0000", 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9269937860000002, 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093335399999999995, 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21960 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616421+0000", 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616421+0000", 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616422+0000", 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-07 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616428+0000", 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1829999999999999e-06 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616443+0000", 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5523999999999999e-05 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616449+0000", 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625632+0000", 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091831090000000001 2024-09-11T06:17:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625678+0000", 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5578000000000003e-05 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625755+0000", 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6810999999999994e-05 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21961 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 163840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.616456+0000", 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9269585739999999, 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094367210000000003, 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21961 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616456+0000", 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616456+0000", 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616457+0000", 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616459+0000", 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4609999999999998e-06 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616463+0000", 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0280000000000002e-06 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616466+0000", 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6929999999999999e-06 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625787+0000", 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093209639999999993 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625834+0000", 2024-09-11T06:17:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6845999999999998e-05 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625893+0000", 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9287999999999999e-05 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21962 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.616469+0000", 2024-09-11T06:17:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9269454640000001, 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095753799999999997, 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21962 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616469+0000", 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616469+0000", 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616470+0000", 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616471+0000", 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0219999999999999e-06 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616474+0000", 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.937e-06 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616476+0000", 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6000000000000001e-06 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625940+0000", 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094636059999999994 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.625990+0000", 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0478e-05 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626045+0000", 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4407000000000003e-05 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21963 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 237568~2209 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.616479+0000", 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9269355340000001, 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098849430000000002, 2024-09-11T06:17:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21963 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616479+0000", 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616479+0000", 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616480+0000", 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616481+0000", 2024-09-11T06:17:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0559999999999999e-06 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616484+0000", 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.988e-06 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616486+0000", 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4719999999999998e-06 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626118+0000", 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096319969999999998 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626202+0000", 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3906999999999995e-05 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626364+0000", 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016230800000000001 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21974 3.e 3:746369b5:::rbd_data.116d3c8aaf0c.0000000000000353:b [read 20480~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.616489+0000", 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9269259380000001, 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097678030000000002, 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21974 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616489+0000", 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616489+0000", 2024-09-11T06:17:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616489+0000", 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.16e-07 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616491+0000", 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.762e-06 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616494+0000", 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616497+0000", 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.83e-06 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626076+0000", 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009579288 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626162+0000", 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.598e-05 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626257+0000", 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4752000000000004e-05 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21975 3.e 3:746369b5:::rbd_data.116d3c8aaf0c.0000000000000353:b [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.616500+0000", 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.926915079, 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099424249999999995, 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21975 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616500+0000", 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616500+0000", 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616500+0000", 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2499999999999999e-07 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616501+0000", 2024-09-11T06:17:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616504+0000", 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.999e-06 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616508+0000", 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5480000000000002e-06 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626284+0000", 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097768279999999996 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626357+0000", 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2381999999999999e-05 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626442+0000", 2024-09-11T06:17:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5447999999999999e-05 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21976 3.e 3:746369b5:::rbd_data.116d3c8aaf0c.0000000000000353:b [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.616513+0000", 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9269017760000002, 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010149223000000001, 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21976 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616513+0000", 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616513+0000", 2024-09-11T06:17:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616513+0000", 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616514+0000", 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616517+0000", 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0060000000000001e-06 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.616520+0000", 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4109999999999999e-06 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626488+0000", 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099683610000000002 2024-09-11T06:17:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626568+0000", 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0247000000000006e-05 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.626662+0000", 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3900999999999994e-05 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21981 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.617964+0000", 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9254507190000001, 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092474480000000001, 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21981 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617964+0000", 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617964+0000", 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617964+0000", 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:17:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617966+0000", 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.623e-06 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617969+0000", 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1370000000000002e-06 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617972+0000", 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4040000000000002e-06 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627100+0000", 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009128298 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627150+0000", 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9898999999999998e-05 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627212+0000", 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1866999999999996e-05 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21982 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.617975+0000", 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9254401969999999, 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093964990000000009, 2024-09-11T06:17:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21982 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617975+0000", 2024-09-11T06:17:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617975+0000", 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617975+0000", 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617976+0000", 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9099999999999991e-07 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617979+0000", 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.061e-06 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617982+0000", 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627256+0000", 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092749319999999996 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627311+0000", 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4577999999999998e-05 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627371+0000", 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0205999999999999e-05 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21983 3.16 3:6d3a7e19:::rbd_data.116d3c8aaf0c.000000000000031e:b [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.617985+0000", 2024-09-11T06:17:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9254303630000003, 2024-09-11T06:17:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096030609999999995, 2024-09-11T06:17:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21983 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617985+0000", 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617985+0000", 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617985+0000", 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617986+0000", 2024-09-11T06:17:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8400000000000002e-07 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617989+0000", 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.021e-06 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617991+0000", 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4329999999999998e-06 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627412+0000", 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094205009999999995 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627487+0000", 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5735999999999995e-05 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627588+0000", 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010015599999999999 2024-09-11T06:17:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21993 3.e 3:746369b5:::rbd_data.116d3c8aaf0c.0000000000000353:b [read 24576~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.617994+0000", 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.925420779, 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094787310000000007, 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21993 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617994+0000", 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617994+0000", 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617994+0000", 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-07 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617995+0000", 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7699999999999992e-07 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.617998+0000", 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9919999999999999e-06 2024-09-11T06:17:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618001+0000", 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6699999999999998e-06 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627388+0000", 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093873280000000003 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627426+0000", 2024-09-11T06:17:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7997999999999998e-05 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627473+0000", 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6532000000000001e-05 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21994 3.e 3:746369b5:::rbd_data.116d3c8aaf0c.0000000000000353:b [read 61440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.618004+0000", 2024-09-11T06:17:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9254109860000002, 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095766749999999998, 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21994 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618004+0000", 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618004+0000", 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618004+0000", 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618005+0000", 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.018e-06 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618008+0000", 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0340000000000001e-06 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618012+0000", 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8820000000000003e-06 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627487+0000", 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094744470000000004 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627523+0000", 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6259e-05 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627581+0000", 2024-09-11T06:17:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7825999999999998e-05 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21995 3.e 3:746369b5:::rbd_data.116d3c8aaf0c.0000000000000353:b [read 98304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.618018+0000", 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9253973640000002, 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098087829999999997, 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21995 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618018+0000", 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618018+0000", 2024-09-11T06:17:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618018+0000", 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2000000000000001e-07 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618021+0000", 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3730000000000001e-06 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618027+0000", 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.618032+0000", 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3810000000000001e-06 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627595+0000", 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095630809999999993 2024-09-11T06:17:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627672+0000", 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7477000000000004e-05 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.627826+0000", 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000154246 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:37.643 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:37.643 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:37.644 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:37.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:37.645 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:37.646 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:37.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:37.643+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:37.745 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:37.744+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:37.788 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:37.788 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:37.788 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:37.788 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:37.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:37.846 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:37.845+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:37.900 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:37.901 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:37.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:37.952 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:37.949+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:38.048 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:38.047+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:38.056 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.435660917, 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:17:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:17:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.141225339000002, 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:17:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16806 3.9 3:933a7220:::rbd_data.116d3c8aaf0c.0000000000000018:b [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8683641680000003, 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036862515999999998, 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16806 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186927+0000", 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9400000000000005e-07 2024-09-11T06:17:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187820+0000", 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089324900000000004 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187832+0000", 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1494e-05 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187839+0000", 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.486e-06 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223214+0000", 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035374783999999999 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223280+0000", 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6157999999999999e-05 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223789+0000", 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050865100000000005 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16818 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8674130670000002, 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036928510999999997, 2024-09-11T06:17:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16818 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187878+0000", 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187880+0000", 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3649999999999998e-06 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187887+0000", 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4019999999999999e-06 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187892+0000", 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.091e-06 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224245+0000", 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036352885000000001 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224532+0000", 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028740800000000001 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224806+0000", 2024-09-11T06:17:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027381999999999998 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16819 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8673854680000002, 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037215051999999998, 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16819 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187907+0000", 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1679999999999998e-06 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187914+0000", 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5409999999999997e-06 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187919+0000", 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224841+0000", 2024-09-11T06:17:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036922117999999997 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225021+0000", 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180173 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225120+0000", 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8987000000000006e-05 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16820 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8673645900000002, 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037628920000000003, 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16820 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187928+0000", 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9599999999999999e-06 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187944+0000", 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6293000000000001e-05 2024-09-11T06:17:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187950+0000", 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3149999999999999e-06 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225172+0000", 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037222435999999998 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225258+0000", 2024-09-11T06:17:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5908000000000005e-05 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225555+0000", 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029660999999999999 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16821 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8673333130000001, 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037879496999999998, 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16821 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187958+0000", 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187960+0000", 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3269999999999999e-06 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187966+0000", 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-06 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187971+0000", 2024-09-11T06:17:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0830000000000003e-06 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225612+0000", 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037640831 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225734+0000", 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122104 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225837+0000", 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010223800000000001 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16822 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 163840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8673124510000001, 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038088416999999999, 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16822 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187980+0000", 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187987+0000", 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0809999999999999e-06 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187991+0000", 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2420000000000002e-06 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225884+0000", 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037893139999999999 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225957+0000", 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3306000000000006e-05 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226066+0000", 2024-09-11T06:17:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109103 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16823 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8672937310000002, 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038574642999999999, 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16823 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187999+0000", 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.12e-06 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188005+0000", 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188010+0000", 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-06 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226107+0000", 2024-09-11T06:17:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03809676 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226463+0000", 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035599299999999998 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226571+0000", 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108725 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16824 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.867275003, 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039232345000000002, 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16824 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188016+0000", 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188018+0000", 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.933e-06 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188024+0000", 2024-09-11T06:17:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2310000000000001e-06 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188038+0000", 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3837e-05 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226631+0000", 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038593589999999997 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226743+0000", 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111192 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227248+0000", 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050521599999999996 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16915 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8668034570000001, 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038728892000000001, 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16915 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188489+0000", 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9190000000000002e-06 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188495+0000", 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6930000000000004e-06 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188505+0000", 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0203999999999999e-05 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226603+0000", 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038097497000000001 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226680+0000", 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7115999999999998e-05 2024-09-11T06:17:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227216+0000", 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000536123 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16916 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.866774988, 2024-09-11T06:17:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03972564, 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16916 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188516+0000", 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188518+0000", 2024-09-11T06:17:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.058e-06 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188524+0000", 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.015e-06 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188528+0000", 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739999999999999e-06 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227244+0000", 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038716172 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227328+0000", 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3120000000000004e-05 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228241+0000", 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091343800000000003 2024-09-11T06:17:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16917 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8667560290000003, 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039912402999999999, 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16917 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188535+0000", 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-07 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188539+0000", 2024-09-11T06:17:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8940000000000003e-06 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188544+0000", 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6250000000000004e-06 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188553+0000", 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2359999999999993e-06 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228275+0000", 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039721226999999998 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228354+0000", 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370999999999996e-05 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228447+0000", 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2692e-05 2024-09-11T06:17:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16918 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8667308509999998, 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040097763000000002, 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16918 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2e-07 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188562+0000", 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188568+0000", 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1419999999999998e-06 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188573+0000", 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6940000000000003e-06 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228491+0000", 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039918355000000003 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228564+0000", 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2621999999999997e-05 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228657+0000", 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517000000000006e-05 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16919 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8667120210000001, 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040276407, 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16919 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188579+0000", 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188581+0000", 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188586+0000", 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8409999999999996e-06 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188601+0000", 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4545999999999999e-05 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228687+0000", 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040086418999999998 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228761+0000", 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3761000000000001e-05 2024-09-11T06:17:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228855+0000", 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3628000000000005e-05 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16920 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.866682188, 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040512056999999997, 2024-09-11T06:17:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16920 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188609+0000", 2024-09-11T06:17:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999996e-07 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188611+0000", 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.176e-06 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188618+0000", 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4769999999999997e-06 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188623+0000", 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8060000000000002e-06 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228884+0000", 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040261107999999997 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228959+0000", 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5100999999999998e-05 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229120+0000", 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016078500000000001 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16927 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8665750249999999, 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040618147, 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16927 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188716+0000", 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188717+0000", 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.283e-06 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188721+0000", 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9020000000000001e-06 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188723+0000", 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5950000000000001e-06 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229151+0000", 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040427053999999997 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229230+0000", 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9467000000000003e-05 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229334+0000", 2024-09-11T06:17:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010351799999999999 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16928 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.866564034, 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040816636000000003, 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16928 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188727+0000", 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188728+0000", 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0690000000000001e-06 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188731+0000", 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.982e-06 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188733+0000", 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.458e-06 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229364+0000", 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040631035000000003 2024-09-11T06:17:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229445+0000", 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0925000000000002e-05 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229543+0000", 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7956999999999997e-05 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16929 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8665542749999999, 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041025210999999999, 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16929 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188737+0000", 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0380000000000001e-06 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188740+0000", 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188744+0000", 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229575+0000", 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040831329 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229656+0000", 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0924e-05 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229761+0000", 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105171 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16930 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8665406120000001, 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041241585999999997, 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16930 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188752+0000", 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188758+0000", 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188762+0000", 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229808+0000", 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041046760000000002 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229854+0000", 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5365999999999999e-05 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229991+0000", 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013750200000000001 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:38.155 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:38.157 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:38.157 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:38.156+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:38.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:17:38.210 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-11T06:17:38.257 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:38.256+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:38.272 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:38.272 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:38.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:38.360 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:38.357+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:38.390 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:38.390 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:38.390 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:38.390 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:38.390 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:38.399 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:38.459 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:38.458+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:38.498 INFO:teuthology.orchestra.run.smithi070.stdout:1527 trunc from 0x1f389ea to 0xa9e6d5c 2024-09-11T06:17:38.507 INFO:teuthology.orchestra.run.smithi070.stdout:1528 punch from 0x62a303b to 0x62af09c, (0xc061 bytes) 2024-09-11T06:17:38.507 INFO:teuthology.orchestra.run.smithi070.stdout:1529 write 0x440eb57 thru 0x4412e4d (0x42f7 bytes) 2024-09-11T06:17:38.509 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.509 INFO:teuthology.orchestra.run.smithi070.stdout:1534 write 0x112cfa4 thru 0x1131ae6 (0x4b43 bytes) 2024-09-11T06:17:38.518 INFO:teuthology.orchestra.run.smithi070.stdout:1535 trunc from 0xa9e6d5c to 0x3b21bd9 2024-09-11T06:17:38.534 INFO:teuthology.orchestra.run.smithi070.stdout:1539 writesame 0x5c8c187 thru 0x5c92759 data_size 0x1(0x65d3 bytes) 2024-09-11T06:17:38.535 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.535 INFO:teuthology.orchestra.run.smithi070.stdout:1541 punch from 0x4371e24 to 0x4375616, (0x37f2 bytes) 2024-09-11T06:17:38.536 INFO:teuthology.orchestra.run.smithi070.stdout:1542 writesame 0x30b6202 thru 0x30c583b data_size 0x1(0xf63a bytes) 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.229320080000001, 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:17:38.547 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:17:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.916746862, 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.553 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:17:38.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:17:38.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:17:38.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16520 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 77824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3699121380000001, 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093324900000000006, 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.559 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16520 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175413+0000", 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9800000000000001e-06 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175419+0000", 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3519999999999997e-06 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175423+0000", 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.561e-06 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184591+0000", 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091677200000000007 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184672+0000", 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1107999999999997e-05 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184743+0000", 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1339000000000003e-05 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16521 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 114688~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3698934099999995, 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095026380000000008, 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.566 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16521 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175432+0000", 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:17:38.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175438+0000", 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175445+0000", 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2219999999999996e-06 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184800+0000", 2024-09-11T06:17:38.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009354322 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184848+0000", 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8398e-05 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184932+0000", 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4132e-05 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16522 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 151552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3698022080000003, 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096235079999999994, 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16522 2024-09-11T06:17:38.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175522+0000", 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1099999999999995e-07 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175525+0000", 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.619e-06 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175535+0000", 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6590000000000002e-06 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175542+0000", 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2570000000000001e-06 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184976+0000", 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094335619999999995 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185064+0000", 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8530999999999997e-05 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185144+0000", 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0168999999999998e-05 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16523 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 188416~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3697707460000004, 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099147300000000001, 2024-09-11T06:17:38.575 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16523 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175553+0000", 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175561+0000", 2024-09-11T06:17:38.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5369999999999997e-06 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175571+0000", 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7480000000000005e-06 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175577+0000", 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-06 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185174+0000", 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095965570000000004 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185253+0000", 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8889999999999999e-05 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185467+0000", 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021430099999999999 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.579 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16524 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3697367490000003, 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010599717999999999, 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16524 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175587+0000", 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175589+0000", 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175596+0000", 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-11T06:17:38.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175601+0000", 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185553+0000", 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099520630000000006 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185649+0000", 2024-09-11T06:17:38.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6086000000000001e-05 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186186+0000", 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053697800000000002 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16553 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3689873590000001, 2024-09-11T06:17:38.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010060193, 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16553 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176340+0000", 2024-09-11T06:17:38.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.405e-06 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176348+0000", 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8199999999999997e-06 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176354+0000", 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186219+0000", 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098650109999999999 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186298+0000", 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9383999999999998e-05 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186396+0000", 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7387999999999997e-05 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.588 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16554 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3689602430000001, 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010247795000000001, 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.589 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16554 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176364+0000", 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5799999999999998e-07 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176366+0000", 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176373+0000", 2024-09-11T06:17:38.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4289999999999998e-06 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176377+0000", 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186427+0000", 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010049742 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186511+0000", 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3991000000000003e-05 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186611+0000", 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9565e-05 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16555 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.593 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3689380289999997, 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010729601, 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16555 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176386+0000", 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176388+0000", 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176395+0000", 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176400+0000", 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:17:38.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186644+0000", 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010244052 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186742+0000", 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8159999999999995e-05 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187115+0000", 2024-09-11T06:17:38.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037263900000000002 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16593 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3688877100000001, 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011057091, 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16593 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176436+0000", 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176439+0000", 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4509999999999999e-06 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176443+0000", 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6240000000000001e-06 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176446+0000", 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0649999999999999e-06 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187152+0000", 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010706194 2024-09-11T06:17:38.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187231+0000", 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8234999999999999e-05 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187492+0000", 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026178300000000002 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16594 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.368868612, 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011362636000000001, 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16594 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176455+0000", 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:17:38.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176457+0000", 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176463+0000", 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176469+0000", 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:17:38.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187542+0000", 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011073037000000001 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187615+0000", 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3013e-05 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187817+0000", 2024-09-11T06:17:38.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020221099999999999 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16595 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3688495469999999, 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011570079, 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16595 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176478+0000", 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176482+0000", 2024-09-11T06:17:38.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176485+0000", 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9050000000000001e-06 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187855+0000", 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011370066999999999 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187951+0000", 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5435999999999999e-05 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188044+0000", 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3010000000000006e-05 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16596 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.368827477, 2024-09-11T06:17:38.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011742973, 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16596 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:38.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176498+0000", 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0889999999999998e-06 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176504+0000", 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176509+0000", 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188070+0000", 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01156101 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188138+0000", 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7527999999999994e-05 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188239+0000", 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100725 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.615 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16597 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3688075599999996, 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011917311999999999, 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.616 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16597 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176516+0000", 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176517+0000", 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.658e-06 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176521+0000", 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9269999999999998e-06 2024-09-11T06:17:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176526+0000", 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1110000000000001e-06 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188263+0000", 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011737632 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188340+0000", 2024-09-11T06:17:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7113000000000005e-05 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188433+0000", 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2538000000000001e-05 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16598 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3687882030000003, 2024-09-11T06:17:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012870312, 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16598 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176538+0000", 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176546+0000", 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176550+0000", 2024-09-11T06:17:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.797e-06 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188466+0000", 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011915965000000001 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188550+0000", 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3446e-05 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189405+0000", 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085535500000000003 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16619 3.6 3:6708c1ee:::rbd_data.116d3c8aaf0c.000000000000002e:b [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3685374770000003, 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012975781, 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16619 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7199999999999998e-07 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176789+0000", 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-06 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176797+0000", 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6310000000000003e-06 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176803+0000", 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6710000000000004e-06 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189440+0000", 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012637438000000001 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189511+0000", 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1421000000000006e-05 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189761+0000", 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024988799999999998 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16675 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 196608~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.3625320109999999, 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0092789550000000002, 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16675 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182792+0000", 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3399999999999998e-07 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182794+0000", 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182802+0000", 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4240000000000004e-06 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182807+0000", 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3800000000000002e-06 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.191714+0000", 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0089070399999999997 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.191797+0000", 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2863999999999998e-05 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.192070+0000", 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000272792 2024-09-11T06:17:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:17472 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.314450238, 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013625929, 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 17472 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230874+0000", 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2999999999999999e-07 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230878+0000", 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4209999999999997e-06 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230888+0000", 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0356e-05 2024-09-11T06:17:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230895+0000", 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9530000000000002e-06 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230940+0000", 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4589000000000003e-05 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230995+0000", 2024-09-11T06:17:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5390000000000003e-05 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231196+0000", 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020024499999999999 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231787+0000", 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059133700000000005 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244412+0000", 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012624803 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244460+0000", 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7802000000000001e-05 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244499+0000", 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9202999999999997e-05 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18219 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.290423562, 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011081077, 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18219 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254900+0000", 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-07 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254905+0000", 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254916+0000", 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0949e-05 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254925+0000", 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254972+0000", 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6826999999999997e-05 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255031+0000", 2024-09-11T06:17:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9364000000000003e-05 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255240+0000", 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020845600000000001 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255893+0000", 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00065294500000000004 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265665+0000", 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097724279999999997 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265932+0000", 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267197 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265981+0000", 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8083e-05 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:38.646 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:38.648 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:38.650 INFO:teuthology.orchestra.run.smithi070.stdout:1543 write 0x379bedd thru 0x37a3d87 (0x7eab bytes) 2024-09-11T06:17:38.650 INFO:teuthology.orchestra.run.smithi070.stdout:1544 punch from 0x4c2e300 to 0x4c37cf6, (0x99f6 bytes) 2024-09-11T06:17:38.650 INFO:teuthology.orchestra.run.smithi070.stdout:1545 read 0x5356ff5 thru 0x53657cf (0xe7db bytes) 2024-09-11T06:17:38.650 INFO:teuthology.orchestra.run.smithi070.stdout:1546 read 0x3b24cfb thru 0x3b296bd (0x49c3 bytes) 2024-09-11T06:17:38.650 INFO:teuthology.orchestra.run.smithi070.stdout:1547 write 0xe3ae86f thru 0xe3bd50f (0xeca1 bytes) 2024-09-11T06:17:38.650 INFO:teuthology.orchestra.run.smithi070.stdout:1548 write 0x1ace62d thru 0x1ad3e41 (0x5815 bytes) 2024-09-11T06:17:38.650 INFO:teuthology.orchestra.run.smithi070.stdout:1549 write 0xd0ef13a thru 0xd0fb6ad (0xc574 bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1550 punch from 0xcb3cab2 to 0xcb4bf5b, (0xf4a9 bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1551 write 0xcb11929 thru 0xcb1ff46 (0xe61e bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1553 write 0x5da05d9 thru 0x5dadab9 (0xd4e1 bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1554 read 0x4f35095 thru 0x4f3da3f (0x89ab bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1555 write 0xd054019 thru 0xd059489 (0x5471 bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1556 read 0x39a270a thru 0x39a653f (0x3e36 bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1558 read 0x5280ac7 thru 0x5288df0 (0x832a bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1560 trunc from 0xe3bd510 to 0xe917404 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1561 trunc from 0xe917404 to 0xad40525 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1562 write 0x4a731a0 thru 0x4a78abb (0x591c bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1564 punch from 0x7364cec to 0x7370aa3, (0xbdb7 bytes) 2024-09-11T06:17:38.651 INFO:teuthology.orchestra.run.smithi070.stdout:1565 writesame 0xe355d75 thru 0xe35601d data_size 0x1(0x2a9 bytes) 2024-09-11T06:17:38.652 INFO:teuthology.orchestra.run.smithi070.stdout:1566 read 0x64515a5 thru 0x6456951 (0x53ad bytes) 2024-09-11T06:17:38.652 INFO:teuthology.orchestra.run.smithi070.stdout:1567 write 0xe6dcc96 thru 0xe6ea5aa (0xd915 bytes) 2024-09-11T06:17:38.652 INFO:teuthology.orchestra.run.smithi070.stdout:1568 writesame 0x59cedf8 thru 0x59d3f9f data_size 0x4e(0x51a8 bytes) 2024-09-11T06:17:38.652 INFO:teuthology.orchestra.run.smithi070.stdout:1569 write 0x13d2003 thru 0x13da303 (0x8301 bytes) 2024-09-11T06:17:38.652 INFO:teuthology.orchestra.run.smithi070.stdout:1570 writesame 0x306d0da thru 0x30794ae data_size 0x11(0xc3d5 bytes) 2024-09-11T06:17:38.652 INFO:teuthology.orchestra.run.smithi070.stdout:1571 write 0xa1cd1a7 thru 0xa1d7707 (0xa561 bytes) 2024-09-11T06:17:38.652 INFO:teuthology.orchestra.run.smithi070.stdout:1572 read 0x97859f0 thru 0x9785fd3 (0x5e4 bytes) 2024-09-11T06:17:38.652 INFO:teuthology.orchestra.run.smithi070.stdout:1573 trunc from 0xe6ea5ab to 0x3e164d8 2024-09-11T06:17:38.652 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:38.646+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:38.665 INFO:teuthology.orchestra.run.smithi070.stdout:1575 trunc from 0x3e164d8 to 0xe83263c 2024-09-11T06:17:38.671 INFO:teuthology.orchestra.run.smithi070.stdout:1576 punch from 0x7b9e9b8 to 0x7ba2d8c, (0x43d4 bytes) 2024-09-11T06:17:38.671 INFO:teuthology.orchestra.run.smithi070.stdout:1577 read 0x8bd456d thru 0x8bdbff8 (0x7a8c bytes) 2024-09-11T06:17:38.671 INFO:teuthology.orchestra.run.smithi070.stdout:1578 write 0xadaeddb thru 0xadbbf57 (0xd17d bytes) 2024-09-11T06:17:38.673 INFO:teuthology.orchestra.run.smithi070.stdout:1580 read 0xc87c2c2 thru 0xc88bb9d (0xf8dc bytes) 2024-09-11T06:17:38.673 INFO:teuthology.orchestra.run.smithi070.stdout:1581 read 0x334a8f9 thru 0x334c976 (0x207e bytes) 2024-09-11T06:17:38.674 INFO:teuthology.orchestra.run.smithi070.stdout:1582 writesame 0x4b8b54f thru 0x4b96215 data_size 0x1(0xacc7 bytes) 2024-09-11T06:17:38.692 INFO:teuthology.orchestra.run.smithi070.stdout:1586 punch from 0xdf63c6 to 0xdf6e00, (0xa3a bytes) 2024-09-11T06:17:38.692 INFO:teuthology.orchestra.run.smithi070.stdout:1588 write 0x108958 thru 0x110a3c (0x80e5 bytes) 2024-09-11T06:17:38.693 INFO:teuthology.orchestra.run.smithi070.stdout:1589 read 0x4548821 thru 0x4554f96 (0xc776 bytes) 2024-09-11T06:17:38.695 INFO:teuthology.orchestra.run.smithi070.stdout:1591 trunc from 0xe83263c to 0xd1f1460 2024-09-11T06:17:38.702 INFO:teuthology.orchestra.run.smithi070.stdout:1592 writesame 0xa2ed817 thru 0xa2f1ee7 data_size 0x1(0x46d1 bytes) 2024-09-11T06:17:38.709 INFO:teuthology.orchestra.run.smithi070.stdout:1594 read 0xc19f907 thru 0xc1a8f86 (0x9680 bytes) 2024-09-11T06:17:38.709 INFO:teuthology.orchestra.run.smithi070.stdout:1595 read 0x8c59aa2 thru 0x8c61a11 (0x7f70 bytes) 2024-09-11T06:17:38.710 INFO:teuthology.orchestra.run.smithi070.stdout:1596 write 0xc97e3e thru 0xca7ccd (0xfe90 bytes) 2024-09-11T06:17:38.718 INFO:teuthology.orchestra.run.smithi070.stdout:1599 write 0xeac96a8 thru 0xead2f5b (0x98b4 bytes) 2024-09-11T06:17:38.720 INFO:teuthology.orchestra.run.smithi070.stdout:1602 write 0x8898efa thru 0x88a895d (0xfa64 bytes) 2024-09-11T06:17:38.721 INFO:teuthology.orchestra.run.smithi070.stdout:1603 write 0xcdfcc89 thru 0xce0656e (0x98e6 bytes) 2024-09-11T06:17:38.731 INFO:teuthology.orchestra.run.smithi070.stdout:1605 trunc from 0xead2f5c to 0x7616686 2024-09-11T06:17:38.739 INFO:teuthology.orchestra.run.smithi070.stdout:1606 trunc from 0x7616686 to 0x8620c37 2024-09-11T06:17:38.744 INFO:teuthology.orchestra.run.smithi070.stdout:1607 punch from 0xae6abb to 0xaedd0e, (0x7253 bytes) 2024-09-11T06:17:38.747 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:38.747+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:38.751 INFO:teuthology.orchestra.run.smithi070.stdout:1608 write 0x984baf4 thru 0x9853412 (0x791f bytes) 2024-09-11T06:17:38.752 INFO:teuthology.orchestra.run.smithi070.stdout:1609 write 0x70837f3 thru 0x708a938 (0x7146 bytes) 2024-09-11T06:17:38.753 INFO:teuthology.orchestra.run.smithi070.stdout:1613 write 0x866b77d thru 0x866f443 (0x3cc7 bytes) 2024-09-11T06:17:38.755 INFO:teuthology.orchestra.run.smithi070.stdout:1614 write 0x5e49cec thru 0x5e52648 (0x895d bytes) 2024-09-11T06:17:38.756 INFO:teuthology.orchestra.run.smithi070.stdout:1615 punch from 0x89b0683 to 0x89b2b31, (0x24ae bytes) 2024-09-11T06:17:38.757 INFO:teuthology.orchestra.run.smithi070.stdout:1617 writesame 0x6d0447d thru 0x6d04bc8 data_size 0x2(0x74c bytes) 2024-09-11T06:17:38.758 INFO:teuthology.orchestra.run.smithi070.stdout:1618 read 0x873abc2 thru 0x8740b2e (0x5f6d bytes) 2024-09-11T06:17:38.758 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.759 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:38.760 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:38.760 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:38.768 INFO:teuthology.orchestra.run.smithi070.stdout:1621 trunc from 0x9853413 to 0x17f5e48 2024-09-11T06:17:38.769 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:38.778 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.778 INFO:teuthology.orchestra.run.smithi070.stdout:1623 write 0x46aba7 thru 0x475483 (0xa8dd bytes) 2024-09-11T06:17:38.798 INFO:teuthology.orchestra.run.smithi070.stdout:1624 writesame 0xba76e4e thru 0xba78cbb data_size 0x26(0x1e6e bytes) 2024-09-11T06:17:38.798 INFO:teuthology.orchestra.run.smithi070.stdout:1625 writesame 0x4be08ab thru 0x4be714d data_size 0x1(0x68a3 bytes) 2024-09-11T06:17:38.810 INFO:teuthology.orchestra.run.smithi070.stdout:1626 read 0xb551b14 thru 0xb553bad (0x209a bytes) 2024-09-11T06:17:38.810 INFO:teuthology.orchestra.run.smithi070.stdout:1628 read 0x11ec482 thru 0x11f0374 (0x3ef3 bytes) 2024-09-11T06:17:38.811 INFO:teuthology.orchestra.run.smithi070.stdout:1630 read 0x75beb15 thru 0x75c40c0 (0x55ac bytes) 2024-09-11T06:17:38.811 INFO:teuthology.orchestra.run.smithi070.stdout:1631 write 0x7d09504 thru 0x7d18ad9 (0xf5d6 bytes) 2024-09-11T06:17:38.814 INFO:teuthology.orchestra.run.smithi070.stdout:1632 read 0x468fcc thru 0x46ae9e (0x1ed3 bytes) 2024-09-11T06:17:38.815 INFO:teuthology.orchestra.run.smithi070.stdout:1633 write 0x5a4cba6 thru 0x5a575bd (0xaa18 bytes) 2024-09-11T06:17:38.818 INFO:teuthology.orchestra.run.smithi070.stdout:1634 writesame 0xa9c2290 thru 0xa9ce0a2 data_size 0x13(0xbe13 bytes) 2024-09-11T06:17:38.820 INFO:teuthology.orchestra.run.smithi070.stdout:1635 punch from 0x1a21c9e to 0x1a2e458, (0xc7ba bytes) 2024-09-11T06:17:38.820 INFO:teuthology.orchestra.run.smithi070.stdout:1636 writesame 0x17a9650 thru 0x17b5756 data_size 0x1(0xc107 bytes) 2024-09-11T06:17:38.843 INFO:teuthology.orchestra.run.smithi070.stdout:1638 write 0xa9d9184 thru 0xa9e33df (0xa25c bytes) 2024-09-11T06:17:38.844 INFO:teuthology.orchestra.run.smithi070.stdout:1639 read 0xf69d1c thru 0xf6b8d5 (0x1bba bytes) 2024-09-11T06:17:38.845 INFO:teuthology.orchestra.run.smithi070.stdout:1640 read 0xa86cb1 thru 0xa88b0e (0x1e5e bytes) 2024-09-11T06:17:38.848 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:38.847+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:38.853 INFO:teuthology.orchestra.run.smithi070.stdout:1641 write 0xe076c9e thru 0xe077649 (0x9ac bytes) 2024-09-11T06:17:38.855 INFO:teuthology.orchestra.run.smithi070.stdout:1643 punch from 0x6f57921 to 0x6f61dcb, (0xa4aa bytes) 2024-09-11T06:17:38.855 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.855 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.855 INFO:teuthology.orchestra.run.smithi070.stdout:1646 write 0x7416d5c thru 0x7421a03 (0xaca8 bytes) 2024-09-11T06:17:38.865 INFO:teuthology.orchestra.run.smithi070.stdout:1647 trunc from 0xe07764a to 0x6ec748a 2024-09-11T06:17:38.872 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:38.872 INFO:teuthology.orchestra.run.smithi070.stdout:1650 read 0x10e7e9a thru 0x10efe98 (0x7fff bytes) 2024-09-11T06:17:38.875 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:38.875 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:38.876 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:38.876 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:38.876 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:38.883 INFO:teuthology.orchestra.run.smithi070.stdout:1651 writesame 0xaf187c7 thru 0xaf1b706 data_size 0x2a(0x2f40 bytes) 2024-09-11T06:17:38.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:38.895 INFO:teuthology.orchestra.run.smithi070.stdout:1653 trunc from 0xaf1b707 to 0x17d4d69 2024-09-11T06:17:38.906 INFO:teuthology.orchestra.run.smithi070.stdout:1655 clone 7 order 22 su 131072 sc 12 2024-09-11T06:17:38.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:38.968+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:39.028 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2451 3.18 3:1f17666a:::rbd_data.116dc3b5629f.0000000000000020:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.511557620000001, 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012096045, 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2451 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515329+0000", 2024-09-11T06:17:39.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1330000000000001e-06 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515339+0000", 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8989999999999996e-06 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515344+0000", 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515378+0000", 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3519999999999998e-05 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515423+0000", 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5221e-05 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.517881+0000", 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024577269999999998 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527239+0000", 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093582379999999996 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527297+0000", 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7481000000000001e-05 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527352+0000", 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5145000000000001e-05 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527420+0000", 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8062e-05 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4110 3.18 3:18dbb972:::rbd_data.116df69fa911.0000000000000004:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:24.585510+0000", 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.441371088, 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.024867093999999999, 2024-09-11T06:17:39.035 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4110 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585510+0000", 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585510+0000", 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585511+0000", 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585514+0000", 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4149999999999999e-06 2024-09-11T06:17:39.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585521+0000", 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4339999999999997e-06 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585525+0000", 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585552+0000", 2024-09-11T06:17:39.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6647000000000001e-05 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585588+0000", 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6681999999999999e-05 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.589775+0000", 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041868039999999997 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.610280+0000", 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020505151999999999 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.610292+0000", 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1545e-05 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.610328+0000", 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5670999999999998e-05 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.610377+0000", 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9657999999999998e-05 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4742 3.1f 3:f8d20853:::rbd_data.116df69fa911.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.373829+0000", 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.653052421, 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014753327, 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4742 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373829+0000", 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373829+0000", 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373830+0000", 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3099999999999996e-07 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373834+0000", 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.211e-06 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373844+0000", 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0094e-05 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373852+0000", 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373920+0000", 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8711e-05 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373968+0000", 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7175999999999997e-05 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.376538+0000", 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002569918 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.388479+0000", 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011941798 2024-09-11T06:17:39.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.388518+0000", 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9103999999999997e-05 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.388554+0000", 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5450000000000001e-05 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.388582+0000", 2024-09-11T06:17:39.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8280999999999999e-05 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4964 3.1f 3:fe6e2b97:::rbd_data.116df69fa911.000000000000000b:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.678276+0000", 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.348605578000001, 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025414968, 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4964 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678276+0000", 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678276+0000", 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678277+0000", 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5820000000000001e-06 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678283+0000", 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5809999999999996e-06 2024-09-11T06:17:39.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678294+0000", 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1477999999999999e-05 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678301+0000", 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4999999999999996e-06 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678348+0000", 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7120000000000003e-05 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678409+0000", 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1383000000000005e-05 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.682404+0000", 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039947699999999999 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.703591+0000", 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021187006000000001 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.703622+0000", 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1019999999999998e-05 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.703655+0000", 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2626999999999998e-05 2024-09-11T06:17:39.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.703691+0000", 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5901000000000001e-05 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:19412 3.1f 3:fe105b17:::rbd_data.116d55772b3c.0000000000000011:head [write 458752~57344 [fadvise_sequential+fadvise_nocache],write 581632~8192 [fadvise_sequential+fadvise_nocache],write 638976~32768 [fadvise_sequential+fadvise_nocache],write 753664~32768 [fadvise_sequential+fadvise_nocache],write 1105920~73728 [fadvise_sequential+fadvise_nocache],write 1220608~32768 [fadvise_sequential+fadvise_nocache],write 1277952~57344 [fadvise_sequential+fadvise_nocache],write 1392640~24576 [fadvise_sequential+fadvise_nocache],write 1449984~49152 [fadvise_sequential+fadvise_nocache],write 1802240~16384 [fadvise_sequential+fadvise_nocache],write 1859584~40960 [fadvise_sequential+fadvise_nocache],write 1916928~57344 [fadvise_sequential+fadvise_nocache],write 2031616~16384 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.317884+0000", 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.708996816, 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013502076999999999, 2024-09-11T06:17:39.053 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 19412 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.317884+0000", 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.317884+0000", 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.317885+0000", 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.22e-07 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.321850+0000", 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039648590000000003 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.321865+0000", 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4961e-05 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.321875+0000", 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0849000000000001e-05 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.322358+0000", 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000482413 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.322489+0000", 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000130872 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.322831+0000", 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00034270600000000002 2024-09-11T06:17:39.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.325718+0000", 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002886778 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.331275+0000", 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055563460000000002 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.331346+0000", 2024-09-11T06:17:39.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1767000000000006e-05 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.331387+0000", 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0204000000000003e-05 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20089 3.17 3:e85aad2a:::rbd_data.116d3c8aaf0c.000000000000009a:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.339779+0000", 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6871018500000003, 2024-09-11T06:17:39.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011666144, 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20089 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339779+0000", 2024-09-11T06:17:39.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339779+0000", 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339780+0000", 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339782+0000", 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2989999999999999e-06 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339788+0000", 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2759999999999997e-06 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339793+0000", 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8999999999999997e-06 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351179+0000", 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011385595 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351248+0000", 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9269000000000004e-05 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351446+0000", 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197445 2024-09-11T06:17:39.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20110 3.17 3:ec0409e7:::rbd_data.116d3c8aaf0c.00000000000000a2:b [read 28672~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340164+0000", 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.68671755, 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011496833999999999, 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20110 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340164+0000", 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340164+0000", 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340164+0000", 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1799999999999995e-07 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340168+0000", 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9469999999999996e-06 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340176+0000", 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8269999999999998e-06 2024-09-11T06:17:39.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340183+0000", 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5479999999999998e-06 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351479+0000", 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011295866999999999 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351556+0000", 2024-09-11T06:17:39.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7239999999999999e-05 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351661+0000", 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104787 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20111 3.17 3:ec0409e7:::rbd_data.116d3c8aaf0c.00000000000000a2:b [read 65536~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340190+0000", 2024-09-11T06:17:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6866912750000003, 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011721664999999999, 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20111 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340190+0000", 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340190+0000", 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340191+0000", 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.75e-07 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340193+0000", 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1449999999999998e-06 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340199+0000", 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3829999999999997e-06 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340204+0000", 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0769999999999998e-06 2024-09-11T06:17:39.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351712+0000", 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011507886 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351808+0000", 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5938000000000002e-05 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351912+0000", 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103661 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20112 3.17 3:ec0409e7:::rbd_data.116d3c8aaf0c.00000000000000a2:b [read 102400~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340211+0000", 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6866704429999997, 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012039324000000001, 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.073 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20112 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340211+0000", 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340211+0000", 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340211+0000", 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5699999999999998e-07 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340213+0000", 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0339999999999999e-06 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340219+0000", 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.976e-06 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340224+0000", 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.152e-06 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351943+0000", 2024-09-11T06:17:39.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011718657 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352020+0000", 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6699999999999994e-05 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352250+0000", 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023044800000000001 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20113 3.17 3:ec0409e7:::rbd_data.116d3c8aaf0c.00000000000000a2:b [read 139264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340230+0000", 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6866509460000003, 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012391607000000001, 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20113 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.078 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340230+0000", 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340230+0000", 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340231+0000", 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340233+0000", 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8109999999999999e-06 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340239+0000", 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9220000000000002e-06 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340243+0000", 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8509999999999998e-06 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352306+0000", 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012063018999999999 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352406+0000", 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100102 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352622+0000", 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000215472 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20164 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 20480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340631+0000", 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6862507280000001, 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012160324, 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.082 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20164 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340631+0000", 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340631+0000", 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340631+0000", 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340633+0000", 2024-09-11T06:17:39.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.984e-06 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340639+0000", 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1340000000000001e-06 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340644+0000", 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352661+0000", 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012016493 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352708+0000", 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7580999999999997e-05 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352791+0000", 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2694000000000005e-05 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.086 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20165 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 57344~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340651+0000", 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6862300430000001, 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012296458, 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20165 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340651+0000", 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340651+0000", 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340652+0000", 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340654+0000", 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2400000000000002e-06 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340661+0000", 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7649999999999996e-06 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340666+0000", 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9150000000000004e-06 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352824+0000", 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012158375000000001 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352890+0000", 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6495999999999995e-05 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352948+0000", 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7292e-05 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20166 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 94208~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.091 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340672+0000", 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6862094540000001, 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012421587, 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20166 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340672+0000", 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340672+0000", 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340672+0000", 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:17:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340674+0000", 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340679+0000", 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8810000000000004e-06 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340682+0000", 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352975+0000", 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012292875 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353021+0000", 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5559999999999997e-05 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353093+0000", 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2616999999999999e-05 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20167 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 131072~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340702+0000", 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6861789140000001, 2024-09-11T06:17:39.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012550286000000001, 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20167 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340702+0000", 2024-09-11T06:17:39.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340702+0000", 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340703+0000", 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.13e-07 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340705+0000", 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.227e-06 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341075+0000", 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036938999999999999 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341081+0000", 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0340000000000002e-06 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353127+0000", 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012046693000000001 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353177+0000", 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9366000000000001e-05 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353253+0000", 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5963000000000004e-05 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20168 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 167936~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.341092+0000", 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6857896480000001, 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01250046, 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.101 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20168 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341092+0000", 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341092+0000", 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341092+0000", 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341095+0000", 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5790000000000002e-06 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341100+0000", 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-06 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341105+0000", 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2619999999999998e-06 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353301+0000", 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01219571 2024-09-11T06:17:39.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353381+0000", 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0272000000000007e-05 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353592+0000", 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021111900000000001 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20169 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 204800~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.341115+0000", 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6857660509999999, 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01277345, 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20169 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341115+0000", 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341115+0000", 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341116+0000", 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341118+0000", 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4169999999999999e-06 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341124+0000", 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.212e-06 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341129+0000", 2024-09-11T06:17:39.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5530000000000003e-06 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353634+0000", 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01250502 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353696+0000", 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1583999999999999e-05 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353889+0000", 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019313300000000001 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20206 3.17 3:ebdbc98c:::rbd_data.116d3c8aaf0c.00000000000000c5:b [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.341136+0000", 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6857456239999999, 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012954894, 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20206 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341136+0000", 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341136+0000", 2024-09-11T06:17:39.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341136+0000", 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341138+0000", 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9350000000000001e-06 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341145+0000", 2024-09-11T06:17:39.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2069999999999998e-06 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341150+0000", 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7219999999999999e-06 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353906+0000", 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012755907 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353951+0000", 2024-09-11T06:17:39.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5108000000000002e-05 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.354091+0000", 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013967499999999999 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20207 3.17 3:ebdbc98c:::rbd_data.116d3c8aaf0c.00000000000000c5:b [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.341156+0000", 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.6857249489999999, 2024-09-11T06:17:39.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013268614999999999, 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20207 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341156+0000", 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341156+0000", 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341157+0000", 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341159+0000", 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0990000000000001e-06 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341165+0000", 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6779999999999997e-06 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341170+0000", 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0080000000000002e-06 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.354127+0000", 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012957237 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.354217+0000", 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9801000000000003e-05 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.354425+0000", 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000208424 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:24486 3.17 3:ea59ddd0:::rbd_data.116d3246af40.0000000000000004:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:38.536234+0000", 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.49064734100000001, 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025473716, 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 24486 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536234+0000", 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536234+0000", 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536235+0000", 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536238+0000", 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2760000000000001e-06 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536246+0000", 2024-09-11T06:17:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2430000000000005e-06 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536251+0000", 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0470000000000001e-06 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536290+0000", 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8940999999999999e-05 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536341+0000", 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1127e-05 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.541397+0000", 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0050559280000000003 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.561520+0000", 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020122635 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.561572+0000", 2024-09-11T06:17:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2479999999999999e-05 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.561635+0000", 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2257999999999999e-05 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.561708+0000", 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3054999999999998e-05 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:24708 3.18 3:18290694:::rbd_data.116d3246af40.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:38.820560+0000", 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.20632170999999999, 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022295333000000001, 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 24708 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820560+0000", 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820560+0000", 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820561+0000", 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820566+0000", 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2159999999999997e-06 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820579+0000", 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3393999999999999e-05 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820588+0000", 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:17:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820642+0000", 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4033000000000003e-05 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820731+0000", 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8765999999999997e-05 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.824240+0000", 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003508733 2024-09-11T06:17:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.842714+0000", 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018474043999999998 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.842771+0000", 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7537999999999997e-05 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.842815+0000", 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3742000000000002e-05 2024-09-11T06:17:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.842855+0000", 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9839999999999998e-05 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.130 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:39.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:39.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:39.131+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:17:39.232 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:39.232+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:39.276 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:39.276 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:39.276 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:39.277 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:39.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:39.332 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:39.332+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:39.387 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:39.387 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:39.388 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:39.388 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:39.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:39.433 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:39.433+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:233 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [read 917504~40157 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.776354745999999, 2024-09-11T06:17:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065151039999999999, 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 233 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.721996+0000", 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6499999999999999e-07 2024-09-11T06:17:39.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722000+0000", 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0740000000000001e-06 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722007+0000", 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.712e-06 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722012+0000", 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2410000000000003e-06 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725710+0000", 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0036971550000000001 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.725811+0000", 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000101788 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728511+0000", 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0026994689999999999 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:236 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 262144~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.776325485000001, 2024-09-11T06:17:39.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0067599590000000003, 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 236 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:39.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722025+0000", 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.27e-07 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722029+0000", 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2320000000000001e-06 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722040+0000", 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0842999999999999e-05 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722044+0000", 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728568+0000", 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065239929999999996 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728647+0000", 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8856999999999994e-05 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728785+0000", 2024-09-11T06:17:39.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013785800000000001 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:240 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 393216~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.776102841, 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006743181, 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.510 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 240 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:39.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722248+0000", 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5499999999999997e-07 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722252+0000", 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.065e-06 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722261+0000", 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2519999999999999e-06 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722265+0000", 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4279999999999998e-06 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728816+0000", 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065505650000000004 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728886+0000", 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9986000000000004e-05 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.728991+0000", 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010513 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:245 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 524288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:39.514 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.775883932999999, 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0066994699999999999, 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 245 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:39.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722467+0000", 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722468+0000", 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8700000000000004e-07 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722471+0000", 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.123e-06 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722477+0000", 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7819999999999996e-06 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722493+0000", 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5034999999999999e-05 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729030+0000", 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.006537434 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729085+0000", 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5232999999999998e-05 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729166+0000", 2024-09-11T06:17:39.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0876000000000003e-05 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:249 3.1 3:86ff50a8:::rbd_data.116d6cc70d0.000000000000000f:3 [sparse-read 655360~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.77558672, 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0065545639999999997, 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.519 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 249 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722764+0000", 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722765+0000", 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2500000000000001e-06 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722770+0000", 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1490000000000002e-06 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722784+0000", 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3694e-05 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.722792+0000", 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2290000000000003e-06 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729196+0000", 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0064038560000000003 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729246+0000", 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0226000000000003e-05 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:15.729318+0000", 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.216e-05 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_repop(client.4461.0:2744 3.18 e35/24 3:184d3c88:::rbd_object_map.116dc3b5629f:head v 35'549, mlcod=33'547)", 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:21.101922+0000", 2024-09-11T06:17:39.523 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.396428325999999, 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047474919999999999, 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101922+0000", 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101922+0000", 2024-09-11T06:17:39.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101922+0000", 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-07 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101928+0000", 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4639999999999997e-06 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101942+0000", 2024-09-11T06:17:39.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4090999999999999e-05 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.101951+0000", 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5930000000000006e-06 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.102011+0000", 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0136999999999997e-05 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.102033+0000", 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2711999999999999e-05 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.106640+0000", 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046063359999999999 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:21.106670+0000", 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9862999999999999e-05 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4597 3.1 3:80e628a5:::rbd_data.116df69fa911.000000000000000d:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.170436+0000", 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.327914297, 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0075998389999999997, 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4597 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.528 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.170436+0000", 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.170436+0000", 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.170438+0000", 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.61e-06 2024-09-11T06:17:39.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.170445+0000", 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2949999999999996e-06 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.170459+0000", 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4301000000000001e-05 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.170467+0000", 2024-09-11T06:17:39.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2289999999999997e-06 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.170523+0000", 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6700000000000003e-05 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.170579+0000", 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5529000000000003e-05 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.171863+0000", 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012842369999999999 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.177943+0000", 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0060800810000000002 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.177973+0000", 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9672999999999999e-05 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.178005+0000", 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2125000000000002e-05 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.178036+0000", 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1059000000000002e-05 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:7581 3.12 3:4cf2316c:::rbd_data.116d497c8375.000000000000014c:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:39.533 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:28.425192+0000", 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.073158457, 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048895559999999998, 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 7581 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.425192+0000", 2024-09-11T06:17:39.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.425192+0000", 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.425194+0000", 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.79e-06 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.425200+0000", 2024-09-11T06:17:39.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.19e-06 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.425215+0000", 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4796e-05 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.425223+0000", 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1499999999999999e-06 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.425281+0000", 2024-09-11T06:17:39.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8168999999999998e-05 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.425421+0000", 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000140061 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:28.430082+0000", 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046604000000000003 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.537 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18001 3.12 3:4f6dce1e:::rbd_data.116d55772b3c.0000000000000009:head [write 466944~57344 [fadvise_sequential+fadvise_nocache],write 589824~8192 [fadvise_sequential+fadvise_nocache],write 647168~32768 [fadvise_sequential+fadvise_nocache],write 761856~32768 [fadvise_sequential+fadvise_nocache],write 1114112~65536 [fadvise_sequential+fadvise_nocache],write 1228800~32768 [fadvise_sequential+fadvise_nocache],write 1286144~57344 [fadvise_sequential+fadvise_nocache],write 1400832~24576 [fadvise_sequential+fadvise_nocache],write 1458176~49152 [fadvise_sequential+fadvise_nocache],write 1572864~8192 [fadvise_sequential+fadvise_nocache],write 1810432~16384 [fadvise_sequential+fadvise_nocache],write 1867776~32768 [fadvise_sequential+fadvise_nocache],write 1925120~57344 [fadvise_sequential+fadvise_nocache],write 2039808~16384 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.244995+0000", 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.253355419, 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012133293999999999, 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18001 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244995+0000", 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244995+0000", 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244996+0000", 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4600000000000003e-07 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.246334+0000", 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0013383900000000001 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.246347+0000", 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2405999999999999e-05 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.246354+0000", 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.246414+0000", 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9320999999999997e-05 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.246564+0000", 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015038399999999999 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.246931+0000", 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036735400000000002 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.248950+0000", 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0020183710000000001 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.257029+0000", 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0080787570000000006 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.257083+0000", 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4113000000000002e-05 2024-09-11T06:17:39.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.257128+0000", 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5754999999999998e-05 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18804 3.12 3:4cc68e58:::rbd_data.116d55772b3c.000000000000000d:head [write 466944~49152 [fadvise_sequential+fadvise_nocache],write 581632~16384 [fadvise_sequential+fadvise_nocache],write 638976~32768 [fadvise_sequential+fadvise_nocache],write 753664~32768 [fadvise_sequential+fadvise_nocache],write 1105920~73728 [fadvise_sequential+fadvise_nocache],write 1220608~40960 [fadvise_sequential+fadvise_nocache],write 1277952~65536 [fadvise_sequential+fadvise_nocache],write 1400832~16384 [fadvise_sequential+fadvise_nocache],write 1458176~40960 [fadvise_sequential+fadvise_nocache],write 1802240~16384 [fadvise_sequential+fadvise_nocache],write 1867776~32768 [fadvise_sequential+fadvise_nocache],write 1925120~57344 [fadvise_sequential+fadvise_nocache],write 2039808~16384 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.285598+0000", 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.2127521889999997, 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0077096020000000003, 2024-09-11T06:17:39.543 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18804 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.285598+0000", 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.285598+0000", 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.285599+0000", 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.286024+0000", 2024-09-11T06:17:39.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000424998 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.286035+0000", 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.286040+0000", 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1479999999999997e-06 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.286090+0000", 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0042e-05 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.286221+0000", 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013084500000000001 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.286544+0000", 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00032240399999999998 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.287813+0000", 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012697190000000001 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.293236+0000", 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0054227720000000002 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.293282+0000", 2024-09-11T06:17:39.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.293308+0000", 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6180999999999999e-05 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:19753 3.4 3:22670452:::rbd_data.116d3c8aaf0c.00000000000000b2:b [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.326441+0000", 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.171909812, 2024-09-11T06:17:39.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0074060330000000002, 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 19753 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.326441+0000", 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.326441+0000", 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.326441+0000", 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9900000000000001e-07 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.326443+0000", 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8640000000000001e-06 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.326449+0000", 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0599999999999996e-06 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.326457+0000", 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3820000000000004e-06 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.330652+0000", 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041941349999999999 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.330720+0000", 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8857999999999997e-05 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.333847+0000", 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031263350000000001 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:19876 3.4 3:22670452:::rbd_data.116d3c8aaf0c.00000000000000b2:b [read 61440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.327462+0000", 2024-09-11T06:17:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1708887470000002, 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048607879999999996, 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 19876 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327462+0000", 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327462+0000", 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327462+0000", 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5699999999999998e-07 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327464+0000", 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.852e-06 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327470+0000", 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3890000000000002e-06 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327476+0000", 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5650000000000001e-06 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.332148+0000", 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0046716850000000001 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.332216+0000", 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8843999999999993e-05 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.332323+0000", 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106096 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:19877 3.4 3:22670452:::rbd_data.116d3c8aaf0c.00000000000000b2:b [read 98304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.327482+0000", 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1708686469999998, 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0050232539999999996, 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 19877 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.558 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327482+0000", 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327482+0000", 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327482+0000", 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:17:39.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327484+0000", 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.905e-06 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327490+0000", 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.327495+0000", 2024-09-11T06:17:39.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.332351+0000", 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048557640000000003 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.332421+0000", 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0889000000000005e-05 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.332505+0000", 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3677999999999994e-05 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20146 3.4 3:22670452:::rbd_data.116d3c8aaf0c.00000000000000b2:b [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.334504+0000", 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1638469459999996, 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047768840000000003, 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20146 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334504+0000", 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334504+0000", 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334504+0000", 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-07 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334506+0000", 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9439999999999999e-06 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334512+0000", 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4640000000000003e-06 2024-09-11T06:17:39.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334517+0000", 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8219999999999997e-06 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339110+0000", 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004592629 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339182+0000", 2024-09-11T06:17:39.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2495000000000003e-05 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339280+0000", 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8101000000000001e-05 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20147 3.4 3:22670452:::rbd_data.116d3c8aaf0c.00000000000000b2:b [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.334523+0000", 2024-09-11T06:17:39.566 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1638273339999996, 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049368249999999997, 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20147 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334523+0000", 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334523+0000", 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334524+0000", 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334526+0000", 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4940000000000002e-06 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334533+0000", 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5050000000000004e-06 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334538+0000", 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339309+0000", 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0047708150000000003 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339373+0000", 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3842000000000003e-05 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339460+0000", 2024-09-11T06:17:39.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7442999999999996e-05 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20148 3.4 3:22670452:::rbd_data.116d3c8aaf0c.00000000000000b2:b [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.334544+0000", 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1638067059999999, 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.005217902, 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20148 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334544+0000", 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334544+0000", 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334544+0000", 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.53e-07 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334546+0000", 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6899999999999999e-06 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334552+0000", 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0839999999999997e-06 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.334557+0000", 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339493+0000", 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0049365110000000002 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339578+0000", 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4938000000000006e-05 2024-09-11T06:17:39.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339762+0000", 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000183306 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20760 3.12 3:4b92985e:::rbd_data.116d55772b3c.0000000000000018:head [write 229376~32768 [fadvise_sequential+fadvise_nocache],write 286720~32768 [fadvise_sequential+fadvise_nocache],write 344064~57344 [fadvise_sequential+fadvise_nocache],write 466944~8192 [fadvise_sequential+fadvise_nocache],write 524288~32768 [fadvise_sequential+fadvise_nocache],write 581632~49152 [fadvise_sequential+fadvise_nocache],write 933888~40960 [fadvise_sequential+fadvise_nocache],write 991232~65536 [fadvise_sequential+fadvise_nocache],write 1105920~24576 [fadvise_sequential+fadvise_nocache],write 1163264~49152 [fadvise_sequential+fadvise_nocache],write 1277952~16384 [fadvise_sequential+fadvise_nocache],write 1335296~40960 [fadvise_sequential+fadvise_nocache],write 1392640~65536 [fadvise_sequential+fadvise_nocache],write 1515520~16384 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.573876+0000", 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.9244750020000003, 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0050930200000000002, 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.575 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20760 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.573876+0000", 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.573876+0000", 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.573876+0000", 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-07 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.574145+0000", 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026855299999999999 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.574158+0000", 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3577999999999999e-05 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.574166+0000", 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4830000000000002e-06 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.574231+0000", 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5555000000000005e-05 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.574387+0000", 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015617199999999999 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.574801+0000", 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00041333100000000002 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.576616+0000", 2024-09-11T06:17:39.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001815594 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.578890+0000", 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0022732590000000001 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.578938+0000", 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8609000000000002e-05 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.578969+0000", 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0266000000000001e-05 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.581 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:22002 3.1 3:85b219aa:::rbd_data.116d55772b3c.0000000000000065:head [write 180224~49152 [fadvise_sequential+fadvise_nocache],write 1687552~31799 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.623700+0000", 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.8746506170000004, 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0052015689999999996, 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 22002 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.623700+0000", 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.623700+0000", 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.623701+0000", 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7100000000000001e-07 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.623773+0000", 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1952999999999994e-05 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.623783+0000", 2024-09-11T06:17:39.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0203999999999999e-05 2024-09-11T06:17:39.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.623788+0000", 2024-09-11T06:17:39.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1909999999999999e-06 2024-09-11T06:17:39.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.623831+0000", 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3466e-05 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.623919+0000", 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7418999999999998e-05 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:39.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.624007+0000", 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7598999999999999e-05 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.625457+0000", 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001450378 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.628842+0000", 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003385103 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.628876+0000", 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3899999999999997e-05 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.628901+0000", 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5585e-05 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:23596 3.4 3:2681b930:::rbd_data.116d3c8aaf0c.0000000000000008:head [sparse-read 0~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:38.264524+0000", 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.2338267860000001, 2024-09-11T06:17:39.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048209949999999998, 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23596 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264524+0000", 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264524+0000", 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264526+0000", 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3609999999999999e-06 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264534+0000", 2024-09-11T06:17:39.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8509999999999999e-06 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264557+0000", 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2969999999999999e-05 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264568+0000", 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0698e-05 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264815+0000", 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024719299999999999 2024-09-11T06:17:39.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op must wait for map", 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264821+0000", 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1840000000000004e-06 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.268663+0000", 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0038420630000000002 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.268736+0000", 2024-09-11T06:17:39.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3232999999999995e-05 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.269345+0000", 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00060844200000000005 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:23616 3.4 3:213a3af2:::rbd_data.116d3c8aaf0c.000000000000001c:head [sparse-read 0~42354] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:38.264975+0000", 2024-09-11T06:17:39.593 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.2333755929999999, 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0048967760000000003, 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 23616 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264975+0000", 2024-09-11T06:17:39.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264975+0000", 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264976+0000", 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8999999999999995e-07 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:39.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264985+0000", 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3200000000000006e-06 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.264996+0000", 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0722e-05 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.265003+0000", 2024-09-11T06:17:39.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9160000000000004e-06 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.265473+0000", 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00047026000000000001 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.265478+0000", 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5319999999999997e-06 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.269391+0000", 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039120759999999996 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.269477+0000", 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6860999999999994e-05 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.269872+0000", 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00039429899999999997 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.599 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:39.599 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:39.599 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:39.600 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:39.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:39.599+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:39.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:39.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:39.700+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:39.745 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:39.745 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:39.745 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:39.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:39.770 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:39.770 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:39.787 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:17:39.787 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:17:39.801 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:39.800+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:39.802 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:39.803 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:39.818 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:39.818 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:39.835 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:39.835 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:39.852 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:39.852 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:39.868 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:39.868 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:39.885 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:39.900 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:39.900 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:39.902 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:39.901+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:39.909 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:40.003 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:17:40.002+0000 7fcc503e2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33574) UID: 0 2024-09-11T06:17:40.052 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:40.052 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:40.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:40.103 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:40.103+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:40.180 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:40.180 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:40.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:40.233 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:40.232+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:40.292 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:40.292 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:40.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:40.305 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:40.305+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:40.407 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:40.406+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:40.445 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:40.445 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:40.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:17:40.508 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:40.508+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:40.556 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:40.557 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:40.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:17:40.609 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:40.609+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:40.668 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:40.669 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:40.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:17:40.710 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:40.710+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:40.780 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:40.780 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:40.789 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:40.833 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:40.831+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:40.892 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:40.892 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:40.901 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:40.942 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:40.940+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:41.013 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:41.012+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:41.045 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:41.045 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:41.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:41.114 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:41.114+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:41.176 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T06:17:41.176 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:17:41.176 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T06:17:41.177 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T06:17:41.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:17:41.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:17:41.205 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:41.206 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:41.215 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:41.214+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:41.217 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:41.222 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T06:17:41.222 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.1 2024-09-11T06:17:41.222 INFO:tasks.thrashosds.thrasher:remote for osd 1 is ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:17:41.223 DEBUG:teuthology.orchestra.run.smithi070:> type ceph-objectstore-tool 2024-09-11T06:17:41.277 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T06:17:41.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op list-pgs 2024-09-11T06:17:41.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:41.315+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:41.325 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:41.325 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:41.334 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:41.417 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:41.417+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:41.477 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:41.477 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:41.486 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:41.527 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:41.526+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:41.619 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:41.617+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:41.628 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:41.628 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:41.637 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:41.719 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:41.719+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:41.742 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:41.742 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:41.751 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:41.820 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:41.819+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:41.895 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:41.895 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:41.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:41.904 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:41.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:41.947+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:42.008 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:42.008 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:42.017 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:42.021 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:42.021 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:42.058 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:42.057+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:42.122 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:42.122+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:42.160 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:42.160 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:42.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:17:42.224 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:42.223+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:42.312 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:42.312 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:42.320 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:42.324 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:42.323+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:42.423 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:42.424 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:42.425 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:42.424+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:42.432 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:42.526 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:42.525+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:42.576 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:42.576 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:42.585 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:42.626 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:42.625+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:42.727 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:42.727+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:42.728 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:42.728 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:42.736 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:42.793 INFO:teuthology.orchestra.run.smithi070.stdout:3.a 2024-09-11T06:17:42.793 INFO:teuthology.orchestra.run.smithi070.stdout:3.1f 2024-09-11T06:17:42.793 INFO:teuthology.orchestra.run.smithi070.stdout:3.1c 2024-09-11T06:17:42.793 INFO:teuthology.orchestra.run.smithi070.stdout:3.1a 2024-09-11T06:17:42.793 INFO:teuthology.orchestra.run.smithi070.stdout:3.d 2024-09-11T06:17:42.793 INFO:teuthology.orchestra.run.smithi070.stdout:3.19 2024-09-11T06:17:42.793 INFO:teuthology.orchestra.run.smithi070.stdout:3.10 2024-09-11T06:17:42.794 INFO:teuthology.orchestra.run.smithi070.stdout:1.0 2024-09-11T06:17:42.829 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:42.828+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:42.880 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:42.880 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:42.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:42.931 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:42.930+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:42.991 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:42.992 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:42.992 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:42.992 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:43.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:43.044 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:43.042+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:43.102 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:43.103 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:43.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:43.132 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:43.132+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:43.191 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-11T06:17:43.233 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:43.231+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:43.244 INFO:teuthology.orchestra.run.smithi070.stdout:1656 write 0x312b97c thru 0x3136999 (0xb01e bytes) 2024-09-11T06:17:43.247 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:43.249 INFO:teuthology.orchestra.run.smithi070.stdout:1658 trunc from 0x313699a to 0x4be2615 2024-09-11T06:17:43.255 INFO:teuthology.orchestra.run.smithi070.stdout:1660 clone 8 order 23 su 65536 sc 3 2024-09-11T06:17:43.269 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:444 3.3 3:c5565208:::rbd_header.116dc3b5629f:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.548746359999999, 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003423368, 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 444 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714815+0000", 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714817+0000", 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9309999999999998e-06 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714824+0000", 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4200000000000004e-06 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714838+0000", 2024-09-11T06:17:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4171999999999999e-05 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714849+0000", 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1505000000000001e-05 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714910+0000", 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0594999999999998e-05 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.714919+0000", 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7180000000000002e-06 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.716614+0000", 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001694936 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.716710+0000", 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6496000000000006e-05 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.717111+0000", 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040113200000000001 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.717718+0000", 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060639799999999996 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718151+0000", 2024-09-11T06:17:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043355800000000001 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718205+0000", 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4048999999999997e-05 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.718239+0000", 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3457999999999997e-05 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:499 3.15 3:aab7007a:::rbd_data.116dc3b5629f.0000000000000049:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.370072513, 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047301069999999999, 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 499 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893490+0000", 2024-09-11T06:17:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893494+0000", 2024-09-11T06:17:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000001e-06 2024-09-11T06:17:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893503+0000", 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3719999999999994e-06 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893510+0000", 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6800000000000004e-06 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893558+0000", 2024-09-11T06:17:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8078000000000003e-05 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893683+0000", 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012479599999999999 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898219+0000", 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045364539999999997 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:501 3.15 3:ad1ccdb6:::rbd_data.116dc3b5629f.000000000000004b:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.369479451, 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042345639999999997, 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 501 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894083+0000", 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4399999999999999e-07 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894087+0000", 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4530000000000004e-06 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894098+0000", 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0892e-05 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894105+0000", 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0949999999999998e-06 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894148+0000", 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2330000000000003e-05 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894246+0000", 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7820999999999997e-05 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898317+0000", 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040711289999999997 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2339 3.15 3:ab55ab8e:::rbd_data.116dc3b5629f.00000000000000a2:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.885523738, 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036876579999999999, 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2339 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378038+0000", 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378040+0000", 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0700000000000001e-06 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378047+0000", 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378064+0000", 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6490999999999998e-05 2024-09-11T06:17:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378073+0000", 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0820000000000005e-06 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378152+0000", 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9116999999999995e-05 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378248+0000", 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6522999999999997e-05 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.378384+0000", 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013565499999999999 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.379558+0000", 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011737169999999999 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381646+0000", 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020887200000000001 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381683+0000", 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6641999999999999e-05 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.381726+0000", 2024-09-11T06:17:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2521999999999997e-05 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.580143916000001, 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:17:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:17:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2562 3.3 e33/24 ondisk, result = 0)", 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.564640016999999, 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074132119999999998, 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698923+0000", 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698928+0000", 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698942+0000", 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4399999999999999e-05 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698953+0000", 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0463e-05 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706238+0000", 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072859140000000001 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706246+0000", 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706335+0000", 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9016000000000003e-05 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.460147677999998, 2024-09-11T06:17:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:17:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:17:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:17:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7611 3.c 3:37d62a9b:::rbd_data.116d497c8375.00000000000001c0:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.82984802, 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054268129999999999, 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7611 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433715+0000", 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4300000000000001e-07 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433718+0000", 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9230000000000004e-06 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433729+0000", 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433734+0000", 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6509999999999998e-06 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433789+0000", 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433913+0000", 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123411 2024-09-11T06:17:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439140+0000", 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052277319999999997 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7616 3.c 3:3048ccfb:::rbd_data.116d497c8375.00000000000001c5:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.827016849, 2024-09-11T06:17:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053875420000000004, 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7616 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436546+0000", 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5000000000000002e-07 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436550+0000", 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2590000000000002e-06 2024-09-11T06:17:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436558+0000", 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0989999999999999e-06 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436564+0000", 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0939999999999996e-06 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436602+0000", 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7956e-05 2024-09-11T06:17:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436671+0000", 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8804000000000001e-05 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.441932+0000", 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052615800000000001 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7628 3.c 3:34665162:::rbd_data.116d497c8375.00000000000001d4:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.824328791999999, 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057029460000000004, 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7628 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439234+0000", 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1500000000000003e-07 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439239+0000", 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439251+0000", 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2142e-05 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439260+0000", 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4020000000000008e-06 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439300+0000", 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9578e-05 2024-09-11T06:17:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439373+0000", 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3716999999999999e-05 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.444936+0000", 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005562338 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:15475 3.3 3:c231e28a:::rbd_data.116d3c8aaf0c.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.153309+0000", 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1102524979999995, 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040631360000000002, 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15475 2024-09-11T06:17:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153309+0000", 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153309+0000", 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153311+0000", 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.852e-06 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153318+0000", 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1659999999999997e-06 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153338+0000", 2024-09-11T06:17:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0058e-05 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153348+0000", 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0145e-05 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153416+0000", 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7309000000000002e-05 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:17:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153424+0000", 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0369999999999995e-06 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.156695+0000", 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032712459999999998 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.156771+0000", 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5747999999999994e-05 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.157372+0000", 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060157500000000003 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:15485 3.3 3:c606b8a7:::rbd_data.116d3c8aaf0c.0000000000000014:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.153450+0000", 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1101114990000003, 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004017016, 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15485 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153450+0000", 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153450+0000", 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153451+0000", 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153455+0000", 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1350000000000002e-06 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153465+0000", 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5619999999999993e-06 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153472+0000", 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9289999999999998e-06 2024-09-11T06:17:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153525+0000", 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2989999999999999e-05 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.153531+0000", 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0020000000000003e-06 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.157396+0000", 2024-09-11T06:17:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038644730000000002 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.157467+0000", 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1196000000000001e-05 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:15521 3.3 3:c42f36cf:::rbd_data.116d3c8aaf0c.0000000000000038:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.154225+0000", 2024-09-11T06:17:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.109336892, 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033713789999999999, 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15521 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154225+0000", 2024-09-11T06:17:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154225+0000", 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154226+0000", 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1900000000000001e-07 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154230+0000", 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5600000000000004e-06 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154241+0000", 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1377e-05 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154249+0000", 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3300000000000001e-06 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154409+0000", 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159896 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154414+0000", 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7819999999999999e-06 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.157512+0000", 2024-09-11T06:17:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003097589 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.157596+0000", 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4025999999999998e-05 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:15530 3.3 3:c5d79f88:::rbd_data.116d3c8aaf0c.0000000000000041:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.154348+0000", 2024-09-11T06:17:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1092137399999995, 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036721409999999999, 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15530 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154348+0000", 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154348+0000", 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154348+0000", 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6100000000000001e-07 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154351+0000", 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0029999999999999e-06 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154359+0000", 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6599999999999995e-06 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154365+0000", 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2979999999999997e-06 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154438+0000", 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3077999999999994e-05 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154444+0000", 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3589999999999999e-06 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.157930+0000", 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034857030000000002 2024-09-11T06:17:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.158020+0000", 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0478999999999999e-05 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:15547 3.3 3:c231e28a:::rbd_data.116d3c8aaf0c.000000000000000a:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.154883+0000", 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1086784329999997, 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033737770000000001, 2024-09-11T06:17:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15547 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154883+0000", 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154883+0000", 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154884+0000", 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1699999999999997e-07 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154889+0000", 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2290000000000002e-06 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154912+0000", 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2257999999999999e-05 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154920+0000", 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2160000000000006e-06 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.155093+0000", 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172936 2024-09-11T06:17:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.155099+0000", 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0730000000000001e-06 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.158063+0000", 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002964623 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.158184+0000", 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120971 2024-09-11T06:17:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.158257+0000", 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2553999999999997e-05 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:15557 3.3 3:c606b8a7:::rbd_data.116d3c8aaf0c.0000000000000014:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.154938+0000", 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1086241159999997, 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034340659999999999, 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 15557 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154938+0000", 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154938+0000", 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154938+0000", 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7899999999999998e-07 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154941+0000", 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0520000000000002e-06 2024-09-11T06:17:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154949+0000", 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9279999999999993e-06 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.154955+0000", 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9209999999999997e-06 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.155124+0000", 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016887099999999999 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.155129+0000", 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.417e-06 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.158287+0000", 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031574849999999998 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.158372+0000", 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4813000000000003e-05 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16953 3.3 3:c36bd5dc:::rbd_data.116d55772b3c.0000000000000001:head [write 0~40960 [fadvise_sequential+fadvise_nocache],write 57344~24576 [fadvise_sequential+fadvise_nocache],write 122880~40960 [fadvise_sequential+fadvise_nocache],write 237568~8192 [fadvise_sequential+fadvise_nocache],write 294912~24576 [fadvise_sequential+fadvise_nocache],write 647168~24576 [fadvise_sequential+fadvise_nocache],write 704512~49152 [fadvise_sequential+fadvise_nocache],write 819200~8192 [fadvise_sequential+fadvise_nocache],write 1105920~8589 [fadvise_sequential+fadvise_nocache],write 1286144~57344 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.190353+0000", 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0732086780000003, 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052902720000000004, 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16953 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190353+0000", 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190353+0000", 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190355+0000", 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6610000000000001e-06 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190786+0000", 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043102499999999997 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190799+0000", 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3794999999999999e-05 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190808+0000", 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6330000000000002e-06 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190871+0000", 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000005e-05 2024-09-11T06:17:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.191048+0000", 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000177555 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.191360+0000", 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031143000000000002 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.193530+0000", 2024-09-11T06:17:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021706799999999999 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.195505+0000", 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019748729999999998 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.195586+0000", 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0641000000000003e-05 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.195643+0000", 2024-09-11T06:17:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7328999999999999e-05 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:19026 3.1d e48/24 3:bfc16a45:::rbd_data.116d55772b3c.0000000000000010:head v 48'246, mlcod=46'244)", 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.314509+0000", 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9490524780000005, 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040704679999999998, 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.314509+0000", 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.314509+0000", 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.314511+0000", 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.412e-06 2024-09-11T06:17:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.314782+0000", 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027131799999999999 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.314797+0000", 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4688000000000001e-05 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.314805+0000", 2024-09-11T06:17:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.943e-06 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.314866+0000", 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1066000000000001e-05 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.314891+0000", 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5007e-05 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.318497+0000", 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003606658 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.318580+0000", 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2375999999999999e-05 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:21748 3.3 3:c4378e7e:::rbd_header.116d3c8aaf0c:head [watch reconnect cookie 139721796033632 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.611597+0000", 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6519645099999991, 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038467340000000001, 2024-09-11T06:17:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 21748 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.611597+0000", 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.611597+0000", 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.611598+0000", 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8800000000000002e-07 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.611603+0000", 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.611613+0000", 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0638999999999999e-05 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.611621+0000", 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2359999999999998e-06 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.611677+0000", 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6011999999999998e-05 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.611758+0000", 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1070999999999997e-05 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.615444+0000", 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036861289999999998 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:24610 3.c 3:33f7bc67:::rbd_data.116d3246af40.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:38.702289+0000", 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5612726280000002, 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007044448, 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 24610 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702289+0000", 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702289+0000", 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702290+0000", 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702295+0000", 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702305+0000", 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0616e-05 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702313+0000", 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4440000000000002e-06 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702363+0000", 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9944999999999997e-05 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702415+0000", 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2247999999999998e-05 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.703810+0000", 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001394901 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.709238+0000", 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054279289999999997 2024-09-11T06:17:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.709264+0000", 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6548999999999999e-05 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.709303+0000", 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8810999999999998e-05 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.709333+0000", 2024-09-11T06:17:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0434e-05 2024-09-11T06:17:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:43.377 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:43.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:43.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op export --pgid 3.1a --file /var/log/ceph/exp.3.1a.1 2024-09-11T06:17:43.380 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:43.378+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:43.479 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:43.477+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:43.523 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:43.523 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:43.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:43.616 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:43.615+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:43.674 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:43.675 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:43.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:43.681+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:43.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:43.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:43.781+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:43.825 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:43.825 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:43.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:43.883 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:43.883+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:43.936 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:43.936 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:43.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:43.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:43.984+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:44.049 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:44.049 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:44.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:44.101 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:44.100+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:44.160 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:44.161 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:44.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:44.192 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:17:44.211 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:44.210+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:44.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:44.286+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:44.288 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:44.288 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:44.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:44.387 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:44.387+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:44.442 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:44.442 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:44.451 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:44.492 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:44.492+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:44.589 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:44.588+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:44.595 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:44.595 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:44.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:44.690 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:44.689+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:44.747 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:44.747 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:44.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:44.798 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:44.797+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:44.892 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:44.891+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:44.898 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:44.899 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:44.909 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:44.993 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:44.992+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:45.012 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:45.012 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:45.021 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:45.060 INFO:teuthology.orchestra.run.smithi070.stderr:Exporting 3.1a info 3.1a( v 49'97 (0'0,49'97] local-lis/les=36/37 n=3 ec=24/24 lis/c=36/36 les/c/f=37/37/0 sis=36) 2024-09-11T06:17:45.066 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:595c52c6:::rbd_data.116df69fa911.0000000000000000:head# 2024-09-11T06:17:45.069 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:5cea7035:::rbd_info:head# 2024-09-11T06:17:45.069 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:5f063de2:::rbd_data.116d3c8aaf0c.000000000000000b:head# 2024-09-11T06:17:45.069 INFO:teuthology.orchestra.run.smithi070.stderr:Export successful 2024-09-11T06:17:45.094 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:45.093+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:45.095 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:17:45.132 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:45.132 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:45.142 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:45.194 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:45.194+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:45.246 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:45.246 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:45.254 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:45.296 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:45.295+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:45.396 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:45.395+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:45.398 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:45.398 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:45.407 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:45.497 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:45.496+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:45.549 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:45.549 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:45.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:45.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --force --op remove --pgid 3.1a 2024-09-11T06:17:45.598 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:45.598+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:45.699 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:45.699+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:45.709 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:45.800 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:45.799+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:45.811 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:45.812 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:45.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:45.901 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:45.900+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:45.926 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:45.926 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:45.926 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:45.926 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:45.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:46.001 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:46.001+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:46.078 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:46.078 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:46.086 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:46.102 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:46.101+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:46.164 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-11T06:17:46.197 INFO:teuthology.orchestra.run.smithi070.stdout:1661 writesame 0x5aefff thru 0x5b33ad data_size 0x1(0x43af bytes) 2024-09-11T06:17:46.202 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:46.202+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:46.205 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:499 3.15 3:aab7007a:::rbd_data.116dc3b5629f.0000000000000049:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.310467407000001, 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047301069999999999, 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 499 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893489+0000", 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893490+0000", 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5700000000000002e-07 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893494+0000", 2024-09-11T06:17:46.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000001e-06 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893503+0000", 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3719999999999994e-06 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893510+0000", 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6800000000000004e-06 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893558+0000", 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8078000000000003e-05 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.893683+0000", 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012479599999999999 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898219+0000", 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045364539999999997 2024-09-11T06:17:46.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:501 3.15 3:ad1ccdb6:::rbd_data.116dc3b5629f.000000000000004b:head [delete] snapc 4=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.309874345000001, 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042345639999999997, 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 501 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894082+0000", 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894083+0000", 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4399999999999999e-07 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894087+0000", 2024-09-11T06:17:46.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4530000000000004e-06 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894098+0000", 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0892e-05 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894105+0000", 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0949999999999998e-06 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894148+0000", 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2330000000000003e-05 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.894246+0000", 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7820999999999997e-05 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:16.898317+0000", 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040711289999999997 2024-09-11T06:17:46.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.520538810000001, 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:17:46.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:17:46.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:2562 3.3 e33/24 ondisk, result = 0)", 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.505034910999999, 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074132119999999998, 2024-09-11T06:17:46.222 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698922+0000", 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698923+0000", 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698928+0000", 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698942+0000", 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4399999999999999e-05 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.698953+0000", 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0463e-05 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706238+0000", 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072859140000000001 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706246+0000", 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:17:46.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706335+0000", 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9016000000000003e-05 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.400542571999999, 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:17:46.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7611 3.c 3:37d62a9b:::rbd_data.116d497c8375.00000000000001c0:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.770242914000001, 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054268129999999999, 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7611 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433714+0000", 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433715+0000", 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4300000000000001e-07 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433718+0000", 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9230000000000004e-06 2024-09-11T06:17:46.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433729+0000", 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0244000000000001e-05 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433734+0000", 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6509999999999998e-06 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433789+0000", 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.433913+0000", 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123411 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439140+0000", 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052277319999999997 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.236 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7616 3.c 3:3048ccfb:::rbd_data.116d497c8375.00000000000001c5:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.767411743, 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053875420000000004, 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7616 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436545+0000", 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436546+0000", 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5000000000000002e-07 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436550+0000", 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2590000000000002e-06 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436558+0000", 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0989999999999999e-06 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436564+0000", 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0939999999999996e-06 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436602+0000", 2024-09-11T06:17:46.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7956e-05 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.436671+0000", 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8804000000000001e-05 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.441932+0000", 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052615800000000001 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:7628 3.c 3:34665162:::rbd_data.116d497c8375.00000000000001d4:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.764723686, 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057029460000000004, 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 7628 2024-09-11T06:17:46.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439233+0000", 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439234+0000", 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1500000000000003e-07 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439239+0000", 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439251+0000", 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2142e-05 2024-09-11T06:17:46.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439260+0000", 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4020000000000008e-06 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439300+0000", 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9578e-05 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.439373+0000", 2024-09-11T06:17:46.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3716999999999999e-05 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:28.444936+0000", 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005562338 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16953 3.3 3:c36bd5dc:::rbd_data.116d55772b3c.0000000000000001:head [write 0~40960 [fadvise_sequential+fadvise_nocache],write 57344~24576 [fadvise_sequential+fadvise_nocache],write 122880~40960 [fadvise_sequential+fadvise_nocache],write 237568~8192 [fadvise_sequential+fadvise_nocache],write 294912~24576 [fadvise_sequential+fadvise_nocache],write 647168~24576 [fadvise_sequential+fadvise_nocache],write 704512~49152 [fadvise_sequential+fadvise_nocache],write 819200~8192 [fadvise_sequential+fadvise_nocache],write 1105920~8589 [fadvise_sequential+fadvise_nocache],write 1286144~57344 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.190353+0000", 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.013603571999999, 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052902720000000004, 2024-09-11T06:17:46.246 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16953 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190353+0000", 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190353+0000", 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190355+0000", 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6610000000000001e-06 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190786+0000", 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043102499999999997 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190799+0000", 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3794999999999999e-05 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190808+0000", 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6330000000000002e-06 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.190871+0000", 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000005e-05 2024-09-11T06:17:46.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.191048+0000", 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000177555 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.191360+0000", 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031143000000000002 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.193530+0000", 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021706799999999999 2024-09-11T06:17:46.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.195505+0000", 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019748729999999998 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.195586+0000", 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0641000000000003e-05 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.195643+0000", 2024-09-11T06:17:46.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7328999999999999e-05 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:24610 3.c 3:33f7bc67:::rbd_data.116d3246af40.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:38.702289+0000", 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.501667522, 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007044448, 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:46.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 24610 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702289+0000", 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702289+0000", 2024-09-11T06:17:46.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702290+0000", 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702295+0000", 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702305+0000", 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0616e-05 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702313+0000", 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4440000000000002e-06 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702363+0000", 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9944999999999997e-05 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.702415+0000", 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2247999999999998e-05 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.703810+0000", 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001394901 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.709238+0000", 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054279289999999997 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.709264+0000", 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6548999999999999e-05 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.709303+0000", 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8810999999999998e-05 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:38.709333+0000", 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0434e-05 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25545 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 1048576~31950 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.112278+0000", 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.091678218, 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045743759999999998, 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25545 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.258 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112278+0000", 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112278+0000", 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112279+0000", 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:17:46.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112281+0000", 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112288+0000", 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6029999999999999e-06 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112294+0000", 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1340000000000003e-06 2024-09-11T06:17:46.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.116124+0000", 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038309619999999998 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.116198+0000", 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3644000000000002e-05 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.116853+0000", 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065455199999999998 2024-09-11T06:17:46.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25546 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 1179648~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.112300+0000", 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.0916564989999999, 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048298689999999997, 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25546 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112300+0000", 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112300+0000", 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112300+0000", 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112302+0000", 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.967e-06 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112311+0000", 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6500000000000002e-06 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112316+0000", 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1290000000000004e-06 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.116925+0000", 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046086160000000003 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.117018+0000", 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3525999999999999e-05 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.117130+0000", 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111612 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25547 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 1310720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.112337+0000", 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.0916193380000001, 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050021960000000004, 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25547 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112337+0000", 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112337+0000", 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112338+0000", 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0400000000000002e-07 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112340+0000", 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112348+0000", 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4440000000000008e-06 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112354+0000", 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7150000000000003e-06 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.117165+0000", 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114179999999996 2024-09-11T06:17:46.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.117245+0000", 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9457999999999997e-05 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.117339+0000", 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4468000000000004e-05 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25548 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 1441792~12380 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.112362+0000", 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.091594623, 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054545590000000003, 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25548 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112362+0000", 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112362+0000", 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112362+0000", 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112376+0000", 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4112e-05 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112385+0000", 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-06 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.112391+0000", 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.117369+0000", 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049779669999999998 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.117441+0000", 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1601999999999996e-05 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.117816+0000", 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037556699999999999 2024-09-11T06:17:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25646 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 851968~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.114907+0000", 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.089049428, 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042685600000000002, 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25646 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114907+0000", 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114907+0000", 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114908+0000", 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2e-07 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114910+0000", 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-06 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114916+0000", 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.127e-06 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114921+0000", 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0830000000000003e-06 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119013+0000", 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040921100000000004 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119083+0000", 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0270000000000003e-05 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119176+0000", 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.255e-05 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25647 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 983040~65536 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.114927+0000", 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.08902992, 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045356090000000003, 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25647 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114927+0000", 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114927+0000", 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114927+0000", 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.58e-07 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114929+0000", 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.877e-06 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114935+0000", 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9290000000000003e-06 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114940+0000", 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7090000000000001e-06 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119214+0000", 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042747050000000002 2024-09-11T06:17:46.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119276+0000", 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1373999999999999e-05 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119462+0000", 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018655700000000001 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25648 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 1114112~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.114945+0000", 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.0890117290000001, 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047615119999999999, 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25648 2024-09-11T06:17:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114945+0000", 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114945+0000", 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114945+0000", 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2300000000000002e-07 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114947+0000", 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.59e-06 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114952+0000", 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.114957+0000", 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119508+0000", 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045502140000000003 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119596+0000", 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8516000000000004e-05 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119706+0000", 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110152 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25649 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 1245184~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.115020+0000", 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.0889366540000001, 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049146190000000003, 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25649 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115020+0000", 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115020+0000", 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115020+0000", 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8100000000000003e-07 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115023+0000", 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0309999999999999e-06 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115031+0000", 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7870000000000002e-06 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115037+0000", 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1109999999999996e-06 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119743+0000", 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004705585 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119824+0000", 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0786999999999997e-05 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119934+0000", 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011073699999999999 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25650 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [sparse-read 1376256~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.115046+0000", 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.088910359, 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050805929999999996, 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25650 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115046+0000", 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115046+0000", 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115047+0000", 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:17:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115049+0000", 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0669999999999999e-06 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115055+0000", 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0310000000000004e-06 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115059+0000", 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8269999999999997e-06 2024-09-11T06:17:46.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.119961+0000", 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049019249999999997 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.120015+0000", 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3999999999999998e-05 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.120127+0000", 2024-09-11T06:17:46.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011134299999999999 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:25651 3.c 3:33149272:::rbd_data.116d8d2c13b4.0000000000000005:11 [read 1507328~6887 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:45.115067+0000", 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.088889883, 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053444909999999998, 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:46.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 25651 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115067+0000", 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115067+0000", 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:46.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115067+0000", 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4799999999999998e-07 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115083+0000", 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6035000000000001e-05 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115090+0000", 2024-09-11T06:17:46.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6499999999999999e-06 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.115096+0000", 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.120155+0000", 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050595079999999999 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:46.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.120235+0000", 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0146000000000001e-05 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:45.120411+0000", 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000175694 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:46.301 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:46.302 INFO:teuthology.orchestra.run.smithi070.stdout:1662 read 0x1d938e3 thru 0x1d99f4a (0x6668 bytes) 2024-09-11T06:17:46.302 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.302 INFO:teuthology.orchestra.run.smithi070.stdout:1664 read 0x3cdcafc thru 0x3ce28c4 (0x5dc9 bytes) 2024-09-11T06:17:46.302 INFO:teuthology.orchestra.run.smithi070.stdout:1665 write 0xd598ca thru 0xd621b7 (0x88ee bytes) 2024-09-11T06:17:46.303 INFO:teuthology.orchestra.run.smithi070.stdout:1668 trunc from 0x4be2615 to 0x31ab227 2024-09-11T06:17:46.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:46.305 INFO:teuthology.orchestra.run.smithi070.stdout:1669 read 0x1c28860 thru 0x1c35af8 (0xd299 bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1671 write 0x9c0d7d0 thru 0x9c10044 (0x2875 bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1672 trunc from 0x9c10045 to 0x6737e8b 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1673 write 0xa957aa2 thru 0xa963447 (0xb9a6 bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1674 read 0x4869d58 thru 0x4872bc7 (0x8e70 bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1675 punch from 0x461c76c to 0x46264e8, (0x9d7c bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1676 punch from 0xb083f7 to 0xb0d4a9, (0x50b2 bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1677 punch from 0x332f202 to 0x3330a8f, (0x188d bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1678 write 0x43d236b thru 0x43de4f5 (0xc18b bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1679 write 0x667fca3 thru 0x6681821 (0x1b7f bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1681 read 0x5e76a06 thru 0x5e85755 (0xed50 bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1682 read 0x9809b45 thru 0x98151d4 (0xb690 bytes) 2024-09-11T06:17:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:1684 writesame 0xdaf22c4 thru 0xdafb2bf data_size 0x61(0x8ffc bytes) 2024-09-11T06:17:46.307 INFO:teuthology.orchestra.run.smithi070.stdout:1685 read 0xd10455 thru 0xd12e50 (0x29fc bytes) 2024-09-11T06:17:46.307 INFO:teuthology.orchestra.run.smithi070.stdout:1689 read 0xc3e0836 thru 0xc3eb5a9 (0xad74 bytes) 2024-09-11T06:17:46.307 INFO:teuthology.orchestra.run.smithi070.stdout:1690 write 0x323b7ab thru 0x323d32f (0x1b85 bytes) 2024-09-11T06:17:46.307 INFO:teuthology.orchestra.run.smithi070.stdout:1691 trunc from 0xdafb2c0 to 0x4474fed 2024-09-11T06:17:46.309 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:46.308+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:46.327 INFO:teuthology.orchestra.run.smithi070.stdout:1692 write 0xded28b3 thru 0xded4d0c (0x245a bytes) 2024-09-11T06:17:46.332 INFO:teuthology.orchestra.run.smithi070.stdout:1693 write 0x47c3714 thru 0x47c9fb2 (0x689f bytes) 2024-09-11T06:17:46.336 INFO:teuthology.orchestra.run.smithi070.stdout:1694 write 0x1a9343f thru 0x1a95118 (0x1cda bytes) 2024-09-11T06:17:46.340 INFO:teuthology.orchestra.run.smithi070.stdout:1697 trunc from 0xded4d0d to 0xb3aafa9 2024-09-11T06:17:46.361 INFO:teuthology.orchestra.run.smithi070.stdout:1698 write 0xe502ce4 thru 0xe507040 (0x435d bytes) 2024-09-11T06:17:46.363 INFO:teuthology.orchestra.run.smithi070.stdout:1700 read 0xc4e1d3 thru 0xc5a8ce (0xc6fc bytes) 2024-09-11T06:17:46.364 INFO:teuthology.orchestra.run.smithi070.stdout:1701 read 0xe0cbcfd thru 0xe0d31c6 (0x74ca bytes) 2024-09-11T06:17:46.364 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.364 INFO:teuthology.orchestra.run.smithi070.stdout:1703 punch from 0xc4125ba to 0xc418234, (0x5c7a bytes) 2024-09-11T06:17:46.364 INFO:teuthology.orchestra.run.smithi070.stdout:1705 punch from 0x3a4cb9d to 0x3a59f25, (0xd388 bytes) 2024-09-11T06:17:46.364 INFO:teuthology.orchestra.run.smithi070.stdout:1706 read 0xa9be5b8 thru 0xa9c8a35 (0xa47e bytes) 2024-09-11T06:17:46.364 INFO:teuthology.orchestra.run.smithi070.stdout:1707 write 0x99f9815 thru 0x9a09684 (0xfe70 bytes) 2024-09-11T06:17:46.367 INFO:teuthology.orchestra.run.smithi070.stdout:1708 write 0x800779b thru 0x8008255 (0xabb bytes) 2024-09-11T06:17:46.370 INFO:teuthology.orchestra.run.smithi070.stdout:1709 writesame 0xe92f73 thru 0xe9f7c3 data_size 0x1(0xc851 bytes) 2024-09-11T06:17:46.394 INFO:teuthology.orchestra.run.smithi070.stdout:1710 write 0x3c8e8e3 thru 0x3c98fe5 (0xa703 bytes) 2024-09-11T06:17:46.395 INFO:teuthology.orchestra.run.smithi070.stdout:1712 writesame 0x306d31c thru 0x30772bc data_size 0xb(0x9fa1 bytes) 2024-09-11T06:17:46.398 INFO:teuthology.orchestra.run.smithi070.stdout:1713 punch from 0x6d26024 to 0x6d31b3f, (0xbb1b bytes) 2024-09-11T06:17:46.399 INFO:teuthology.orchestra.run.smithi070.stdout:1717 punch from 0x7db7c46 to 0x7dbc194, (0x454e bytes) 2024-09-11T06:17:46.399 INFO:teuthology.orchestra.run.smithi070.stdout:1718 read 0xae2850 thru 0xaef9b7 (0xd168 bytes) 2024-09-11T06:17:46.399 INFO:teuthology.orchestra.run.smithi070.stdout:1722 write 0x10d61b3 thru 0x10d9148 (0x2f96 bytes) 2024-09-11T06:17:46.409 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:46.408+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:46.414 INFO:teuthology.orchestra.run.smithi070.stdout:1723 trunc from 0xe507041 to 0x2b4f554 2024-09-11T06:17:46.424 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:46.424 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:46.425 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.425 INFO:teuthology.orchestra.run.smithi070.stdout:1726 read 0x654fb3 thru 0x659fe5 (0x5033 bytes) 2024-09-11T06:17:46.437 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:46.443 INFO:teuthology.orchestra.run.smithi070.stdout:1727 write 0xce52cac thru 0xce567a1 (0x3af6 bytes) 2024-09-11T06:17:46.451 INFO:teuthology.orchestra.run.smithi070.stdout:1729 write 0xd22f3b3 thru 0xd23dd3a (0xe988 bytes) 2024-09-11T06:17:46.455 INFO:teuthology.orchestra.run.smithi070.stdout:1731 punch from 0x7c4801 to 0x7c743a, (0x2c39 bytes) 2024-09-11T06:17:46.455 INFO:teuthology.orchestra.run.smithi070.stdout:1732 write 0x28fda71 thru 0x290582d (0x7dbd bytes) 2024-09-11T06:17:46.462 INFO:teuthology.orchestra.run.smithi070.stdout:1734 trunc from 0xd23dd3b to 0xa4e014e 2024-09-11T06:17:46.474 INFO:teuthology.orchestra.run.smithi070.stdout:1735 trunc from 0xa4e014e to 0x8c30c2b 2024-09-11T06:17:46.489 INFO:teuthology.orchestra.run.smithi070.stdout:1736 writesame 0xb7e7d3f thru 0xb7f4871 data_size 0x1(0xcb33 bytes) 2024-09-11T06:17:46.490 INFO:teuthology.orchestra.run.smithi070.stdout:1737 writesame 0x7f40c82 thru 0x7f4a92b data_size 0xb(0x9caa bytes) 2024-09-11T06:17:46.493 INFO:teuthology.orchestra.run.smithi070.stdout:1738 write 0x71359cd thru 0x713ad07 (0x533b bytes) 2024-09-11T06:17:46.497 INFO:teuthology.orchestra.run.smithi070.stdout:1740 punch from 0xa35b034 to 0xa35e874, (0x3840 bytes) 2024-09-11T06:17:46.497 INFO:teuthology.orchestra.run.smithi070.stdout:1741 read 0x75879fc thru 0x758f851 (0x7e56 bytes) 2024-09-11T06:17:46.497 INFO:teuthology.orchestra.run.smithi070.stdout:1742 write 0x28394bc thru 0x2840bac (0x76f1 bytes) 2024-09-11T06:17:46.498 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.498 INFO:teuthology.orchestra.run.smithi070.stdout:1745 write 0x6e1777c thru 0x6e25f9a (0xe81f bytes) 2024-09-11T06:17:46.509 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:46.509+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:46.510 INFO:teuthology.orchestra.run.smithi070.stdout:1746 write 0xda65843 thru 0xda6ffd0 (0xa78e bytes) 2024-09-11T06:17:46.512 INFO:teuthology.orchestra.run.smithi070.stdout:1748 punch from 0x3b44fb9 to 0x3b4b82d, (0x6874 bytes) 2024-09-11T06:17:46.513 INFO:teuthology.orchestra.run.smithi070.stdout:1749 read 0xc5c694 thru 0xc5f3eb (0x2d58 bytes) 2024-09-11T06:17:46.513 INFO:teuthology.orchestra.run.smithi070.stdout:1750 write 0xbd1c996 thru 0xbd246f2 (0x7d5d bytes) 2024-09-11T06:17:46.516 INFO:teuthology.orchestra.run.smithi070.stdout:1751 punch from 0x77336bf to 0x7734ebd, (0x17fe bytes) 2024-09-11T06:17:46.516 INFO:teuthology.orchestra.run.smithi070.stdout:1752 write 0x293b092 thru 0x293fe74 (0x4de3 bytes) 2024-09-11T06:17:46.518 INFO:teuthology.orchestra.run.smithi070.stdout:1753 write 0x5dca8e thru 0x5ec255 (0xf7c8 bytes) 2024-09-11T06:17:46.520 INFO:teuthology.orchestra.run.smithi070.stdout:1754 read 0x8dcd781 thru 0x8dcf19f (0x1a1f bytes) 2024-09-11T06:17:46.520 INFO:teuthology.orchestra.run.smithi070.stdout:1755 read 0x87d4c55 thru 0x87d59b6 (0xd62 bytes) 2024-09-11T06:17:46.520 INFO:teuthology.orchestra.run.smithi070.stdout:1756 write 0x6047e3c thru 0x6049f33 (0x20f8 bytes) 2024-09-11T06:17:46.521 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.521 INFO:teuthology.orchestra.run.smithi070.stdout:1758 punch from 0x1fd732f to 0x1fdb360, (0x4031 bytes) 2024-09-11T06:17:46.521 INFO:teuthology.orchestra.run.smithi070.stdout:1759 write 0x7027d2 thru 0x70e4e9 (0xbd18 bytes) 2024-09-11T06:17:46.523 INFO:teuthology.orchestra.run.smithi070.stdout:1760 write 0x46a4f0f thru 0x46b081a (0xb90c bytes) 2024-09-11T06:17:46.536 INFO:teuthology.orchestra.run.smithi070.stdout:1761 trunc from 0xda6ffd1 to 0x563d2a1 2024-09-11T06:17:46.545 INFO:teuthology.orchestra.run.smithi070.stdout:1762 read 0x27a9c47 thru 0x27b7d81 (0xe13b bytes) 2024-09-11T06:17:46.547 INFO:teuthology.orchestra.run.smithi070.stdout:1763 read 0x40e263 thru 0x40ef04 (0xca2 bytes) 2024-09-11T06:17:46.559 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:46.559 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:46.564 INFO:teuthology.orchestra.run.smithi070.stdout:1764 writesame 0xedd654d thru 0xedda33a data_size 0x1(0x3dee bytes) 2024-09-11T06:17:46.564 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.565 INFO:teuthology.orchestra.run.smithi070.stdout:1768 write 0x16351d9 thru 0x16418d9 (0xc701 bytes) 2024-09-11T06:17:46.566 INFO:teuthology.orchestra.run.smithi070.stdout:1769 punch from 0x2592e1c to 0x25941bf, (0x13a3 bytes) 2024-09-11T06:17:46.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:46.582 INFO:teuthology.orchestra.run.smithi070.stdout:1770 trunc from 0xedda33b to 0x133f0ce 2024-09-11T06:17:46.593 INFO:teuthology.orchestra.run.smithi070.stdout:1772 write 0x15723f thru 0x165251 (0xe013 bytes) 2024-09-11T06:17:46.595 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.607 INFO:teuthology.orchestra.run.smithi070.stdout:1776 trunc from 0x133f0ce to 0xbc76ff7 2024-09-11T06:17:46.610 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:46.610+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:46.613 INFO:teuthology.orchestra.run.smithi070.stdout:1777 punch from 0x1a5290e to 0x1a54988, (0x207a bytes) 2024-09-11T06:17:46.613 INFO:teuthology.orchestra.run.smithi070.stdout:1781 read 0x657231e thru 0x6575576 (0x3259 bytes) 2024-09-11T06:17:46.626 INFO:teuthology.orchestra.run.smithi070.stdout:1782 trunc from 0xbc76ff7 to 0xf918aa 2024-09-11T06:17:46.633 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.648 INFO:teuthology.orchestra.run.smithi070.stdout:1786 writesame 0x88806bd thru 0x8881d7f data_size 0x1(0x16c3 bytes) 2024-09-11T06:17:46.649 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.649 INFO:teuthology.orchestra.run.smithi070.stdout:1790 writesame 0x2e138c8 thru 0x2e14e76 data_size 0xd(0x15af bytes) 2024-09-11T06:17:46.651 INFO:teuthology.orchestra.run.smithi070.stdout:1791 write 0x8789de0 thru 0x878a1a5 (0x3c6 bytes) 2024-09-11T06:17:46.654 INFO:teuthology.orchestra.run.smithi070.stdout:1792 writesame 0x4745121 thru 0x47476b9 data_size 0xb(0x2599 bytes) 2024-09-11T06:17:46.657 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.657 INFO:teuthology.orchestra.run.smithi070.stdout:1794 punch from 0xec5de7 to 0xed3768, (0xd981 bytes) 2024-09-11T06:17:46.665 INFO:teuthology.orchestra.run.smithi070.stdout:1795 writesame 0xa2331fa thru 0xa23d2e9 data_size 0x67(0xa0f0 bytes) 2024-09-11T06:17:46.665 INFO:teuthology.orchestra.run.smithi070.stdout:1797 write 0x8308250 thru 0x8308cbe (0xa6f bytes) 2024-09-11T06:17:46.675 INFO:teuthology.orchestra.run.smithi070.stdout:1798 write 0xc3bcf6c thru 0xc3c61ba (0x924f bytes) 2024-09-11T06:17:46.679 INFO:teuthology.orchestra.run.smithi070.stdout:1799 write 0x9089340 thru 0x9094fd5 (0xbc96 bytes) 2024-09-11T06:17:46.682 INFO:teuthology.orchestra.run.smithi070.stdout:1800 write 0x6bf7c9d thru 0x6bf8f71 (0x12d5 bytes) 2024-09-11T06:17:46.688 INFO:teuthology.orchestra.run.smithi070.stdout:1801 write 0xa48379b thru 0xa48f41f (0xbc85 bytes) 2024-09-11T06:17:46.696 INFO:teuthology.orchestra.run.smithi070.stdout:1802 writesame 0xe40c634 thru 0xe417d86 data_size 0x1(0xb753 bytes) 2024-09-11T06:17:46.696 INFO:teuthology.orchestra.run.smithi070.stdout:1806 write 0xdd8d21f thru 0xdd98ead (0xbc8f bytes) 2024-09-11T06:17:46.699 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.699 INFO:teuthology.orchestra.run.smithi070.stdout:1808 read 0x2eecfd thru 0x2f6e60 (0x8164 bytes) 2024-09-11T06:17:46.703 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:46.703 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:46.711 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:46.711+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:46.714 INFO:teuthology.orchestra.run.smithi070.stdout:1809 trunc from 0xe417d87 to 0x26f3527 2024-09-11T06:17:46.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:46.726 INFO:teuthology.orchestra.run.smithi070.stdout:1811 read 0x1a78136 thru 0x1a82f9a (0xae65 bytes) 2024-09-11T06:17:46.726 INFO:teuthology.orchestra.run.smithi070.stdout:1812 read 0x2447180 thru 0x245200b (0xae8c bytes) 2024-09-11T06:17:46.734 INFO:teuthology.orchestra.run.smithi070.stdout:1813 writesame 0x4610cb4 thru 0x461df08 data_size 0x37(0xd255 bytes) 2024-09-11T06:17:46.742 INFO:teuthology.orchestra.run.smithi070.stdout:1814 write 0x5559bea thru 0x555da14 (0x3e2b bytes) 2024-09-11T06:17:46.745 INFO:teuthology.orchestra.run.smithi070.stdout:1816 read 0x444e6dd thru 0x44566a7 (0x7fcb bytes) 2024-09-11T06:17:46.745 INFO:teuthology.orchestra.run.smithi070.stdout:1817 read 0x7d820 thru 0x8d11e (0xf8ff bytes) 2024-09-11T06:17:46.760 INFO:teuthology.orchestra.run.smithi070.stdout:1818 writesame 0xce101de thru 0xce1dd63 data_size 0x1(0xdb86 bytes) 2024-09-11T06:17:46.761 INFO:teuthology.orchestra.run.smithi070.stdout:1819 punch from 0xc1a3886 to 0xc1b1945, (0xe0bf bytes) 2024-09-11T06:17:46.767 INFO:teuthology.orchestra.run.smithi070.stdout:1820 writesame 0xe027d94 thru 0xe02e5f2 data_size 0xb(0x685f bytes) 2024-09-11T06:17:46.772 INFO:teuthology.orchestra.run.smithi070.stdout:1822 writesame 0xe23e627 thru 0xe2483b1 data_size 0x1(0x9d8b bytes) 2024-09-11T06:17:46.777 INFO:teuthology.orchestra.run.smithi070.stdout:1823 trunc from 0xe2483b2 to 0xa985e4e 2024-09-11T06:17:46.783 INFO:teuthology.orchestra.run.smithi070.stdout:1825 trunc from 0xa985e4e to 0xabd46bc 2024-09-11T06:17:46.798 INFO:teuthology.orchestra.run.smithi070.stdout:1827 writesame 0xe7d117c thru 0xe7d9bbd data_size 0x22(0x8a42 bytes) 2024-09-11T06:17:46.798 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.799 INFO:teuthology.orchestra.run.smithi070.stdout:1830 read 0x4b9c9e5 thru 0x4ba66d2 (0x9cee bytes) 2024-09-11T06:17:46.799 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.799 INFO:teuthology.orchestra.run.smithi070.stdout:1832 punch from 0xc5ea0a1 to 0xc5efcec, (0x5c4b bytes) 2024-09-11T06:17:46.799 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.800 INFO:teuthology.orchestra.run.smithi070.stdout:1834 punch from 0xa37b07c to 0xa37f470, (0x43f4 bytes) 2024-09-11T06:17:46.800 INFO:teuthology.orchestra.run.smithi070.stdout:1835 read 0x5b87381 thru 0x5b8a4af (0x312f bytes) 2024-09-11T06:17:46.800 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.800 INFO:teuthology.orchestra.run.smithi070.stdout:1837 write 0x77f28c2 thru 0x77fe4c0 (0xbbff bytes) 2024-09-11T06:17:46.802 INFO:teuthology.orchestra.run.smithi070.stdout:1838 writesame 0xb659930 thru 0xb66073c data_size 0x1(0x6e0d bytes) 2024-09-11T06:17:46.811 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:46.810+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:46.814 INFO:teuthology.orchestra.run.smithi070.stdout:1839 writesame 0x1f664da thru 0x1f75945 data_size 0x2(0xf46c bytes) 2024-09-11T06:17:46.824 INFO:teuthology.orchestra.run.smithi070.stdout:1840 punch from 0x97945b0 to 0x979dfd4, (0x9a24 bytes) 2024-09-11T06:17:46.825 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:46.825 INFO:teuthology.orchestra.run.smithi070.stdout:1842 writesame 0x5c2d145 thru 0x5c2f108 data_size 0x4(0x1fc4 bytes) 2024-09-11T06:17:46.828 INFO:teuthology.orchestra.run.smithi070.stdout:1843 write 0x3d58dca thru 0x3d638c7 (0xaafe bytes) 2024-09-11T06:17:46.832 INFO:teuthology.orchestra.run.smithi070.stdout:1845 writesame 0x248af73 thru 0x24905ac data_size 0x27(0x563a bytes) 2024-09-11T06:17:46.835 INFO:teuthology.orchestra.run.smithi070.stdout:1847 clone 9 order 21 su 16384 sc 15 2024-09-11T06:17:46.846 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:46.846 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:46.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:46.912 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:46.911+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:46.996 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:46.996 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:47.002 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:17:47.005 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:47.021 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:47.022 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:47.022 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:47.021+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: marking collection for removal 2024-09-11T06:17:47.022 INFO:teuthology.orchestra.run.smithi070.stdout:setting '_remove' omap key 2024-09-11T06:17:47.023 INFO:teuthology.orchestra.run.smithi070.stdout:finish_remove_pgs 3.1a_head removing 3.1a 2024-09-11T06:17:47.028 INFO:teuthology.orchestra.run.smithi070.stdout:Remove successful 2024-09-11T06:17:47.040 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:47.040 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:47.056 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:47.057 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:47.073 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:47.073 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:47.090 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:47.106 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:47.110 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:17:47.110 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:17:47.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.491930304999997, 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.197494726999999, 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16806 3.9 3:933a7220:::rbd_data.116d3c8aaf0c.0000000000000018:b [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.924633556, 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036862515999999998, 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16806 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186926+0000", 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.186927+0000", 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9400000000000005e-07 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187820+0000", 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089324900000000004 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187832+0000", 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1494e-05 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187839+0000", 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.486e-06 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223214+0000", 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.035374783999999999 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223280+0000", 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6157999999999999e-05 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.223789+0000", 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050865100000000005 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16818 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923682455, 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036928510999999997, 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16818 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187877+0000", 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187878+0000", 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187880+0000", 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3649999999999998e-06 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187887+0000", 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4019999999999999e-06 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187892+0000", 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.091e-06 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224245+0000", 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036352885000000001 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224532+0000", 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028740800000000001 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224806+0000", 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027381999999999998 2024-09-11T06:17:47.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16819 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923654856000001, 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037215051999999998, 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16819 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187905+0000", 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187907+0000", 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1679999999999998e-06 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187914+0000", 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5409999999999997e-06 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187919+0000", 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.224841+0000", 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036922117999999997 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225021+0000", 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180173 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225120+0000", 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8987000000000006e-05 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16820 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923633978, 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037628920000000003, 2024-09-11T06:17:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16820 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187926+0000", 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187928+0000", 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9599999999999999e-06 2024-09-11T06:17:47.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187944+0000", 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6293000000000001e-05 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187950+0000", 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3149999999999999e-06 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225172+0000", 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037222435999999998 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225258+0000", 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5908000000000005e-05 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225555+0000", 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029660999999999999 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16821 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923602701, 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037879496999999998, 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16821 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187957+0000", 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187958+0000", 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187960+0000", 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3269999999999999e-06 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187966+0000", 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-06 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187971+0000", 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0830000000000003e-06 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225612+0000", 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037640831 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225734+0000", 2024-09-11T06:17:47.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122104 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225837+0000", 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010223800000000001 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16822 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 163840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923581839000001, 2024-09-11T06:17:47.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038088416999999999, 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16822 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187980+0000", 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:17:47.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187987+0000", 2024-09-11T06:17:47.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0809999999999999e-06 2024-09-11T06:17:47.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187991+0000", 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2420000000000002e-06 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225884+0000", 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037893139999999999 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225957+0000", 2024-09-11T06:17:47.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3306000000000006e-05 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226066+0000", 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109103 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16823 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923563119000001, 2024-09-11T06:17:47.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038574642999999999, 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16823 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187999+0000", 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.12e-06 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188005+0000", 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188010+0000", 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-06 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226107+0000", 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03809676 2024-09-11T06:17:47.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226463+0000", 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035599299999999998 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226571+0000", 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108725 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16824 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923544391, 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039232345000000002, 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16824 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188016+0000", 2024-09-11T06:17:47.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188018+0000", 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.933e-06 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188024+0000", 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2310000000000001e-06 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188038+0000", 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3837e-05 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226631+0000", 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038593589999999997 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226743+0000", 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111192 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227248+0000", 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050521599999999996 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16915 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923072845, 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038728892000000001, 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16915 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188489+0000", 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9190000000000002e-06 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188495+0000", 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6930000000000004e-06 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188505+0000", 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0203999999999999e-05 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226603+0000", 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038097497000000001 2024-09-11T06:17:47.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226680+0000", 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7115999999999998e-05 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227216+0000", 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000536123 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16916 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923044376, 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03972564, 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16916 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188516+0000", 2024-09-11T06:17:47.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188518+0000", 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.058e-06 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188524+0000", 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.015e-06 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188528+0000", 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739999999999999e-06 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227244+0000", 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038716172 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227328+0000", 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3120000000000004e-05 2024-09-11T06:17:47.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228241+0000", 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091343800000000003 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16917 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923025417, 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039912402999999999, 2024-09-11T06:17:47.171 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16917 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188535+0000", 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-07 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188539+0000", 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8940000000000003e-06 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188544+0000", 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6250000000000004e-06 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188553+0000", 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2359999999999993e-06 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228275+0000", 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039721226999999998 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228354+0000", 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370999999999996e-05 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228447+0000", 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2692e-05 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16918 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.175 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.923000239, 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040097763000000002, 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16918 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:47.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2e-07 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188562+0000", 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188568+0000", 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1419999999999998e-06 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188573+0000", 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6940000000000003e-06 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228491+0000", 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039918355000000003 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228564+0000", 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2621999999999997e-05 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228657+0000", 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517000000000006e-05 2024-09-11T06:17:47.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16919 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.922981409, 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040276407, 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16919 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188579+0000", 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188581+0000", 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188586+0000", 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8409999999999996e-06 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188601+0000", 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4545999999999999e-05 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228687+0000", 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040086418999999998 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228761+0000", 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3761000000000001e-05 2024-09-11T06:17:47.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228855+0000", 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3628000000000005e-05 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16920 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.922951575999999, 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040512056999999997, 2024-09-11T06:17:47.184 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16920 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188609+0000", 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999996e-07 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188611+0000", 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.176e-06 2024-09-11T06:17:47.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188618+0000", 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4769999999999997e-06 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188623+0000", 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8060000000000002e-06 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228884+0000", 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040261107999999997 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228959+0000", 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5100999999999998e-05 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229120+0000", 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016078500000000001 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16927 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.922844413, 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040618147, 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16927 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188716+0000", 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188717+0000", 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.283e-06 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188721+0000", 2024-09-11T06:17:47.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9020000000000001e-06 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188723+0000", 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5950000000000001e-06 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229151+0000", 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040427053999999997 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229230+0000", 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9467000000000003e-05 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229334+0000", 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010351799999999999 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16928 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.193 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.922833422, 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040816636000000003, 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16928 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188727+0000", 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188728+0000", 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0690000000000001e-06 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188731+0000", 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.982e-06 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188733+0000", 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.458e-06 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229364+0000", 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040631035000000003 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229445+0000", 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0925000000000002e-05 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229543+0000", 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7956999999999997e-05 2024-09-11T06:17:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16929 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.922823662999999, 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041025210999999999, 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16929 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:47.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188737+0000", 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0380000000000001e-06 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188740+0000", 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188744+0000", 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229575+0000", 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040831329 2024-09-11T06:17:47.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229656+0000", 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0924e-05 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229761+0000", 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105171 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16930 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.92281, 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041241585999999997, 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16930 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:47.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:47.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188752+0000", 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188758+0000", 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188762+0000", 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229808+0000", 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041046760000000002 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229854+0000", 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5365999999999999e-05 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:47.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:47.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229991+0000", 2024-09-11T06:17:47.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013750200000000001 2024-09-11T06:17:47.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:47.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:47.207 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:47.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:47.209 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:47.206+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:47.309 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:47.308+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:47.313 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:47.314 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:47.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:47.410 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:47.409+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:47.465 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:47.466 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:47.475 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:47.511 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:47.510+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:47.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.1a.1 2024-09-11T06:17:47.580 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:47.580 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:47.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:47.580 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:47.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.580 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:47.580 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:47.580 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.262212419000001, 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:17:47.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:17:47.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:47.586 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.949639201, 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:17:47.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16520 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 77824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.592 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.402804477, 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093324900000000006, 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16520 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:47.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175411+0000", 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175413+0000", 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9800000000000001e-06 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175419+0000", 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3519999999999997e-06 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175423+0000", 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.561e-06 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184591+0000", 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0091677200000000007 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184672+0000", 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1107999999999997e-05 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184743+0000", 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1339000000000003e-05 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.596 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16521 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 114688~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.402785749, 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095026380000000008, 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.597 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16521 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175432+0000", 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175438+0000", 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175445+0000", 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2219999999999996e-06 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184800+0000", 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009354322 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184848+0000", 2024-09-11T06:17:47.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8398e-05 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184932+0000", 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4132e-05 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16522 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 151552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.601 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.402694546999999, 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096235079999999994, 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16522 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175522+0000", 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1099999999999995e-07 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175525+0000", 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.619e-06 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175535+0000", 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6590000000000002e-06 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175542+0000", 2024-09-11T06:17:47.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2570000000000001e-06 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184976+0000", 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094335619999999995 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185064+0000", 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8530999999999997e-05 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185144+0000", 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0168999999999998e-05 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16523 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 188416~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.402663085, 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099147300000000001, 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16523 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:47.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175553+0000", 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175561+0000", 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5369999999999997e-06 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175571+0000", 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7480000000000005e-06 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175577+0000", 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-06 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185174+0000", 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095965570000000004 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185253+0000", 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8889999999999999e-05 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185467+0000", 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021430099999999999 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16524 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.402629087999999, 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010599717999999999, 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16524 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175587+0000", 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:17:47.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175589+0000", 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175596+0000", 2024-09-11T06:17:47.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175601+0000", 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185553+0000", 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099520630000000006 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185649+0000", 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6086000000000001e-05 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186186+0000", 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053697800000000002 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.615 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16553 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401879698, 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010060193, 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16553 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:17:47.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176340+0000", 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.405e-06 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176348+0000", 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8199999999999997e-06 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176354+0000", 2024-09-11T06:17:47.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186219+0000", 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098650109999999999 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186298+0000", 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9383999999999998e-05 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186396+0000", 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7387999999999997e-05 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16554 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401852582, 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010247795000000001, 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.620 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16554 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176364+0000", 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5799999999999998e-07 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176366+0000", 2024-09-11T06:17:47.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176373+0000", 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4289999999999998e-06 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176377+0000", 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186427+0000", 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010049742 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186511+0000", 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3991000000000003e-05 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186611+0000", 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9565e-05 2024-09-11T06:17:47.624 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16555 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401830368000001, 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010729601, 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16555 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176386+0000", 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176388+0000", 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176395+0000", 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176400+0000", 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186644+0000", 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010244052 2024-09-11T06:17:47.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186742+0000", 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8159999999999995e-05 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187115+0000", 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037263900000000002 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16593 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401780048999999, 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011057091, 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.630 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16593 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176436+0000", 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176439+0000", 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4509999999999999e-06 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176443+0000", 2024-09-11T06:17:47.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6240000000000001e-06 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176446+0000", 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0649999999999999e-06 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187152+0000", 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010706194 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187231+0000", 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8234999999999999e-05 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187492+0000", 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026178300000000002 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16594 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:47.634 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401760951, 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011362636000000001, 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16594 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176455+0000", 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176457+0000", 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176463+0000", 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176469+0000", 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187542+0000", 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011073037000000001 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187615+0000", 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3013e-05 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187817+0000", 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020221099999999999 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.638 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16595 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401741886, 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011570079, 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.639 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16595 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176478+0000", 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176482+0000", 2024-09-11T06:17:47.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176485+0000", 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9050000000000001e-06 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187855+0000", 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011370066999999999 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187951+0000", 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5435999999999999e-05 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188044+0000", 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3010000000000006e-05 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16596 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:47.643 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401719816, 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011742973, 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16596 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176498+0000", 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0889999999999998e-06 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176504+0000", 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176509+0000", 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188070+0000", 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01156101 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188138+0000", 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7527999999999994e-05 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188239+0000", 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100725 2024-09-11T06:17:47.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16597 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401699899, 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011917311999999999, 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16597 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176516+0000", 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176517+0000", 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.658e-06 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176521+0000", 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9269999999999998e-06 2024-09-11T06:17:47.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176526+0000", 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1110000000000001e-06 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188263+0000", 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011737632 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188340+0000", 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7113000000000005e-05 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188433+0000", 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2538000000000001e-05 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16598 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:47.652 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401680541999999, 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012870312, 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16598 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176538+0000", 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176546+0000", 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176550+0000", 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.797e-06 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188466+0000", 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011915965000000001 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188550+0000", 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3446e-05 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189405+0000", 2024-09-11T06:17:47.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085535500000000003 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16619 3.6 3:6708c1ee:::rbd_data.116d3c8aaf0c.000000000000002e:b [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.401429816, 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012975781, 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16619 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7199999999999998e-07 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176789+0000", 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-06 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176797+0000", 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6310000000000003e-06 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176803+0000", 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6710000000000004e-06 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189440+0000", 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012637438000000001 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189511+0000", 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1421000000000006e-05 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189761+0000", 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024988799999999998 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.661 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16675 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 196608~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.395424350000001, 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0092789550000000002, 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16675 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182791+0000", 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182792+0000", 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3399999999999998e-07 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182794+0000", 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.621e-06 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182802+0000", 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4240000000000004e-06 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.182807+0000", 2024-09-11T06:17:47.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3800000000000002e-06 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.191714+0000", 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0089070399999999997 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.191797+0000", 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2863999999999998e-05 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.192070+0000", 2024-09-11T06:17:47.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000272792 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:17472 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.347342576999999, 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013625929, 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:47.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 17472 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:47.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230874+0000", 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2999999999999999e-07 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230878+0000", 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4209999999999997e-06 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230888+0000", 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0356e-05 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230895+0000", 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9530000000000002e-06 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230940+0000", 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4589000000000003e-05 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230995+0000", 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5390000000000003e-05 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231196+0000", 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020024499999999999 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231787+0000", 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059133700000000005 2024-09-11T06:17:47.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244412+0000", 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012624803 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244460+0000", 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7802000000000001e-05 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244499+0000", 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9202999999999997e-05 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18219 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.323315901000001, 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011081077, 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:47.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18219 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:47.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254900+0000", 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-07 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254905+0000", 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254916+0000", 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0949e-05 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254925+0000", 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254972+0000", 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6826999999999997e-05 2024-09-11T06:17:47.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255031+0000", 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9364000000000003e-05 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255240+0000", 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020845600000000001 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:47.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255893+0000", 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00065294500000000004 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265665+0000", 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097724279999999997 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265932+0000", 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267197 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:47.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265981+0000", 2024-09-11T06:17:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8083e-05 2024-09-11T06:17:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:47.678 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:47.678 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:47.680 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:47.680 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:47.678+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:47.780 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:47.779+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:47.824 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:47.824 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:47.825 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:47.825 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:47.833 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:47.917 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:47.915+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:47.975 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:47.975 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:47.982 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:47.981+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:47.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:48.082 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:48.081+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:48.127 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2451 3.18 3:1f17666a:::rbd_data.116dc3b5629f.0000000000000020:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.610811310999999, 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012096045, 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.128 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2451 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515324+0000", 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0999999999999997e-07 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515329+0000", 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1330000000000001e-06 2024-09-11T06:17:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515339+0000", 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8989999999999996e-06 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515344+0000", 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515378+0000", 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3519999999999998e-05 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.515423+0000", 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5221e-05 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.517881+0000", 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0024577269999999998 2024-09-11T06:17:48.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527239+0000", 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093582379999999996 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527297+0000", 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7481000000000001e-05 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527352+0000", 2024-09-11T06:17:48.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5145000000000001e-05 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.527420+0000", 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8062e-05 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4110 3.18 3:18dbb972:::rbd_data.116df69fa911.0000000000000004:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:24.585510+0000", 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.540624779000002, 2024-09-11T06:17:48.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.024867093999999999, 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4110 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585510+0000", 2024-09-11T06:17:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585510+0000", 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585511+0000", 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585514+0000", 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4149999999999999e-06 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585521+0000", 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4339999999999997e-06 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585525+0000", 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585552+0000", 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6647000000000001e-05 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.585588+0000", 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6681999999999999e-05 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.589775+0000", 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0041868039999999997 2024-09-11T06:17:48.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.610280+0000", 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020505151999999999 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.610292+0000", 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1545e-05 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.610328+0000", 2024-09-11T06:17:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5670999999999998e-05 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:24.610377+0000", 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9657999999999998e-05 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4742 3.1f 3:f8d20853:::rbd_data.116df69fa911.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.373829+0000", 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.752306111999999, 2024-09-11T06:17:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.014753327, 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4742 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373829+0000", 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373829+0000", 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373830+0000", 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3099999999999996e-07 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373834+0000", 2024-09-11T06:17:48.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.211e-06 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373844+0000", 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0094e-05 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373852+0000", 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7530000000000001e-06 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373920+0000", 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8711e-05 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.373968+0000", 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7175999999999997e-05 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.376538+0000", 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002569918 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.388479+0000", 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011941798 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.388518+0000", 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9103999999999997e-05 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.388554+0000", 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5450000000000001e-05 2024-09-11T06:17:48.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.388582+0000", 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8280999999999999e-05 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4964 3.1f 3:fe6e2b97:::rbd_data.116df69fa911.000000000000000b:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.678276+0000", 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.447859268999999, 2024-09-11T06:17:48.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025414968, 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4964 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678276+0000", 2024-09-11T06:17:48.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678276+0000", 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678277+0000", 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5820000000000001e-06 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678283+0000", 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5809999999999996e-06 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678294+0000", 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1477999999999999e-05 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678301+0000", 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4999999999999996e-06 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678348+0000", 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7120000000000003e-05 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.678409+0000", 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1383000000000005e-05 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.682404+0000", 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039947699999999999 2024-09-11T06:17:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.703591+0000", 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021187006000000001 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.703622+0000", 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1019999999999998e-05 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.703655+0000", 2024-09-11T06:17:48.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2626999999999998e-05 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.703691+0000", 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5901000000000001e-05 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:19412 3.1f 3:fe105b17:::rbd_data.116d55772b3c.0000000000000011:head [write 458752~57344 [fadvise_sequential+fadvise_nocache],write 581632~8192 [fadvise_sequential+fadvise_nocache],write 638976~32768 [fadvise_sequential+fadvise_nocache],write 753664~32768 [fadvise_sequential+fadvise_nocache],write 1105920~73728 [fadvise_sequential+fadvise_nocache],write 1220608~32768 [fadvise_sequential+fadvise_nocache],write 1277952~57344 [fadvise_sequential+fadvise_nocache],write 1392640~24576 [fadvise_sequential+fadvise_nocache],write 1449984~49152 [fadvise_sequential+fadvise_nocache],write 1802240~16384 [fadvise_sequential+fadvise_nocache],write 1859584~40960 [fadvise_sequential+fadvise_nocache],write 1916928~57344 [fadvise_sequential+fadvise_nocache],write 2031616~16384 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.317884+0000", 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.808250507, 2024-09-11T06:17:48.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013502076999999999, 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 19412 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.317884+0000", 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.317884+0000", 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.317885+0000", 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.22e-07 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.321850+0000", 2024-09-11T06:17:48.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0039648590000000003 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.321865+0000", 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4961e-05 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.321875+0000", 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0849000000000001e-05 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.322358+0000", 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000482413 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.322489+0000", 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000130872 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.322831+0000", 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00034270600000000002 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.325718+0000", 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002886778 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.331275+0000", 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0055563460000000002 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.331346+0000", 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1767000000000006e-05 2024-09-11T06:17:48.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.331387+0000", 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0204000000000003e-05 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20089 3.17 3:e85aad2a:::rbd_data.116d3c8aaf0c.000000000000009a:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.339779+0000", 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.786355541000001, 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011666144, 2024-09-11T06:17:48.158 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20089 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339779+0000", 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339779+0000", 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339780+0000", 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339782+0000", 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2989999999999999e-06 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339788+0000", 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2759999999999997e-06 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.339793+0000", 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8999999999999997e-06 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351179+0000", 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011385595 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351248+0000", 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9269000000000004e-05 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351446+0000", 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000197445 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.162 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20110 3.17 3:ec0409e7:::rbd_data.116d3c8aaf0c.00000000000000a2:b [read 28672~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340164+0000", 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785971241, 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011496833999999999, 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20110 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340164+0000", 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340164+0000", 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340164+0000", 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1799999999999995e-07 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340168+0000", 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9469999999999996e-06 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340176+0000", 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8269999999999998e-06 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340183+0000", 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5479999999999998e-06 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351479+0000", 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011295866999999999 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351556+0000", 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7239999999999999e-05 2024-09-11T06:17:48.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351661+0000", 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000104787 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20111 3.17 3:ec0409e7:::rbd_data.116d3c8aaf0c.00000000000000a2:b [read 65536~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340190+0000", 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785944966000001, 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011721664999999999, 2024-09-11T06:17:48.167 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20111 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340190+0000", 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340190+0000", 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340191+0000", 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.75e-07 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340193+0000", 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1449999999999998e-06 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340199+0000", 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3829999999999997e-06 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340204+0000", 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0769999999999998e-06 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351712+0000", 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011507886 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351808+0000", 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5938000000000002e-05 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351912+0000", 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103661 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20112 3.17 3:ec0409e7:::rbd_data.116d3c8aaf0c.00000000000000a2:b [read 102400~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340211+0000", 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785924134, 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012039324000000001, 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20112 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340211+0000", 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340211+0000", 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340211+0000", 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5699999999999998e-07 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340213+0000", 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0339999999999999e-06 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340219+0000", 2024-09-11T06:17:48.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.976e-06 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340224+0000", 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.152e-06 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.351943+0000", 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011718657 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352020+0000", 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6699999999999994e-05 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352250+0000", 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00023044800000000001 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20113 3.17 3:ec0409e7:::rbd_data.116d3c8aaf0c.00000000000000a2:b [read 139264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340230+0000", 2024-09-11T06:17:48.178 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785904637, 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012391607000000001, 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20113 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340230+0000", 2024-09-11T06:17:48.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340230+0000", 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340231+0000", 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340233+0000", 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8109999999999999e-06 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340239+0000", 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9220000000000002e-06 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340243+0000", 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8509999999999998e-06 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352306+0000", 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012063018999999999 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352406+0000", 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100102 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352622+0000", 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000215472 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.182 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20164 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 20480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340631+0000", 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785504419, 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012160324, 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.183 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20164 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340631+0000", 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340631+0000", 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340631+0000", 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340633+0000", 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.984e-06 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340639+0000", 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1340000000000001e-06 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340644+0000", 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352661+0000", 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012016493 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352708+0000", 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7580999999999997e-05 2024-09-11T06:17:48.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352791+0000", 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2694000000000005e-05 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20165 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 57344~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340651+0000", 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785483734, 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012296458, 2024-09-11T06:17:48.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20165 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340651+0000", 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340651+0000", 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340652+0000", 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340654+0000", 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2400000000000002e-06 2024-09-11T06:17:48.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340661+0000", 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7649999999999996e-06 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340666+0000", 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9150000000000004e-06 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352824+0000", 2024-09-11T06:17:48.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012158375000000001 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352890+0000", 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6495999999999995e-05 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352948+0000", 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7292e-05 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20166 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 94208~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340672+0000", 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785463145, 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012421587, 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20166 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.192 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340672+0000", 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340672+0000", 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340672+0000", 2024-09-11T06:17:48.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340674+0000", 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340679+0000", 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8810000000000004e-06 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340682+0000", 2024-09-11T06:17:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.352975+0000", 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012292875 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353021+0000", 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5559999999999997e-05 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353093+0000", 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2616999999999999e-05 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20167 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 131072~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.340702+0000", 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785432605, 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012550286000000001, 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20167 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340702+0000", 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340702+0000", 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340703+0000", 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.13e-07 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.340705+0000", 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.227e-06 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341075+0000", 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036938999999999999 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341081+0000", 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0340000000000002e-06 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353127+0000", 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012046693000000001 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353177+0000", 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9366000000000001e-05 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353253+0000", 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5963000000000004e-05 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20168 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 167936~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.341092+0000", 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785043339, 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01250046, 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20168 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.201 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341092+0000", 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341092+0000", 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341092+0000", 2024-09-11T06:17:48.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341095+0000", 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5790000000000002e-06 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341100+0000", 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-06 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341105+0000", 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2619999999999998e-06 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353301+0000", 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01219571 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353381+0000", 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0272000000000007e-05 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353592+0000", 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021111900000000001 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20169 3.17 3:e87ba507:::rbd_data.116d3c8aaf0c.00000000000000b8:b [read 204800~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.341115+0000", 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.785019741999999, 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01277345, 2024-09-11T06:17:48.205 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20169 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341115+0000", 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341115+0000", 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341116+0000", 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341118+0000", 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4169999999999999e-06 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341124+0000", 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.212e-06 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341129+0000", 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5530000000000003e-06 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353634+0000", 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01250502 2024-09-11T06:17:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353696+0000", 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1583999999999999e-05 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353889+0000", 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019313300000000001 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20206 3.17 3:ebdbc98c:::rbd_data.116d3c8aaf0c.00000000000000c5:b [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.341136+0000", 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.784999315, 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012954894, 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20206 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341136+0000", 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341136+0000", 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341136+0000", 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341138+0000", 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9350000000000001e-06 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341145+0000", 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2069999999999998e-06 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341150+0000", 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7219999999999999e-06 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353906+0000", 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012755907 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.353951+0000", 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5108000000000002e-05 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.354091+0000", 2024-09-11T06:17:48.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013967499999999999 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:20207 3.17 3:ebdbc98c:::rbd_data.116d3c8aaf0c.00000000000000c5:b [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.341156+0000", 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.78497864, 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013268614999999999, 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 20207 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341156+0000", 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341156+0000", 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341157+0000", 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341159+0000", 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0990000000000001e-06 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341165+0000", 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6779999999999997e-06 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.341170+0000", 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0080000000000002e-06 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.354127+0000", 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012957237 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.354217+0000", 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9801000000000003e-05 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.354425+0000", 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000208424 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.218 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:24486 3.17 3:ea59ddd0:::rbd_data.116d3246af40.0000000000000004:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:38.536234+0000", 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.5899010320000002, 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025473716, 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.219 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 24486 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536234+0000", 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536234+0000", 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536235+0000", 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536238+0000", 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2760000000000001e-06 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536246+0000", 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2430000000000005e-06 2024-09-11T06:17:48.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536251+0000", 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0470000000000001e-06 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536290+0000", 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8940999999999999e-05 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.536341+0000", 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1127e-05 2024-09-11T06:17:48.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.541397+0000", 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0050559280000000003 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.561520+0000", 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020122635 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.561572+0000", 2024-09-11T06:17:48.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2479999999999999e-05 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.561635+0000", 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2257999999999999e-05 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.561708+0000", 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3054999999999998e-05 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:24708 3.18 3:18290694:::rbd_data.116d3246af40.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:38.820560+0000", 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3055754010000005, 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.022295333000000001, 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.225 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 24708 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820560+0000", 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820560+0000", 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820561+0000", 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1799999999999999e-06 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820566+0000", 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2159999999999997e-06 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820579+0000", 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3393999999999999e-05 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820588+0000", 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820642+0000", 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4033000000000003e-05 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.820731+0000", 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8765999999999997e-05 2024-09-11T06:17:48.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.824240+0000", 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003508733 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.842714+0000", 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018474043999999998 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.842771+0000", 2024-09-11T06:17:48.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7537999999999997e-05 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.842815+0000", 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3742000000000002e-05 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:38.842855+0000", 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9839999999999998e-05 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.230 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.231 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:48.232 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:17:48.233 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:48.233 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:48.231+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:48.332 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:48.330+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:48.416 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:48.417 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:48.417 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:48.417 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:48.426 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:48.467 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:48.465+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:48.534 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:48.532+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:48.629 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:48.630 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:48.630 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:48.630 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:48.630 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:48.634 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:48.634+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:48.639 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:48.736 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:48.735+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25635977399999998, 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:48.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:17:48.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:17:48.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25634132500000001, 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:17:48.788 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:17:48.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25631052799999998, 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.796 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25629151999999999, 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.797 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:48.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.256272852, 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.801 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.805 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25625079299999998, 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.809 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25623192900000002, 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:48.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.813 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25621214799999997, 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:17:48.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.817 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25619322, 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.821 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25615273999999999, 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25612263099999999, 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:17:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25403143500000003, 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:17:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25395451400000002, 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:17:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25393021399999999, 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:17:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25389479500000001, 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:17:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:17:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25387759100000001, 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:17:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:17:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.253861328, 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:17:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25384435100000002, 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:17:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:17:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25382836600000003, 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:17:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25381039700000002, 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:17:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:17:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:48.866 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:48.868 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:48.868 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:48.866+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:48.968 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:48.967+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:48.974 INFO:teuthology.orchestra.run.smithi070.stdout:get_pg_num_history pg_num_history pg_num_history(e54 pg_nums {1={16=1},2={19=8},3={24=32}} deleted_pools ) 2024-09-11T06:17:48.974 INFO:teuthology.orchestra.run.smithi070.stdout:Importing pgid 3.1a 2024-09-11T06:17:48.979 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:595c52c6:::rbd_data.116df69fa911.0000000000000000:head# 2024-09-11T06:17:48.981 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:17:48.983 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:5cea7035:::rbd_info:head# 2024-09-11T06:17:48.983 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:17:48.984 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:5f063de2:::rbd_data.116d3c8aaf0c.000000000000000b:head# 2024-09-11T06:17:48.984 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:17:48.984 INFO:teuthology.orchestra.run.smithi070.stdout:write_pg epoch 54 info 3.1a( v 49'97 (0'0,49'97] local-lis/les=36/37 n=3 ec=24/24 lis/c=36/36 les/c/f=37/37/0 sis=36) 2024-09-11T06:17:48.988 INFO:teuthology.orchestra.run.smithi070.stdout:Import successful 2024-09-11T06:17:49.011 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:49.011 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:49.011 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:49.011 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:49.019 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:49.103 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:49.102+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:49.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:49.162 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:49.162 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:49.162 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:49.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:49.171 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:49.169+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:49.234 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:49.234 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:49.234 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:17:49.254 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:49.270 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:49.271 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:49.271 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:49.270+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:49.287 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:49.304 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0746515329999999, 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:17:49.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.320 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.074638795, 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0746276619999999, 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:17:49.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0746170740000001, 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:17:49.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.333 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0746065790000001, 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:17:49.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0745962659999999, 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:17:49.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:17:49.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:17:49.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0745857240000001, 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.074575418, 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.07455984, 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.350 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:17:49.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0745408350000001, 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:17:49.354 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0150114619999999, 2024-09-11T06:17:49.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:17:49.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:17:49.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.362 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.014992991, 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:17:49.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:17:49.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:17:49.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.366 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.014974501, 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.370 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.014957433, 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.371 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:17:49.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.014939402, 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.375 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:17:49.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:17:49.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:17:49.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0149172179999999, 2024-09-11T06:17:49.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:17:49.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.014899226, 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.384 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:17:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:17:49.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.014881572, 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.388 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:17:49.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:17:49.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0148586559999999, 2024-09-11T06:17:49.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:17:49.393 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.393 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.393 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.393 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.393 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:17:49.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:17:49.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.399 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.0148402679999999, 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:17:49.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.404 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:49.405 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:49.405 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:49.405 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:49.406 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:49.406 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:49.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:49.408 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:17:49.408 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:49.408 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:17:49.408 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-11T06:17:49.409 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:49.405+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:49.446 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.446 INFO:teuthology.orchestra.run.smithi070.stdout:1849 read 0x3c80b36 thru 0x3c8b7a1 (0xac6c bytes) 2024-09-11T06:17:49.447 INFO:teuthology.orchestra.run.smithi070.stdout:1850 punch from 0xbb5bee to 0xbb9f2c, (0x433e bytes) 2024-09-11T06:17:49.450 INFO:teuthology.orchestra.run.smithi070.stdout:1851 writesame 0xd011db1 thru 0xd018bac data_size 0x2(0x6dfc bytes) 2024-09-11T06:17:49.455 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.456 INFO:teuthology.orchestra.run.smithi070.stdout:1856 read 0x26e9e thru 0x28862 (0x19c5 bytes) 2024-09-11T06:17:49.456 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.456 INFO:teuthology.orchestra.run.smithi070.stdout:1859 punch from 0x4c87668 to 0x4c880d2, (0xa6a bytes) 2024-09-11T06:17:49.467 INFO:teuthology.orchestra.run.smithi070.stdout:1860 trunc from 0xe7d9bbe to 0x545fd9f 2024-09-11T06:17:49.492 INFO:teuthology.orchestra.run.smithi070.stdout:1861 write 0x416a9a9 thru 0x416f25f (0x48b7 bytes) 2024-09-11T06:17:49.493 INFO:teuthology.orchestra.run.smithi070.stdout:1863 writesame 0x1acc2b0 thru 0x1ad907c data_size 0x29(0xcdcd bytes) 2024-09-11T06:17:49.495 INFO:teuthology.orchestra.run.smithi070.stdout:1864 punch from 0x505515 to 0x513f2e, (0xea19 bytes) 2024-09-11T06:17:49.495 INFO:teuthology.orchestra.run.smithi070.stdout:1865 read 0x27d09f2 thru 0x27da0f5 (0x9704 bytes) 2024-09-11T06:17:49.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:49.506+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:49.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /var/log/ceph/exp.3.1a.1 2024-09-11T06:17:49.512 INFO:teuthology.orchestra.run.smithi070.stdout:1866 write 0xee32acc thru 0xee37f69 (0x549e bytes) 2024-09-11T06:17:49.517 INFO:teuthology.orchestra.run.smithi070.stdout:1867 writesame 0xd420f0 thru 0xd47f72 data_size 0x5(0x5e83 bytes) 2024-09-11T06:17:49.519 INFO:teuthology.orchestra.run.smithi070.stdout:1868 read 0x754088d thru 0x7544c54 (0x43c8 bytes) 2024-09-11T06:17:49.519 INFO:teuthology.orchestra.run.smithi070.stdout:1869 read 0xc3b3f58 thru 0xc3be471 (0xa51a bytes) 2024-09-11T06:17:49.523 INFO:teuthology.orchestra.run.smithi070.stdout:1871 trunc from 0xee37f6a to 0xc603a1d 2024-09-11T06:17:49.533 INFO:teuthology.orchestra.run.smithi070.stdout:1872 punch from 0x3258f40 to 0x32683f4, (0xf4b4 bytes) 2024-09-11T06:17:49.533 INFO:teuthology.orchestra.run.smithi070.stdout:1873 write 0x5a4881a thru 0x5a4b198 (0x297f bytes) 2024-09-11T06:17:49.537 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.541 INFO:teuthology.orchestra.run.smithi070.stdout:1876 trunc from 0xc603a1d to 0x8ef87c4 2024-09-11T06:17:49.546 INFO:teuthology.orchestra.run.smithi070.stdout:1877 writesame 0x6c019b7 thru 0x6c0e9b9 data_size 0x2f(0xd003 bytes) 2024-09-11T06:17:49.552 INFO:teuthology.orchestra.run.smithi070.stdout:1878 read 0x85bb7aa thru 0x85c50e4 (0x993b bytes) 2024-09-11T06:17:49.552 INFO:teuthology.orchestra.run.smithi070.stdout:1879 write 0x1878009 thru 0x1885ab9 (0xdab1 bytes) 2024-09-11T06:17:49.554 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.560 INFO:teuthology.orchestra.run.smithi070.stdout:1883 trunc from 0x8ef87c4 to 0xdb56c34 2024-09-11T06:17:49.565 INFO:teuthology.orchestra.run.smithi070.stdout:1884 write 0x3dcc09d thru 0x3dcd4b8 (0x141c bytes) 2024-09-11T06:17:49.566 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.567 INFO:teuthology.orchestra.run.smithi070.stdout:1889 read 0x5790f3 thru 0x579df7 (0xd05 bytes) 2024-09-11T06:17:49.567 INFO:teuthology.orchestra.run.smithi070.stdout:1890 read 0x3516825 thru 0x351de15 (0x75f1 bytes) 2024-09-11T06:17:49.568 INFO:teuthology.orchestra.run.smithi070.stdout:1891 punch from 0x9f87d41 to 0x9f9541b, (0xd6da bytes) 2024-09-11T06:17:49.568 INFO:teuthology.orchestra.run.smithi070.stdout:1892 read 0x8e32460 thru 0x8e3c549 (0xa0ea bytes) 2024-09-11T06:17:49.568 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.568 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.568 INFO:teuthology.orchestra.run.smithi070.stdout:1895 punch from 0xaacaf35 to 0xaad67e6, (0xb8b1 bytes) 2024-09-11T06:17:49.569 INFO:teuthology.orchestra.run.smithi070.stdout:1896 trunc from 0xdb56c34 to 0xc624853 2024-09-11T06:17:49.570 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:49.571 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:49.575 INFO:teuthology.orchestra.run.smithi070.stdout:1899 punch from 0x1bf4801 to 0x1bf67be, (0x1fbd bytes) 2024-09-11T06:17:49.581 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:49.582 INFO:teuthology.orchestra.run.smithi070.stdout:1900 trunc from 0xc624853 to 0x7154074 2024-09-11T06:17:49.589 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.589 INFO:teuthology.orchestra.run.smithi070.stdout:1904 write 0x55aba8f thru 0x55adccf (0x2241 bytes) 2024-09-11T06:17:49.601 INFO:teuthology.orchestra.run.smithi070.stdout:1906 write 0xc579e49 thru 0xc57efda (0x5192 bytes) 2024-09-11T06:17:49.604 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.604 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.604 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.604 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:49.604 INFO:teuthology.orchestra.run.smithi070.stdout:1912 write 0x16d18e2 thru 0x16d38b8 (0x1fd7 bytes) 2024-09-11T06:17:49.605 INFO:teuthology.orchestra.run.smithi070.stdout:1915 read 0x79f6c04 thru 0x79f6d63 (0x160 bytes) 2024-09-11T06:17:49.605 INFO:teuthology.orchestra.run.smithi070.stdout:1919 write 0xd1ee4 thru 0xdd2df (0xb3fc bytes) 2024-09-11T06:17:49.607 INFO:teuthology.orchestra.run.smithi070.stdout:1924 write 0x2dbe9f0 thru 0x2dc379a (0x4dab bytes) 2024-09-11T06:17:49.608 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:49.607+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:49.608 INFO:teuthology.orchestra.run.smithi070.stdout:1926 read 0x38ac577 thru 0x38b116e (0x4bf8 bytes) 2024-09-11T06:17:49.609 INFO:teuthology.orchestra.run.smithi070.stdout:1927 writesame 0x3619650 thru 0x361c719 data_size 0x5(0x30ca bytes) 2024-09-11T06:17:49.611 INFO:teuthology.orchestra.run.smithi070.stdout:1928 read 0x6308eaf thru 0x6316198 (0xd2ea bytes) 2024-09-11T06:17:49.611 INFO:teuthology.orchestra.run.smithi070.stdout:1929 read 0x7827b13 thru 0x782ca20 (0x4f0e bytes) 2024-09-11T06:17:49.611 INFO:teuthology.orchestra.run.smithi070.stdout:1930 read 0x3d46c81 thru 0x3d5664a (0xf9ca bytes) 2024-09-11T06:17:49.620 INFO:teuthology.orchestra.run.smithi070.stdout:1932 trunc from 0xc57efdb to 0x5d5cf5b 2024-09-11T06:17:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:1933 read 0x177d857 thru 0x178cf47 (0xf6f1 bytes) 2024-09-11T06:17:49.638 INFO:teuthology.orchestra.run.smithi070.stdout:1934 trunc from 0x5d5cf5b to 0x13dd78a 2024-09-11T06:17:49.672 INFO:teuthology.orchestra.run.smithi070.stdout:1935 trunc from 0x13dd78a to 0xc943fea 2024-09-11T06:17:49.677 INFO:teuthology.orchestra.run.smithi070.stdout:1938 read 0x87396b4 thru 0x8743068 (0x99b5 bytes) 2024-09-11T06:17:49.677 INFO:teuthology.orchestra.run.smithi070.stdout:1939 punch from 0xa6a67f0 to 0xa6a8c08, (0x2418 bytes) 2024-09-11T06:17:49.687 INFO:teuthology.orchestra.run.smithi070.stdout:1940 trunc from 0xc943fea to 0x56a59fa 2024-09-11T06:17:49.697 INFO:teuthology.orchestra.run.smithi070.stdout:1941 trunc from 0x56a59fa to 0x1a52841 2024-09-11T06:17:49.708 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:49.708+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:49.709 INFO:teuthology.orchestra.run.smithi070.stdout:1942 punch from 0x15c1837 to 0x15cdfab, (0xc774 bytes) 2024-09-11T06:17:49.723 INFO:teuthology.orchestra.run.smithi070.stdout:1943 write 0x7ee8f29 thru 0x7ef39a2 (0xaa7a bytes) 2024-09-11T06:17:49.728 INFO:teuthology.orchestra.run.smithi070.stdout:1944 write 0x1718813 thru 0x171beef (0x36dd bytes) 2024-09-11T06:17:49.732 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:49.733 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:49.740 INFO:teuthology.orchestra.run.smithi070.stdout:1945 write 0xc36c365 thru 0xc374eb5 (0x8b51 bytes) 2024-09-11T06:17:49.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:49.745 INFO:teuthology.orchestra.run.smithi070.stdout:1946 write 0x1a7673f thru 0x1a7851e (0x1de0 bytes) 2024-09-11T06:17:49.747 INFO:teuthology.orchestra.run.smithi070.stdout:1947 read 0x553ca76 thru 0x553fcbf (0x324a bytes) 2024-09-11T06:17:49.747 INFO:teuthology.orchestra.run.smithi070.stdout:1950 read 0xb0ccfe1 thru 0xb0da3f4 (0xd414 bytes) 2024-09-11T06:17:49.747 INFO:teuthology.orchestra.run.smithi070.stdout:1951 punch from 0x6586e41 to 0x658966a, (0x2829 bytes) 2024-09-11T06:17:49.753 INFO:teuthology.orchestra.run.smithi070.stdout:1952 writesame 0xd6ea411 thru 0xd6ed4b1 data_size 0x1(0x30a1 bytes) 2024-09-11T06:17:49.753 INFO:teuthology.orchestra.run.smithi070.stdout:1953 punch from 0x653f157 to 0x653f4c6, (0x36f bytes) 2024-09-11T06:17:49.753 INFO:teuthology.orchestra.run.smithi070.stdout:1955 read 0xbcc4c35 thru 0xbcce034 (0x9400 bytes) 2024-09-11T06:17:49.763 INFO:teuthology.orchestra.run.smithi070.stdout:1956 trunc from 0xd6ed4b2 to 0x4d4db48 2024-09-11T06:17:49.774 INFO:teuthology.orchestra.run.smithi070.stdout:1958 trunc from 0x4d4db48 to 0x5a8ab25 2024-09-11T06:17:49.779 INFO:teuthology.orchestra.run.smithi070.stdout:1959 clone 10 order 22 su 16384 sc 8 2024-09-11T06:17:49.810 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:49.809+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:49.850 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:49.850 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:49.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:49.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:49.909+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:50.002 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:50.002 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:50.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:50.012 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:50.010+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:50.111 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:50.111+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:50.161 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:50.161 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:50.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:50.213 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:50.212+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:50.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:17:50.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:50.313+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:50.317 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:50.317 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:50.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:50.415 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:50.414+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:50.434 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:50.434 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:50.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:50.517 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:50.516+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:50.546 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:50.547 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:50.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:50.622 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:50.616+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:50.698 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:50.699 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:50.707 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:50.718 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:50.717+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:50.812 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:50.812 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:50.819 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:50.817+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:50.820 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:50.921 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:50.921+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:50.964 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:50.964 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:50.972 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:51.022 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:51.021+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:51.075 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:51.075 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:51.084 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:51.093 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:17:51.126 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:51.124+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:51.225 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:51.224+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:51.279 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:51.279 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:51.288 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:51.325 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:51.325+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:51.391 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:51.391 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:51.400 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:51.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:51.453 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:51.452+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:51.503 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:51.503 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:51.512 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:51.526 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:51.526+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:51.533 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:51.533 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:51.533 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:17:51.549 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:51.550 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:51.565 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:51.582 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:51.582 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:51.598 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:51.598 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:51.614 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:51.616 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:51.617 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:51.617 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:51.625 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:51.627 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:51.626+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:51.631 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:51.631 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:51.634 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:17:51.635 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:17:51.728 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:51.727+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:51.728 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:51.729 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:51.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:51.829 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:51.828+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:51.845 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3142290170000002, 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:51.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:17:51.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:17:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.850 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.314210568, 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:17:51.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:17:51.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3141797710000001, 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:17:51.855 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:51.859 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3141607629999998, 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:17:51.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:17:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.863 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3141420950000002, 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:17:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:17:51.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:17:51.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3141200359999998, 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.314101172, 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.872 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:17:51.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3140813910000002, 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:17:51.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.314062463, 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:17:51.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:17:51.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.883 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3140219829999999, 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.887 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3139918740000001, 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:51.891 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3119006779999998, 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:17:51.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:17:51.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.311823757, 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:17:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3117994570000002, 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:17:51.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3117640380000002, 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.311746834, 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:17:51.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.910 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.311730571, 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.311713594, 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.915 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3116976089999999, 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.919 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.3116796399999999, 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:51.923 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:51.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:51.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:51.927 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:51.928 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:51.930 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:51.929+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:52.031 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:52.030+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:52.032 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:52.032 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:52.032 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:52.032 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:52.040 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:52.132 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:52.131+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:52.142 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:52.143 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:52.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:52.232 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:52.231+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:52.258 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.017232151, 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:17:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:17:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0172194130000003, 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:17:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:17:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0172082800000002, 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:17:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:17:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0171976919999999, 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:17:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0171871970000002, 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0171768840000004, 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0171663420000003, 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:17:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0171560360000003, 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0171404580000001, 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:17:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0171214529999997, 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.95759208, 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.9575736089999998, 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:17:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:17:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.9575551190000002, 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.9575380510000002, 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:17:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:17:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:17:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.95752002, 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:17:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:17:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.9574978359999999, 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.324 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:17:52.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.9574798439999999, 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.329 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:17:52.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.9574621900000002, 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:17:52.333 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:17:52.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.337 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.957439274, 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:17:52.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.957420886, 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:52.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:17:52.345 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:52.346 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:52.346 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:52.347 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-11T06:17:52.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:52.346+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:52.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:52.448 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:52.447+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:52.479 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:52.479 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:52.479 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:52.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:52.549 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:52.548+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:52.595 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:1960 read 0x9ffbd4 thru 0xa08d42 (0x916f bytes) 2024-09-11T06:17:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:52.601 INFO:teuthology.orchestra.run.smithi070.stdout:1964 read 0x288a29c thru 0x2896f6b (0xccd0 bytes) 2024-09-11T06:17:52.602 INFO:teuthology.orchestra.run.smithi070.stdout:1967 write 0x542767 thru 0x54d2cd (0xab67 bytes) 2024-09-11T06:17:52.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:1968 read 0x395713e thru 0x395ac23 (0x3ae6 bytes) 2024-09-11T06:17:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:1970 read 0x2b9dff7 thru 0x2b9e889 (0x893 bytes) 2024-09-11T06:17:52.613 INFO:teuthology.orchestra.run.smithi070.stdout:1973 write 0x635ab6b thru 0x635d694 (0x2b2a bytes) 2024-09-11T06:17:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:1974 trunc from 0x635d695 to 0x1e73e69 2024-09-11T06:17:52.633 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:52.650 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:52.648+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:1976 writesame 0xc624f05 thru 0xc628580 data_size 0x16(0x367c bytes) 2024-09-11T06:17:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:1978 write 0x105dd20 thru 0x1067179 (0x945a bytes) 2024-09-11T06:17:52.653 INFO:teuthology.orchestra.run.smithi070.stdout:1984 clone 11 order 21 su 65536 sc 11 2024-09-11T06:17:52.718 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:52.718 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:52.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:52.718 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:52.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.03310579, 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:17:52.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:17:52.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.913109552000002, 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:17:52.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:17:52.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:17:52.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28798 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 1982464~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366507+0000", 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3500164059999999, 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018328509, 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28798 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366507+0000", 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366507+0000", 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366507+0000", 2024-09-11T06:17:52.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6699999999999999e-07 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366510+0000", 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366515+0000", 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6640000000000003e-06 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366520+0000", 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.384685+0000", 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018165434000000001 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.384754+0000", 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9049999999999998e-05 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.384836+0000", 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1491999999999998e-05 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28799 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 2310144~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366526+0000", 2024-09-11T06:17:52.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3499977369999998, 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018526939999999999, 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28799 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366526+0000", 2024-09-11T06:17:52.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366526+0000", 2024-09-11T06:17:52.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366526+0000", 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9900000000000001e-07 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366528+0000", 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0169999999999999e-06 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366535+0000", 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5830000000000003e-06 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366540+0000", 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8389999999999997e-06 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.384876+0000", 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018336623999999999 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.384954+0000", 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8267000000000001e-05 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385053+0000", 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8210999999999999e-05 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28800 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 2637824~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366546+0000", 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3499773629999998, 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018769213999999999, 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28800 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366546+0000", 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366546+0000", 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366547+0000", 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.65e-07 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366549+0000", 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9989999999999998e-06 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366556+0000", 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0160000000000003e-06 2024-09-11T06:17:52.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366560+0000", 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5249999999999999e-06 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385085+0000", 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018524718999999999 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385166+0000", 2024-09-11T06:17:52.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1155999999999993e-05 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385315+0000", 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014943399999999999 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28801 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366566+0000", 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3499572840000003, 2024-09-11T06:17:52.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019001971999999999, 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28801 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366566+0000", 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366566+0000", 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366567+0000", 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366573+0000", 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.981e-06 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366577+0000", 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5070000000000002e-06 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366581+0000", 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3939999999999998e-06 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385345+0000", 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018763561000000002 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385426+0000", 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0897999999999997e-05 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385568+0000", 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014224999999999999 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28802 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366588+0000", 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3499359599999998, 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019190258000000002, 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28802 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366588+0000", 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366588+0000", 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366588+0000", 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2500000000000001e-07 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366590+0000", 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0229999999999999e-06 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366596+0000", 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6200000000000004e-06 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366600+0000", 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385612+0000", 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019011996999999999 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385689+0000", 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6179000000000004e-05 2024-09-11T06:17:52.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385778+0000", 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9235999999999997e-05 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28803 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366606+0000", 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3499172919999998, 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019422635000000001, 2024-09-11T06:17:52.756 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28803 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366606+0000", 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366606+0000", 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366607+0000", 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.96e-07 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366609+0000", 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.012e-06 2024-09-11T06:17:52.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366615+0000", 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9370000000000001e-06 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366619+0000", 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4020000000000004e-06 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385819+0000", 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019200054000000001 2024-09-11T06:17:52.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.385881+0000", 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1754000000000005e-05 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.386029+0000", 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014808000000000001 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28804 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366625+0000", 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3498985130000003, 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019684187999999998, 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28804 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366625+0000", 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366625+0000", 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366625+0000", 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:17:52.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366628+0000", 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2929999999999999e-06 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366634+0000", 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1160000000000004e-06 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366638+0000", 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7049999999999998e-06 2024-09-11T06:17:52.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.386066+0000", 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019427632 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.386167+0000", 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010056399999999999 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.386309+0000", 2024-09-11T06:17:52.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014249900000000001 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28831 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.367184+0000", 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3493390979999997, 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385030000000001, 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28831 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.367184+0000", 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.367184+0000", 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.367185+0000", 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6500000000000008e-07 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.367190+0000", 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.367202+0000", 2024-09-11T06:17:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1967000000000001e-05 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.367210+0000", 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0339999999999997e-06 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.386341+0000", 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019130331 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.386433+0000", 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2083000000000006e-05 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.386569+0000", 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000136525 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28874 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 1015808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370059+0000", 2024-09-11T06:17:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3464648229999998, 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018204811000000001, 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28874 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370059+0000", 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370059+0000", 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370059+0000", 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370061+0000", 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2419999999999999e-06 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370069+0000", 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4789999999999999e-06 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370076+0000", 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999998e-06 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.387791+0000", 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017714619000000001 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388116+0000", 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000325428 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388263+0000", 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014753800000000001 2024-09-11T06:17:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28875 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 1343488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370084+0000", 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3464398400000004, 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018464139000000001, 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28875 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370084+0000", 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370084+0000", 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370084+0000", 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370086+0000", 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1940000000000001e-06 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370102+0000", 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5899000000000001e-05 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370108+0000", 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9290000000000003e-06 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388297+0000", 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018188607999999998 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388378+0000", 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1252000000000001e-05 2024-09-11T06:17:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388548+0000", 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016984500000000001 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28876 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 1671168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370116+0000", 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3464073340000002, 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01870374, 2024-09-11T06:17:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28876 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370116+0000", 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370116+0000", 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370117+0000", 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7000000000000005e-07 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370119+0000", 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7480000000000002e-06 2024-09-11T06:17:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370126+0000", 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8759999999999999e-06 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370132+0000", 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2630000000000003e-06 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388581+0000", 2024-09-11T06:17:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018449041999999999 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388671+0000", 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0385999999999998e-05 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388820+0000", 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014885500000000001 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28877 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 1998848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370138+0000", 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3463854639999999, 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018931160999999998, 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28877 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370138+0000", 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370138+0000", 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370138+0000", 2024-09-11T06:17:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0400000000000002e-07 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370141+0000", 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2230000000000001e-06 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370147+0000", 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.421e-06 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370152+0000", 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3700000000000003e-06 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388850+0000", 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018697864000000002 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.388940+0000", 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9413000000000006e-05 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389069+0000", 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012946600000000001 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28878 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 2326528~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370173+0000", 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3463502680000001, 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083592, 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28878 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370173+0000", 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370173+0000", 2024-09-11T06:17:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370174+0000", 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8699999999999995e-07 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370176+0000", 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5749999999999999e-06 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370184+0000", 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1690000000000003e-06 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370190+0000", 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2450000000000003e-06 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389101+0000", 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018911363 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389168+0000", 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6614999999999998e-05 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389257+0000", 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9037999999999997e-05 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28879 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 2654208~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370197+0000", 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3463263489999999, 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019314082999999999, 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28879 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370197+0000", 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370197+0000", 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370198+0000", 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6000000000000004e-07 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370200+0000", 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370206+0000", 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.63e-06 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370211+0000", 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7840000000000003e-06 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389289+0000", 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019077361000000001 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389374+0000", 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5042000000000003e-05 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389511+0000", 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013766900000000001 2024-09-11T06:17:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28880 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 2981888~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370218+0000", 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3463057530000002, 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019525003999999999, 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28880 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370218+0000", 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370218+0000", 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370218+0000", 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5999999999999999e-07 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370220+0000", 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.945e-06 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370227+0000", 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3670000000000002e-06 2024-09-11T06:17:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370231+0000", 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389543+0000", 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019311409000000002 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389622+0000", 2024-09-11T06:17:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9473000000000003e-05 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389743+0000", 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012050899999999999 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28881 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3309568~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370238+0000", 2024-09-11T06:17:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3462855219999996, 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019818312000000001, 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28881 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370238+0000", 2024-09-11T06:17:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370238+0000", 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370238+0000", 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370241+0000", 2024-09-11T06:17:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2709999999999999e-06 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370247+0000", 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4420000000000003e-06 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370252+0000", 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2889999999999997e-06 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389804+0000", 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019551931000000002 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.389915+0000", 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110284 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390056+0000", 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014175400000000001 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28882 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3637248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3462645909999997, 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020043653000000002, 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28882 2024-09-11T06:17:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000002e-07 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370273+0000", 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4075e-05 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370280+0000", 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.007e-06 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370286+0000", 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3380000000000004e-06 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390099+0000", 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019812923999999999 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390172+0000", 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3375999999999997e-05 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390303+0000", 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130512 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28883 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3462292510000005, 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020291813999999998, 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28883 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370295+0000", 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370297+0000", 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.21e-06 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370303+0000", 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4479999999999999e-06 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370309+0000", 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3040000000000004e-06 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390350+0000", 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020040842 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390438+0000", 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8446e-05 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390586+0000", 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014808399999999999 2024-09-11T06:17:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:52.814 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:52.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:52.816 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:52.814+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:52.915 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:52.915+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:52.959 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:52.960 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:52.960 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:52.960 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:52.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:53.016 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:53.015+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:53.110 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:53.110 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:53.110 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:53.110 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:53.110 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:53.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:17:53.117 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:53.116+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:53.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:53.218 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:53.218+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:53.271 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:53.271 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:53.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:53.271 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:53.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.271 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2271 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.011543252999999, 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012468982999999999, 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258004+0000", 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6419999999999999e-06 2024-09-11T06:17:53.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258011+0000", 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4599999999999997e-06 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258025+0000", 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3804e-05 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258033+0000", 2024-09-11T06:17:53.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4239999999999993e-06 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258089+0000", 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.588e-05 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258147+0000", 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000002e-05 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.260204+0000", 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020570269999999999 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270393+0000", 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010188657 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270403+0000", 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270437+0000", 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3373e-05 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270471+0000", 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4073999999999999e-05 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2403 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.827906351999999, 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018324528999999999, 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2403 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441640+0000", 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:17:53.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441646+0000", 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441656+0000", 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0257e-05 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441661+0000", 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0549999999999999e-06 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441710+0000", 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8446999999999999e-05 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441761+0000", 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1060999999999998e-05 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.444470+0000", 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027092539999999999 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459870+0000", 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015399629 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459881+0000", 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1382e-05 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459926+0000", 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4505000000000002e-05 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459963+0000", 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7759999999999998e-05 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28474 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2506752~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344366+0000", 2024-09-11T06:17:53.283 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9251788459999997, 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011081840000000001, 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28474 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344366+0000", 2024-09-11T06:17:53.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344366+0000", 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344367+0000", 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3799999999999998e-07 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344369+0000", 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8929999999999999e-06 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344376+0000", 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344381+0000", 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.729e-06 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355262+0000", 2024-09-11T06:17:53.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010881093 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355346+0000", 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3590000000000004e-05 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355448+0000", 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102495 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28475 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2834432~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9251565260000003, 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011213330000000001, 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28475 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6899999999999997e-07 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344391+0000", 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2050000000000001e-06 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344398+0000", 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3380000000000001e-06 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344403+0000", 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.882e-06 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355471+0000", 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011068056 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355528+0000", 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6821999999999999e-05 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355602+0000", 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4457999999999998e-05 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28476 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3162112~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9251365229999999, 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464858, 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28476 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3700000000000001e-07 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344411+0000", 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.052e-06 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344417+0000", 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344422+0000", 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7589999999999997e-06 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355649+0000", 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011227305999999999 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355742+0000", 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2974999999999997e-05 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355874+0000", 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013158000000000001 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28477 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3489792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9251171840000003, 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011629143999999999, 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28477 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344429+0000", 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.06e-07 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344445+0000", 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6001000000000001e-05 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344451+0000", 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9569999999999996e-06 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344456+0000", 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8350000000000003e-06 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355921+0000", 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464919 2024-09-11T06:17:53.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355991+0000", 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9424000000000005e-05 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356057+0000", 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6501999999999994e-05 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28478 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3817472~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9250812269999997, 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011937405, 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28478 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000003e-07 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344467+0000", 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344473+0000", 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344478+0000", 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8720000000000001e-06 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356268+0000", 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011790629 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356317+0000", 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8594999999999998e-05 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356401+0000", 2024-09-11T06:17:53.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4469999999999996e-05 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28479 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4145152~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9250610269999999, 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012172307, 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28479 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:17:53.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344485+0000", 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344486+0000", 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.894e-06 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344493+0000", 2024-09-11T06:17:53.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344497+0000", 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.464e-06 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356440+0000", 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011942790999999999 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356532+0000", 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2093000000000001e-05 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356656+0000", 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012460800000000001 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28824 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3129344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9033855710000003, 2024-09-11T06:17:53.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011315202, 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28824 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366162+0000", 2024-09-11T06:17:53.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8360000000000001e-06 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366167+0000", 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366172+0000", 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377208+0000", 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011035872 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377326+0000", 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118474 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377475+0000", 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148675 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28825 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3342336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9033676599999998, 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011577013000000001, 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28825 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.314 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:17:53.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366180+0000", 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7880000000000001e-06 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366185+0000", 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7309999999999998e-06 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366190+0000", 2024-09-11T06:17:53.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377508+0000", 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011317763 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377595+0000", 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6674000000000004e-05 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377755+0000", 2024-09-11T06:17:53.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015964899999999999 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28826 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3457024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9033489000000001, 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011917782, 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28826 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366197+0000", 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-07 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366233+0000", 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6746999999999999e-05 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366283+0000", 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9579000000000001e-05 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366289+0000", 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8799999999999996e-06 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377787+0000", 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011498058 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378003+0000", 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215553 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378114+0000", 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111576 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28827 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3670016~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9032460479999997, 2024-09-11T06:17:53.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012035376, 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28827 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366300+0000", 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000004e-07 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366307+0000", 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5850000000000002e-06 2024-09-11T06:17:53.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366315+0000", 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4290000000000004e-06 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366319+0000", 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6310000000000002e-06 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378147+0000", 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011827725000000001 2024-09-11T06:17:53.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378228+0000", 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1207999999999999e-05 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378335+0000", 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010620699999999999 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.326 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28828 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3784704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9032189089999996, 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012221928999999999, 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28828 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366327+0000", 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:17:53.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366359+0000", 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2202000000000001e-05 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366415+0000", 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5828000000000001e-05 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366425+0000", 2024-09-11T06:17:53.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0176e-05 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378366+0000", 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011941139 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378446+0000", 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0144999999999999e-05 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378548+0000", 2024-09-11T06:17:53.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010201599999999999 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28829 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3997696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9031098289999999, 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012320490999999999, 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28829 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:17:53.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366436+0000", 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2200000000000003e-07 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366439+0000", 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366446+0000", 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9580000000000001e-06 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366451+0000", 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378579+0000", 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012127816 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378660+0000", 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1391999999999996e-05 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378756+0000", 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5610000000000001e-05 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28830 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4112384~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.335 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9030861860000003, 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012505113, 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28830 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366461+0000", 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0159999999999998e-06 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366467+0000", 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7679999999999997e-06 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366472+0000", 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378786+0000", 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012313783 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378863+0000", 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7307999999999999e-05 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378964+0000", 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101242 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28832 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9014906490000003, 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011082763000000001, 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28832 2024-09-11T06:17:53.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368056+0000", 2024-09-11T06:17:53.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6500000000000008e-07 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368060+0000", 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3800000000000004e-06 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368069+0000", 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0280000000000006e-06 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368076+0000", 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0690000000000004e-06 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378995+0000", 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010918638 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379071+0000", 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379137+0000", 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6068000000000005e-05 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28892 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.8990645590000002, 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011111242, 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28892 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6699999999999999e-07 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370483+0000", 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7320000000000001e-06 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370609+0000", 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012621900000000001 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370907+0000", 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029802600000000001 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381393+0000", 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010486430999999999 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381481+0000", 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7565999999999995e-05 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381592+0000", 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110901 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28895 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3686400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:17:53.348 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.8985045419999995, 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011282359, 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28895 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:17:53.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4799999999999999e-07 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371047+0000", 2024-09-11T06:17:53.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371055+0000", 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6149999999999999e-06 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371060+0000", 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.853e-06 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382125+0000", 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011064978 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382209+0000", 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3665000000000006e-05 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382323+0000", 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001145 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28896 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4014080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.8984779869999997, 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011490497000000001, 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28896 2024-09-11T06:17:53.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371068+0000", 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371070+0000", 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.091e-06 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371076+0000", 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4389999999999997e-06 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371080+0000", 2024-09-11T06:17:53.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2350000000000001e-06 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382360+0000", 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011279811000000001 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382447+0000", 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7306999999999996e-05 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382558+0000", 2024-09-11T06:17:53.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110216 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:33858 3.1 e66/24 3:813e6a9a:::rbd_header.116de94696bd:head v 66'309, mlcod=65'307)", 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.0524326289999999, 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.031257166000000003, 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7700000000000001e-07 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217117+0000", 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247505+0000", 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030387882000000001 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247521+0000", 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5610000000000001e-05 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247591+0000", 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0219e-05 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247617+0000", 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6393999999999998e-05 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248310+0000", 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000693094 2024-09-11T06:17:53.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248370+0000", 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9338e-05 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.361 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:53.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:53.363 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:53.361+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:53.464 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:53.462+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:53.506 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:53.506 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:53.506 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:53.506 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:53.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:53.563 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:53.563+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:53.617 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:53.617 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:53.617 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:53.617 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:53.617 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:53.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:53.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:53.666 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:53.665+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:53.766 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:53.765+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:53.774 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:53.774 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:53.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:53.774 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:53.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.153229803000002, 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:17:53.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:17:53.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:17:53.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.858794224999997, 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:17:53.781 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:17:53.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:17:53.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16822 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 163840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584881336999999, 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038088416999999999, 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16822 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:53.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187980+0000", 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187987+0000", 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0809999999999999e-06 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187991+0000", 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2420000000000002e-06 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225884+0000", 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037893139999999999 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225957+0000", 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3306000000000006e-05 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226066+0000", 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109103 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16823 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584862616999999, 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038574642999999999, 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16823 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:53.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187999+0000", 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.12e-06 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188005+0000", 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188010+0000", 2024-09-11T06:17:53.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-06 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226107+0000", 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03809676 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226463+0000", 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035599299999999998 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226571+0000", 2024-09-11T06:17:53.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108725 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16824 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584843888999998, 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039232345000000002, 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16824 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188016+0000", 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188018+0000", 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.933e-06 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188024+0000", 2024-09-11T06:17:53.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2310000000000001e-06 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188038+0000", 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3837e-05 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226631+0000", 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038593589999999997 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226743+0000", 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111192 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227248+0000", 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050521599999999996 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16915 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:53.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584372342999998, 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038728892000000001, 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16915 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188489+0000", 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9190000000000002e-06 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188495+0000", 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6930000000000004e-06 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188505+0000", 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0203999999999999e-05 2024-09-11T06:17:53.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226603+0000", 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038097497000000001 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226680+0000", 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7115999999999998e-05 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227216+0000", 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000536123 2024-09-11T06:17:53.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16916 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584343873999998, 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03972564, 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16916 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188516+0000", 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188518+0000", 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.058e-06 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188524+0000", 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.015e-06 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188528+0000", 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739999999999999e-06 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227244+0000", 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038716172 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227328+0000", 2024-09-11T06:17:53.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3120000000000004e-05 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228241+0000", 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091343800000000003 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16917 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584324915, 2024-09-11T06:17:53.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039912402999999999, 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16917 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:53.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188535+0000", 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-07 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188539+0000", 2024-09-11T06:17:53.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8940000000000003e-06 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188544+0000", 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6250000000000004e-06 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188553+0000", 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2359999999999993e-06 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228275+0000", 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039721226999999998 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228354+0000", 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370999999999996e-05 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228447+0000", 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2692e-05 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16918 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584299736999998, 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040097763000000002, 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16918 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2e-07 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188562+0000", 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188568+0000", 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1419999999999998e-06 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188573+0000", 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6940000000000003e-06 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228491+0000", 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039918355000000003 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228564+0000", 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2621999999999997e-05 2024-09-11T06:17:53.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228657+0000", 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517000000000006e-05 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16919 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584280907, 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040276407, 2024-09-11T06:17:53.817 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16919 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188579+0000", 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188581+0000", 2024-09-11T06:17:53.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188586+0000", 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8409999999999996e-06 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188601+0000", 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4545999999999999e-05 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228687+0000", 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040086418999999998 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228761+0000", 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3761000000000001e-05 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228855+0000", 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3628000000000005e-05 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16920 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584251074000001, 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040512056999999997, 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16920 2024-09-11T06:17:53.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188609+0000", 2024-09-11T06:17:53.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999996e-07 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188611+0000", 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.176e-06 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188618+0000", 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4769999999999997e-06 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188623+0000", 2024-09-11T06:17:53.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8060000000000002e-06 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228884+0000", 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040261107999999997 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228959+0000", 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5100999999999998e-05 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229120+0000", 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016078500000000001 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16927 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584143910999998, 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040618147, 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16927 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188716+0000", 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188717+0000", 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.283e-06 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188721+0000", 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9020000000000001e-06 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188723+0000", 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5950000000000001e-06 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229151+0000", 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040427053999999997 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229230+0000", 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9467000000000003e-05 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229334+0000", 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010351799999999999 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16928 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584132920000002, 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040816636000000003, 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16928 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188727+0000", 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188728+0000", 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0690000000000001e-06 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188731+0000", 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.982e-06 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188733+0000", 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.458e-06 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229364+0000", 2024-09-11T06:17:53.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040631035000000003 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229445+0000", 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0925000000000002e-05 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229543+0000", 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7956999999999997e-05 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16929 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584123161000001, 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041025210999999999, 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16929 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:17:53.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188737+0000", 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0380000000000001e-06 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188740+0000", 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188744+0000", 2024-09-11T06:17:53.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229575+0000", 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040831329 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229656+0000", 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0924e-05 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229761+0000", 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105171 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16930 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.584109498, 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041241585999999997, 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16930 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:53.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188752+0000", 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188758+0000", 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188762+0000", 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229808+0000", 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041046760000000002 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229854+0000", 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5365999999999999e-05 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229991+0000", 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013750200000000001 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27145 3.1d 3:bfb304f8:::rbd_data.116d770b822.0000000000000001:13 [read 5292032~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.843 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.240275+0000", 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5325841340000004, 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038166796000000003, 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27145 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240275+0000", 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240275+0000", 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240907+0000", 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00063139100000000003 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240911+0000", 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7729999999999999e-06 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240920+0000", 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9299999999999992e-06 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240927+0000", 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.278339+0000", 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037412051000000002 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.278382+0000", 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3371000000000002e-05 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.278442+0000", 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9444999999999998e-05 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.847 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27166 3.1d 3:b81da1e4:::rbd_data.116d770b822.0000000000000003:13 [read 999424~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.241009+0000", 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5318504820000003, 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038187825000000002, 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27166 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241009+0000", 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241009+0000", 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241009+0000", 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241011+0000", 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0140000000000001e-06 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241017+0000", 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0739999999999998e-06 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241022+0000", 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.87e-06 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279079+0000", 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038056517999999998 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279142+0000", 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2886999999999996e-05 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279197+0000", 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5067e-05 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27167 3.1d 3:b81da1e4:::rbd_data.116d770b822.0000000000000003:13 [read 1327104~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.241028+0000", 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5318314900000001, 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038322044999999999, 2024-09-11T06:17:53.852 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27167 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241028+0000", 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241028+0000", 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241028+0000", 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241030+0000", 2024-09-11T06:17:53.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241036+0000", 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3900000000000001e-06 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241040+0000", 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6290000000000001e-06 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279239+0000", 2024-09-11T06:17:53.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0381991 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279288+0000", 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8408000000000001e-05 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279350+0000", 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1966999999999998e-05 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27168 3.1d 3:b81da1e4:::rbd_data.116d770b822.0000000000000003:13 [read 1654784~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.241046+0000", 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5318132279999999, 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038409984000000001, 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27168 2024-09-11T06:17:53.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241046+0000", 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241046+0000", 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241046+0000", 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-07 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241048+0000", 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9740000000000001e-06 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241054+0000", 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6010000000000002e-06 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241059+0000", 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5299999999999998e-06 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279364+0000", 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038305937999999998 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279404+0000", 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9771999999999998e-05 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279456+0000", 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1811000000000003e-05 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27169 3.1d 3:b81da1e4:::rbd_data.116d770b822.0000000000000003:13 [read 1982464~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.241071+0000", 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5317884949999998, 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038518973999999997, 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:53.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27169 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241071+0000", 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241071+0000", 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:53.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.242906+0000", 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018353460000000001 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.242912+0000", 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9399999999999999e-06 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.242923+0000", 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.242931+0000", 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0139999999999998e-06 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279491+0000", 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036560702 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279534+0000", 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2734000000000001e-05 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:53.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279590+0000", 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5658999999999997e-05 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:53.865 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:53.866 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:53.867 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:53.867 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:53.867 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:17:53.867 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:53.868 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:53.868 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:53.868 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:53.868 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:53.869 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:53.869 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:53.869 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:53.872 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:53.873 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:53.873 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:53.872+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:53.889 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:53.889 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:53.892 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:17:53.893 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:17:53.971 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:53.970+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:53.984 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:53.984 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:53.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:54.072 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:54.071+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:54.096 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:54.097 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:54.105 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:54.172 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:54.172+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:54.208 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:54.208 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:54.217 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:54.220 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:17:54.278 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:54.277+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:54.356 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:54.357 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:54.370 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:54.413 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:54.412+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:54.476 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:54.474+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:54.484 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:54.484 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:54.493 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:54.546 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-11T06:17:54.546 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:17:54.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:17:54.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:54.575+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:54.635 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:54.636 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:54.644 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:54.686 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:54.684+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:54.778 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:54.778+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:54.788 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:54.788 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:54.797 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:54.823 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:17:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:17:54.835 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-09-11T06:17:54.425180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":310258597,"num_objects":286,"num_object_clones":0,"num_object_copies":572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":57,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":34578,"num_read_kb":168523,"num_write":7350,"num_write_kb":151224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":788072,"num_keys_recovered":9,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4523,"ondisk_log_size":4523,"up":74,"acting":74,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294580,"kb_used_data":24140,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754680140,"statfs":{"total":773094113280,"available":772792463360,"internally_reserved":0,"allocated":24719360,"data_stored":130130175,"data_compressed":3897443,"data_compressed_allocated":12435456,"data_compressed_original":122295298,"omap_allocated":12750,"internal_metadata":276614706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":61816795,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":7209,"num_read_kb":92073,"num_write":1839,"num_write_kb":91387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000809"},"pg_stats":[{"pgid":"3.1f","version":"65'133","reported_seq":1128,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-11T06:17:52.322223+0000","last_change":"2024-09-11T06:17:43.185805+0000","last_active":"2024-09-11T06:17:52.322223+0000","last_peered":"2024-09-11T06:17:52.322223+0000","last_clean":"2024-09-11T06:17:41.206792+0000","last_became_active":"2024-09-11T06:17:43.185805+0000","last_became_peered":"2024-09-11T06:17:43.185805+0000","last_unstale":"2024-09-11T06:17:52.322223+0000","last_undegraded":"2024-09-11T06:17:43.184727+0000","last_fullsized":"2024-09-11T06:17:43.184644+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:23.297921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077884500000000001,"stat_sum":{"num_bytes":31368493,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":10,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1065,"num_read_kb":4185,"num_write":223,"num_write_kb":8951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":10}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"1"}]},{"pgid":"3.1e","version":"63'84","reported_seq":792,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.322392+0000","last_change":"2024-09-11T06:17:52.322553+0000","last_active":"2024-09-11T06:17:52.322392+0000","last_peered":"2024-09-11T06:17:52.322392+0000","last_clean":"2024-09-11T06:17:52.322392+0000","last_became_active":"2024-09-11T06:17:09.686913+0000","last_became_peered":"2024-09-11T06:17:09.686913+0000","last_unstale":"2024-09-11T06:17:52.322392+0000","last_undegraded":"2024-09-11T06:17:52.322392+0000","last_fullsized":"2024-09-11T06:17:52.322392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:44.927232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039657800000000002,"stat_sum":{"num_bytes":1521414,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":784,"num_read_kb":1677,"num_write":136,"num_write_kb":1401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.1d","version":"63'277","reported_seq":1866,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.396027+0000","last_change":"2024-09-11T06:17:52.316441+0000","last_active":"2024-09-11T06:17:52.396027+0000","last_peered":"2024-09-11T06:17:52.396027+0000","last_clean":"2024-09-11T06:17:52.396027+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:17:52.396027+0000","last_undegraded":"2024-09-11T06:17:52.396027+0000","last_fullsized":"2024-09-11T06:17:52.396027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:22.002595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072448200000000003,"stat_sum":{"num_bytes":17849687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2556,"num_read_kb":18433,"num_write":523,"num_write_kb":4619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.1c","version":"64'76","reported_seq":902,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-11T06:17:52.213865+0000","last_change":"2024-09-11T06:17:43.185309+0000","last_active":"2024-09-11T06:17:52.213865+0000","last_peered":"2024-09-11T06:17:52.213865+0000","last_clean":"2024-09-11T06:17:39.176365+0000","last_became_active":"2024-09-11T06:17:43.185309+0000","last_became_peered":"2024-09-11T06:17:43.185309+0000","last_unstale":"2024-09-11T06:17:52.213865+0000","last_undegraded":"2024-09-11T06:17:43.184938+0000","last_fullsized":"2024-09-11T06:17:43.184818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:18:36.422254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051974300000000003,"stat_sum":{"num_bytes":22221095,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":701,"num_read_kb":6352,"num_write":149,"num_write_kb":3811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":7}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"65'228","reported_seq":971,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.214711+0000","last_change":"2024-09-11T06:17:52.214949+0000","last_active":"2024-09-11T06:17:52.214711+0000","last_peered":"2024-09-11T06:17:52.214711+0000","last_clean":"2024-09-11T06:17:52.214711+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:17:52.214711+0000","last_undegraded":"2024-09-11T06:17:52.214711+0000","last_fullsized":"2024-09-11T06:17:52.214711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:23.342806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073527499999999997,"stat_sum":{"num_bytes":8529690,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1318,"num_read_kb":4034,"num_write":386,"num_write_kb":6753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.1a","version":"63'115","reported_seq":1483,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-11T06:17:52.331333+0000","last_change":"2024-09-11T06:17:43.185299+0000","last_active":"2024-09-11T06:17:52.331333+0000","last_peered":"2024-09-11T06:17:52.331333+0000","last_clean":"2024-09-11T06:17:41.206555+0000","last_became_active":"2024-09-11T06:17:43.185299+0000","last_became_peered":"2024-09-11T06:17:43.185299+0000","last_unstale":"2024-09-11T06:17:52.331333+0000","last_undegraded":"2024-09-11T06:17:43.184658+0000","last_fullsized":"2024-09-11T06:17:43.184564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:39.998702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056498400000000004,"stat_sum":{"num_bytes":13047532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1353,"num_read_kb":10387,"num_write":156,"num_write_kb":4874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":6}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"1"}]},{"pgid":"3.19","version":"63'108","reported_seq":297,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-11T06:17:52.213879+0000","last_change":"2024-09-11T06:17:43.182964+0000","last_active":"2024-09-11T06:17:52.213879+0000","last_peered":"2024-09-11T06:17:52.213879+0000","last_clean":"2024-09-11T06:17:41.179730+0000","last_became_active":"2024-09-11T06:17:43.182964+0000","last_became_peered":"2024-09-11T06:17:43.182964+0000","last_unstale":"2024-09-11T06:17:52.213879+0000","last_undegraded":"2024-09-11T06:17:43.182572+0000","last_fullsized":"2024-09-11T06:17:43.182428+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:38.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001253482,"stat_sum":{"num_bytes":1572864,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":259,"num_read_kb":490,"num_write":186,"num_write_kb":2581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":2}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"10","length":"1"}]},{"pgid":"3.18","version":"63'632","reported_seq":1573,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.322609+0000","last_change":"2024-09-11T06:17:52.322776+0000","last_active":"2024-09-11T06:17:52.322609+0000","last_peered":"2024-09-11T06:17:52.322609+0000","last_clean":"2024-09-11T06:17:52.322609+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:17:52.322609+0000","last_undegraded":"2024-09-11T06:17:52.322609+0000","last_fullsized":"2024-09-11T06:17:52.322609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:21.023755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036817000000000002,"stat_sum":{"num_bytes":12714016,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3551,"num_read_kb":9154,"num_write":1087,"num_write_kb":7954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.17","version":"63'85","reported_seq":1140,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.322913+0000","last_change":"2024-09-11T06:17:52.322913+0000","last_active":"2024-09-11T06:17:52.322913+0000","last_peered":"2024-09-11T06:17:52.322913+0000","last_clean":"2024-09-11T06:17:52.322913+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:17:52.322913+0000","last_undegraded":"2024-09-11T06:17:52.322913+0000","last_fullsized":"2024-09-11T06:17:52.322913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:17:08.071206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038845200000000001,"stat_sum":{"num_bytes":12361143,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":888,"num_read_kb":9511,"num_write":158,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.16","version":"63'133","reported_seq":1403,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.247537+0000","last_change":"2024-09-11T06:17:52.247537+0000","last_active":"2024-09-11T06:17:52.247537+0000","last_peered":"2024-09-11T06:17:52.247537+0000","last_clean":"2024-09-11T06:17:52.247537+0000","last_became_active":"2024-09-11T06:17:09.686021+0000","last_became_peered":"2024-09-11T06:17:09.686021+0000","last_unstale":"2024-09-11T06:17:52.247537+0000","last_undegraded":"2024-09-11T06:17:52.247537+0000","last_fullsized":"2024-09-11T06:17:52.247537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:15.752831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015744750000000001,"stat_sum":{"num_bytes":11790820,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1498,"num_read_kb":9365,"num_write":182,"num_write_kb":4656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.15","version":"63'84","reported_seq":368,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.214419+0000","last_change":"2024-09-11T06:17:52.214637+0000","last_active":"2024-09-11T06:17:52.214419+0000","last_peered":"2024-09-11T06:17:52.214419+0000","last_clean":"2024-09-11T06:17:52.214419+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:17:52.214419+0000","last_undegraded":"2024-09-11T06:17:52.214419+0000","last_fullsized":"2024-09-11T06:17:52.214419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:50.046418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066634400000000003,"stat_sum":{"num_bytes":1709623,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":147,"num_read_kb":675,"num_write":129,"num_write_kb":2640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.14","version":"65'51","reported_seq":549,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.316181+0000","last_change":"2024-09-11T06:17:52.316370+0000","last_active":"2024-09-11T06:17:52.316181+0000","last_peered":"2024-09-11T06:17:52.316181+0000","last_clean":"2024-09-11T06:17:52.316181+0000","last_became_active":"2024-09-11T06:17:09.682654+0000","last_became_peered":"2024-09-11T06:17:09.682654+0000","last_unstale":"2024-09-11T06:17:52.316181+0000","last_undegraded":"2024-09-11T06:17:52.316181+0000","last_fullsized":"2024-09-11T06:17:52.316181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:34:51.957280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069683099999999997,"stat_sum":{"num_bytes":3883024,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":379,"num_read_kb":2732,"num_write":112,"num_write_kb":3715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.315537+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:17:52.315537+0000","last_peered":"2024-09-11T06:17:52.315537+0000","last_clean":"2024-09-11T06:17:52.315537+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:17:52.315537+0000","last_undegraded":"2024-09-11T06:17:52.315537+0000","last_fullsized":"2024-09-11T06:17:52.315537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"63'67","reported_seq":776,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.214472+0000","last_change":"2024-09-11T06:17:52.214654+0000","last_active":"2024-09-11T06:17:52.214472+0000","last_peered":"2024-09-11T06:17:52.214472+0000","last_clean":"2024-09-11T06:17:52.214472+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:17:52.214472+0000","last_undegraded":"2024-09-11T06:17:52.214472+0000","last_fullsized":"2024-09-11T06:17:52.214472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:09:41.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000439345,"stat_sum":{"num_bytes":5657436,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":542,"num_read_kb":4244,"num_write":172,"num_write_kb":6131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.213884+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:17:52.213884+0000","last_peered":"2024-09-11T06:17:52.213884+0000","last_clean":"2024-09-11T06:17:52.213884+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:17:52.213884+0000","last_undegraded":"2024-09-11T06:17:52.213884+0000","last_fullsized":"2024-09-11T06:17:52.213884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"63'59","reported_seq":604,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.214412+0000","last_change":"2024-09-11T06:17:52.214658+0000","last_active":"2024-09-11T06:17:52.214412+0000","last_peered":"2024-09-11T06:17:52.214412+0000","last_clean":"2024-09-11T06:17:52.214412+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:17:52.214412+0000","last_undegraded":"2024-09-11T06:17:52.214412+0000","last_fullsized":"2024-09-11T06:17:52.214412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:47.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067373800000000001,"stat_sum":{"num_bytes":1836238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":890,"num_write":97,"num_write_kb":2185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.315816+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:17:52.315816+0000","last_peered":"2024-09-11T06:17:52.315816+0000","last_clean":"2024-09-11T06:17:52.315816+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:17:52.315816+0000","last_undegraded":"2024-09-11T06:17:52.315816+0000","last_fullsized":"2024-09-11T06:17:52.315816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"65'80","reported_seq":1357,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T06:17:51.170647+0000","last_change":"2024-09-11T06:17:49.474696+0000","last_active":"2024-09-11T06:17:51.170647+0000","last_peered":"2024-09-11T06:17:51.170647+0000","last_clean":"2024-09-11T06:17:51.170647+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:17:51.170647+0000","last_undegraded":"2024-09-11T06:17:51.170647+0000","last_fullsized":"2024-09-11T06:17:51.170647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:15.481948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016300100000000001,"stat_sum":{"num_bytes":16526551,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1117,"num_read_kb":12178,"num_write":143,"num_write_kb":7904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.322081+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:17:52.322081+0000","last_peered":"2024-09-11T06:17:52.322081+0000","last_clean":"2024-09-11T06:17:52.322081+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:17:52.322081+0000","last_undegraded":"2024-09-11T06:17:52.322081+0000","last_fullsized":"2024-09-11T06:17:52.322081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"63'152","reported_seq":797,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.213573+0000","last_change":"2024-09-11T06:17:52.213877+0000","last_active":"2024-09-11T06:17:52.213573+0000","last_peered":"2024-09-11T06:17:52.213573+0000","last_clean":"2024-09-11T06:17:52.213573+0000","last_became_active":"2024-09-11T06:17:09.680887+0000","last_became_peered":"2024-09-11T06:17:09.680887+0000","last_unstale":"2024-09-11T06:17:52.213573+0000","last_undegraded":"2024-09-11T06:17:52.213573+0000","last_fullsized":"2024-09-11T06:17:52.213573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:33.937532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055407999999999998,"stat_sum":{"num_bytes":3985961,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":982,"num_read_kb":1811,"num_write":235,"num_write_kb":1951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.3","version":"63'261","reported_seq":1699,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.213909+0000","last_change":"2024-09-11T06:17:52.214493+0000","last_active":"2024-09-11T06:17:52.213909+0000","last_peered":"2024-09-11T06:17:52.213909+0000","last_clean":"2024-09-11T06:17:52.213909+0000","last_became_active":"2024-09-11T06:17:09.676881+0000","last_became_peered":"2024-09-11T06:17:09.676881+0000","last_unstale":"2024-09-11T06:17:52.213909+0000","last_undegraded":"2024-09-11T06:17:52.213909+0000","last_fullsized":"2024-09-11T06:17:52.213909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:36:55.517471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077665399999999999,"stat_sum":{"num_bytes":6534530,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3172,"num_read_kb":5642,"num_write":304,"num_write_kb":4067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":109,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.315309+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:17:52.315309+0000","last_peered":"2024-09-11T06:17:52.315309+0000","last_clean":"2024-09-11T06:17:52.315309+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:17:52.315309+0000","last_undegraded":"2024-09-11T06:17:52.315309+0000","last_fullsized":"2024-09-11T06:17:52.315309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"63'58","reported_seq":795,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.322683+0000","last_change":"2024-09-11T06:17:52.322683+0000","last_active":"2024-09-11T06:17:52.322683+0000","last_peered":"2024-09-11T06:17:52.322683+0000","last_clean":"2024-09-11T06:17:52.322683+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:17:52.322683+0000","last_undegraded":"2024-09-11T06:17:52.322683+0000","last_fullsized":"2024-09-11T06:17:52.322683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:41.490163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000544372,"stat_sum":{"num_bytes":4893154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":4377,"num_write":130,"num_write_kb":3501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T06:17:49.209237+0000","last_change":"2024-09-11T06:17:02.030301+0000","last_active":"2024-09-11T06:17:49.209237+0000","last_peered":"2024-09-11T06:17:49.209237+0000","last_clean":"2024-09-11T06:17:49.209237+0000","last_became_active":"2024-09-11T06:16:59.622610+0000","last_became_peered":"2024-09-11T06:16:59.622610+0000","last_unstale":"2024-09-11T06:17:49.209237+0000","last_undegraded":"2024-09-11T06:17:49.209237+0000","last_fullsized":"2024-09-11T06:17:49.209237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:38.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000348341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"65'308","reported_seq":798,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T06:17:51.282433+0000","last_change":"2024-09-11T06:17:49.473586+0000","last_active":"2024-09-11T06:17:51.282433+0000","last_peered":"2024-09-11T06:17:51.282433+0000","last_clean":"2024-09-11T06:17:51.282433+0000","last_became_active":"2024-09-11T06:17:09.679986+0000","last_became_peered":"2024-09-11T06:17:09.679986+0000","last_unstale":"2024-09-11T06:17:51.282433+0000","last_undegraded":"2024-09-11T06:17:51.282433+0000","last_fullsized":"2024-09-11T06:17:51.282433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:13.848098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069868600000000001,"stat_sum":{"num_bytes":6577609,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1619,"num_read_kb":3739,"num_write":566,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.315286+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:17:52.315286+0000","last_peered":"2024-09-11T06:17:52.315286+0000","last_clean":"2024-09-11T06:17:52.315286+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:17:52.315286+0000","last_undegraded":"2024-09-11T06:17:52.315286+0000","last_fullsized":"2024-09-11T06:17:52.315286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"63'138","reported_seq":484,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.214210+0000","last_change":"2024-09-11T06:17:52.214385+0000","last_active":"2024-09-11T06:17:52.214210+0000","last_peered":"2024-09-11T06:17:52.214210+0000","last_clean":"2024-09-11T06:17:52.214210+0000","last_became_active":"2024-09-11T06:17:09.675683+0000","last_became_peered":"2024-09-11T06:17:09.675683+0000","last_unstale":"2024-09-11T06:17:52.214210+0000","last_undegraded":"2024-09-11T06:17:52.214210+0000","last_fullsized":"2024-09-11T06:17:52.214210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:01.708993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046869899999999999,"stat_sum":{"num_bytes":1409040,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":694,"num_read_kb":1122,"num_write":276,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":108,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.315433+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:17:52.315433+0000","last_peered":"2024-09-11T06:17:52.315433+0000","last_clean":"2024-09-11T06:17:52.315433+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:17:52.315433+0000","last_undegraded":"2024-09-11T06:17:52.315433+0000","last_fullsized":"2024-09-11T06:17:52.315433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-11T06:17:52.322334+0000","last_change":"2024-09-11T06:17:43.185802+0000","last_active":"2024-09-11T06:17:52.322334+0000","last_peered":"2024-09-11T06:17:52.322334+0000","last_clean":"2024-09-11T06:16:54.693910+0000","last_became_active":"2024-09-11T06:17:43.185802+0000","last_became_peered":"2024-09-11T06:17:43.185802+0000","last_unstale":"2024-09-11T06:17:52.322334+0000","last_undegraded":"2024-09-11T06:17:43.184829+0000","last_fullsized":"2024-09-11T06:17:43.184779+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:12.389760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"66'163","reported_seq":1286,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.250777+0000","last_change":"2024-09-11T06:17:52.214360+0000","last_active":"2024-09-11T06:17:52.250777+0000","last_peered":"2024-09-11T06:17:52.250777+0000","last_clean":"2024-09-11T06:17:52.250777+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:17:52.250777+0000","last_undegraded":"2024-09-11T06:17:52.250777+0000","last_fullsized":"2024-09-11T06:17:52.250777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:20.384251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057092799999999995,"stat_sum":{"num_bytes":811312,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2145,"num_read_kb":2543,"num_write":206,"num_write_kb":1385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.9","version":"65'71","reported_seq":1298,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.316673+0000","last_change":"2024-09-11T06:17:52.316673+0000","last_active":"2024-09-11T06:17:52.316673+0000","last_peered":"2024-09-11T06:17:52.316673+0000","last_clean":"2024-09-11T06:17:52.316673+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:17:52.316673+0000","last_undegraded":"2024-09-11T06:17:52.316673+0000","last_fullsized":"2024-09-11T06:17:52.316673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:15.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693900000000002,"stat_sum":{"num_bytes":15229147,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1062,"num_read_kb":8766,"num_write":153,"num_write_kb":8337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.a","version":"63'85","reported_seq":346,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-11T06:17:52.315480+0000","last_change":"2024-09-11T06:17:43.184105+0000","last_active":"2024-09-11T06:17:52.315480+0000","last_peered":"2024-09-11T06:17:52.315480+0000","last_clean":"2024-09-11T06:17:41.174829+0000","last_became_active":"2024-09-11T06:17:43.184105+0000","last_became_peered":"2024-09-11T06:17:43.184105+0000","last_unstale":"2024-09-11T06:17:52.315480+0000","last_undegraded":"2024-09-11T06:17:43.183562+0000","last_fullsized":"2024-09-11T06:17:43.183471+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:06.782604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067788199999999999,"stat_sum":{"num_bytes":2064771,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":251,"num_read_kb":956,"num_write":132,"num_write_kb":2157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":5}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"1"}]},{"pgid":"3.b","version":"62'68","reported_seq":412,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T06:17:49.354285+0000","last_change":"2024-09-11T06:17:49.209716+0000","last_active":"2024-09-11T06:17:49.354285+0000","last_peered":"2024-09-11T06:17:49.354285+0000","last_clean":"2024-09-11T06:17:49.354285+0000","last_became_active":"2024-09-11T06:17:09.681406+0000","last_became_peered":"2024-09-11T06:17:09.681406+0000","last_unstale":"2024-09-11T06:17:49.354285+0000","last_undegraded":"2024-09-11T06:17:49.354285+0000","last_fullsized":"2024-09-11T06:17:49.354285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:05:32.484639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037379600000000002,"stat_sum":{"num_bytes":10946463,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":263,"num_read_kb":1281,"num_write":113,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"}]},{"pgid":"3.c","version":"63'170","reported_seq":845,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.214068+0000","last_change":"2024-09-11T06:17:52.214448+0000","last_active":"2024-09-11T06:17:52.214068+0000","last_peered":"2024-09-11T06:17:52.214068+0000","last_clean":"2024-09-11T06:17:52.214068+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:17:52.214068+0000","last_undegraded":"2024-09-11T06:17:52.214068+0000","last_fullsized":"2024-09-11T06:17:52.214068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:44.254729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048882299999999999,"stat_sum":{"num_bytes":6550526,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1057,"num_read_kb":4194,"num_write":228,"num_write_kb":2578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.d","version":"63'65","reported_seq":694,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-11T06:17:52.315573+0000","last_change":"2024-09-11T06:17:43.183775+0000","last_active":"2024-09-11T06:17:52.315573+0000","last_peered":"2024-09-11T06:17:52.315573+0000","last_clean":"2024-09-11T06:17:41.175113+0000","last_became_active":"2024-09-11T06:17:43.183775+0000","last_became_peered":"2024-09-11T06:17:43.183775+0000","last_unstale":"2024-09-11T06:17:52.315573+0000","last_undegraded":"2024-09-11T06:17:43.182948+0000","last_fullsized":"2024-09-11T06:17:43.182834+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:28.274618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078253299999999997,"stat_sum":{"num_bytes":7163000,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":472,"num_read_kb":3673,"num_write":118,"num_write_kb":3911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":8}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"1"}]},{"pgid":"3.e","version":"65'50","reported_seq":470,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.214456+0000","last_change":"2024-09-11T06:17:52.247538+0000","last_active":"2024-09-11T06:17:52.214456+0000","last_peered":"2024-09-11T06:17:52.214456+0000","last_clean":"2024-09-11T06:17:52.214456+0000","last_became_active":"2024-09-11T06:17:09.679886+0000","last_became_peered":"2024-09-11T06:17:09.679886+0000","last_unstale":"2024-09-11T06:17:52.214456+0000","last_undegraded":"2024-09-11T06:17:52.214456+0000","last_fullsized":"2024-09-11T06:17:52.214456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:58:02.457468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065748800000000002,"stat_sum":{"num_bytes":3935818,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":255,"num_read_kb":649,"num_write":72,"num_write_kb":4976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.f","version":"63'160","reported_seq":1626,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-11T06:17:49.209808+0000","last_change":"2024-09-11T06:17:49.209808+0000","last_active":"2024-09-11T06:17:49.209808+0000","last_peered":"2024-09-11T06:17:49.209808+0000","last_clean":"2024-09-11T06:17:49.209808+0000","last_became_active":"2024-09-11T06:17:30.780099+0000","last_became_peered":"2024-09-11T06:17:30.780099+0000","last_unstale":"2024-09-11T06:17:49.209808+0000","last_undegraded":"2024-09-11T06:17:49.209808+0000","last_fullsized":"2024-09-11T06:17:49.209808+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:36:38.643324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000381386,"stat_sum":{"num_bytes":18333934,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2312,"num_read_kb":13633,"num_write":200,"num_write_kb":2795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":16758,"num_keys_recovered":9,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"1"},{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"}]},{"pgid":"3.10","version":"65'137","reported_seq":1663,"reported_epoch":66,"state":"active+undersized+degraded","last_fresh":"2024-09-11T06:17:52.322219+0000","last_change":"2024-09-11T06:17:43.185032+0000","last_active":"2024-09-11T06:17:52.322219+0000","last_peered":"2024-09-11T06:17:52.322219+0000","last_clean":"2024-09-11T06:17:40.120533+0000","last_became_active":"2024-09-11T06:17:43.185032+0000","last_became_peered":"2024-09-11T06:17:43.185032+0000","last_unstale":"2024-09-11T06:17:52.322219+0000","last_undegraded":"2024-09-11T06:17:43.184589+0000","last_fullsized":"2024-09-11T06:17:43.184492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:31:20.114873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077247800000000005,"stat_sum":{"num_bytes":22944943,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1586,"num_read_kb":12257,"num_write":145,"num_write_kb":9956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":17}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"65'71","reported_seq":510,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.316004+0000","last_change":"2024-09-11T06:17:52.316150+0000","last_active":"2024-09-11T06:17:52.316004+0000","last_peered":"2024-09-11T06:17:52.316004+0000","last_clean":"2024-09-11T06:17:52.316004+0000","last_became_active":"2024-09-11T06:17:09.683890+0000","last_became_peered":"2024-09-11T06:17:09.683890+0000","last_unstale":"2024-09-11T06:17:52.316004+0000","last_undegraded":"2024-09-11T06:17:52.316004+0000","last_fullsized":"2024-09-11T06:17:52.316004+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:20:24.115571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063158699999999997,"stat_sum":{"num_bytes":11200577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":272,"num_read_kb":3504,"num_write":83,"num_write_kb":10973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.12","version":"63'77","reported_seq":426,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T06:17:51.098847+0000","last_change":"2024-09-11T06:17:49.473173+0000","last_active":"2024-09-11T06:17:51.098847+0000","last_peered":"2024-09-11T06:17:51.098847+0000","last_clean":"2024-09-11T06:17:51.098847+0000","last_became_active":"2024-09-11T06:17:37.166037+0000","last_became_peered":"2024-09-11T06:17:37.166037+0000","last_unstale":"2024-09-11T06:17:51.098847+0000","last_undegraded":"2024-09-11T06:17:51.098847+0000","last_fullsized":"2024-09-11T06:17:51.098847+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:27:42.051605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000414831,"stat_sum":{"num_bytes":4293177,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":150,"num_read_kb":1763,"num_write":146,"num_write_kb":3869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":771314,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"}]},{"pgid":"3.13","version":"64'157","reported_seq":1117,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-11T06:17:52.316122+0000","last_change":"2024-09-11T06:17:52.316122+0000","last_active":"2024-09-11T06:17:52.316122+0000","last_peered":"2024-09-11T06:17:52.316122+0000","last_clean":"2024-09-11T06:17:52.316122+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:17:52.316122+0000","last_undegraded":"2024-09-11T06:17:52.316122+0000","last_fullsized":"2024-09-11T06:17:52.316122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:41.582457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068271300000000005,"stat_sum":{"num_bytes":20204622,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1022,"num_read_kb":4206,"num_write":243,"num_write_kb":6024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"1"},{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":309668210,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":55,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":34462,"num_read_kb":168423,"num_write":7189,"num_write_kb":148806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":788072,"num_keys_recovered":9,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19488768,"data_stored":132779230,"data_compressed":4134333,"data_compressed_allocated":12976128,"data_compressed_original":127538178,"omap_allocated":0,"internal_metadata":0},"log_size":4403,"ondisk_log_size":4403,"up":57,"acting":57,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39236,"kb_used_data":3892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332604,"statfs":{"total":96636764160,"available":96596586496,"internally_reserved":0,"allocated":3985408,"data_stored":24854897,"data_compressed":820776,"data_compressed_allocated":2310144,"data_compressed_original":23766189,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":2564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":2625536,"data_stored":13514846,"data_compressed":497383,"data_compressed_allocated":1327104,"data_compressed_original":12747566,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39376,"kb_used_data":4028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332464,"statfs":{"total":96636764160,"available":96596443136,"internally_reserved":0,"allocated":4124672,"data_stored":23638579,"data_compressed":671677,"data_compressed_allocated":2105344,"data_compressed_original":22261654,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38884,"kb_used_data":3524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332956,"statfs":{"total":96636764160,"available":96596946944,"internally_reserved":0,"allocated":3608576,"data_stored":21001230,"data_compressed":631883,"data_compressed_allocated":1888256,"data_compressed_original":19893393,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1388544,"data_stored":3476400,"data_compressed":102930,"data_compressed_allocated":372736,"data_compressed_original":2861353,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38424,"kb_used_data":3072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333416,"statfs":{"total":96636764160,"available":96597417984,"internally_reserved":0,"allocated":3145728,"data_stored":16409834,"data_compressed":513690,"data_compressed_allocated":1548288,"data_compressed_original":15399458,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37960,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333880,"statfs":{"total":96636764160,"available":96597893120,"internally_reserved":0,"allocated":2555904,"data_stored":9885323,"data_compressed":362035,"data_compressed_allocated":970752,"data_compressed_original":8854938,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34404,"kb_used_data":3208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337436,"statfs":{"total":96636764160,"available":96601534464,"internally_reserved":0,"allocated":3284992,"data_stored":17349066,"data_compressed":297069,"data_compressed_allocated":1912832,"data_compressed_original":16510747,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2396160,"data_stored":16070516,"data_compressed":513690,"data_compressed_allocated":1548288,"data_compressed_original":15399458,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1118208,"data_stored":5630297,"data_compressed":231528,"data_compressed_allocated":638976,"data_compressed_original":5237033,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2859008,"data_stored":20661912,"data_compressed":631883,"data_compressed_allocated":1888256,"data_compressed_original":19893393,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3371008,"data_stored":23299242,"data_compressed":671677,"data_compressed_allocated":2105344,"data_compressed_original":22261654,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1875968,"data_stored":13175528,"data_compressed":497383,"data_compressed_allocated":1327104,"data_compressed_original":12747566,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3178496,"data_stored":23925211,"data_compressed":812107,"data_compressed_allocated":2273280,"data_compressed_original":23192749,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2129920,"data_stored":12994198,"data_compressed":478996,"data_compressed_allocated":1282048,"data_compressed_original":12295578,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2560000,"data_stored":17022326,"data_compressed":297069,"data_compressed_allocated":1912832,"data_compressed_original":16510747,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:17:54.880 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:54.878+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:54.900 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:54.900 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:54.909 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:54.981 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:54.980+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:55.052 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:55.052 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:55.060 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:55.104 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:55.102+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:55.162 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:55.163 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:55.171 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:55.184 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:55.183+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:55.284 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:55.283+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:55.315 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:55.316 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:55.324 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:55.357 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-11T06:17:55.386 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:55.385+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:55.433 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:55.433 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:55.442 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:55.480 INFO:teuthology.orchestra.run.smithi070.stdout:1987 trunc from 0xc628581 to 0x73d9e20 2024-09-11T06:17:55.486 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:55.485+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:55.490 INFO:teuthology.orchestra.run.smithi070.stdout:1988 punch from 0x20db944 to 0x20e1d31, (0x63ed bytes) 2024-09-11T06:17:55.490 INFO:teuthology.orchestra.run.smithi070.stdout:1989 punch from 0x2e78ece to 0x2e7c1a6, (0x32d8 bytes) 2024-09-11T06:17:55.493 INFO:teuthology.orchestra.run.smithi070.stdout:1990 trunc from 0x73d9e20 to 0x9cf7ace 2024-09-11T06:17:55.506 INFO:teuthology.orchestra.run.smithi070.stdout:1991 trunc from 0x9cf7ace to 0x371762c 2024-09-11T06:17:55.525 INFO:teuthology.orchestra.run.smithi070.stdout:1992 trunc from 0x371762c to 0xda63887 2024-09-11T06:17:55.531 INFO:teuthology.orchestra.run.smithi070.stdout:1993 punch from 0x715a0dc to 0x71658f9, (0xb81d bytes) 2024-09-11T06:17:55.531 INFO:teuthology.orchestra.run.smithi070.stdout:1994 punch from 0x379b93 to 0x37bb07, (0x1f74 bytes) 2024-09-11T06:17:55.532 INFO:teuthology.orchestra.run.smithi070.stdout:1995 trunc from 0xda63887 to 0xe950338 2024-09-11T06:17:55.538 INFO:teuthology.orchestra.run.smithi070.stdout:1996 write 0x60c2a24 thru 0x60cf394 (0xc971 bytes) 2024-09-11T06:17:55.541 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:55.541 INFO:teuthology.orchestra.run.smithi070.stdout:2000 writesame 0x3dc4f9b thru 0x3dc9ed9 data_size 0x1(0x4f3f bytes) 2024-09-11T06:17:55.554 INFO:teuthology.orchestra.run.smithi070.stdout:2001 write 0x4710b34 thru 0x471fc0f (0xf0dc bytes) 2024-09-11T06:17:55.557 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:55.557 INFO:teuthology.orchestra.run.smithi070.stdout:2003 write 0x4604e30 thru 0x460bfeb (0x71bc bytes) 2024-09-11T06:17:55.559 INFO:teuthology.orchestra.run.smithi070.stdout:2004 punch from 0x918c8b8 to 0x919784a, (0xaf92 bytes) 2024-09-11T06:17:55.560 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:55.560 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:55.563 INFO:teuthology.orchestra.run.smithi070.stdout:2008 trunc from 0xe950338 to 0xbf977a6 2024-09-11T06:17:55.568 INFO:teuthology.orchestra.run.smithi070.stdout:2010 write 0x7f8b148 thru 0x7f904eb (0x53a4 bytes) 2024-09-11T06:17:55.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:55.576 INFO:teuthology.orchestra.run.smithi070.stdout:2011 trunc from 0xbf977a6 to 0x9235195 2024-09-11T06:17:55.581 INFO:teuthology.orchestra.run.smithi070.stdout:2013 punch from 0x2ddf7a6 to 0x2deb68e, (0xbee8 bytes) 2024-09-11T06:17:55.583 INFO:teuthology.orchestra.run.smithi070.stdout:2015 trunc from 0x9235195 to 0xa2b43a1 2024-09-11T06:17:55.587 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:55.586+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:55.588 INFO:teuthology.orchestra.run.smithi070.stdout:2017 write 0x9184a71 thru 0x918bc94 (0x7224 bytes) 2024-09-11T06:17:55.591 INFO:teuthology.orchestra.run.smithi070.stdout:2018 read 0x2964a76 thru 0x29652b6 (0x841 bytes) 2024-09-11T06:17:55.592 INFO:teuthology.orchestra.run.smithi070.stdout:2019 punch from 0x7cbc1b7 to 0x7ccb405, (0xf24e bytes) 2024-09-11T06:17:55.592 INFO:teuthology.orchestra.run.smithi070.stdout:2020 read 0x2f18cc9 thru 0x2f258d5 (0xcc0d bytes) 2024-09-11T06:17:55.592 INFO:teuthology.orchestra.run.smithi070.stdout:2021 read 0x7ba919b thru 0x7bad566 (0x43cc bytes) 2024-09-11T06:17:55.592 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:55.593 INFO:teuthology.orchestra.run.smithi070.stdout:2025 punch from 0x2aa6360 to 0x2aafaf6, (0x9796 bytes) 2024-09-11T06:17:55.593 INFO:teuthology.orchestra.run.smithi070.stdout:2026 writesame 0x8623ecc thru 0x86309ed data_size 0x36(0xcb22 bytes) 2024-09-11T06:17:55.596 INFO:teuthology.orchestra.run.smithi070.stdout:2028 read 0x31f632b thru 0x3202db0 (0xca86 bytes) 2024-09-11T06:17:55.597 INFO:teuthology.orchestra.run.smithi070.stdout:2030 punch from 0x9891a42 to 0x989c74e, (0xad0c bytes) 2024-09-11T06:17:55.597 INFO:teuthology.orchestra.run.smithi070.stdout:2031 write 0x298b60d thru 0x2998b40 (0xd534 bytes) 2024-09-11T06:17:55.606 INFO:teuthology.orchestra.run.smithi070.stdout:2032 write 0xbd24605 thru 0xbd31132 (0xcb2e bytes) 2024-09-11T06:17:55.615 INFO:teuthology.orchestra.run.smithi070.stdout:2033 writesame 0xc7ad23d thru 0xc7b393e data_size 0x2d(0x6702 bytes) 2024-09-11T06:17:55.615 INFO:teuthology.orchestra.run.smithi070.stdout:2034 read 0xb92fdfe thru 0xb9353b6 (0x55b9 bytes) 2024-09-11T06:17:55.615 INFO:teuthology.orchestra.run.smithi070.stdout:2035 writesame 0x4b3d3bc thru 0x4b46778 data_size 0x7(0x93bd bytes) 2024-09-11T06:17:55.620 INFO:teuthology.orchestra.run.smithi070.stdout:2037 write 0x1f78b1 thru 0x1fd7d8 (0x5f28 bytes) 2024-09-11T06:17:55.621 INFO:teuthology.orchestra.run.smithi070.stdout:2039 write 0x160795f thru 0x160ed8e (0x7430 bytes) 2024-09-11T06:17:55.624 INFO:teuthology.orchestra.run.smithi070.stdout:2040 trunc from 0xc7b393f to 0xd9a3a7b 2024-09-11T06:17:55.630 INFO:teuthology.orchestra.run.smithi070.stdout:2041 writesame 0x6814ccb thru 0x6816972 data_size 0xe(0x1ca8 bytes) 2024-09-11T06:17:55.633 INFO:teuthology.orchestra.run.smithi070.stdout:2042 write 0x84ec7fb thru 0x84f0b2c (0x4332 bytes) 2024-09-11T06:17:55.637 INFO:teuthology.orchestra.run.smithi070.stdout:2043 writesame 0x83f04f5 thru 0x83f4d10 data_size 0x5(0x481c bytes) 2024-09-11T06:17:55.641 INFO:teuthology.orchestra.run.smithi070.stdout:2044 write 0xd4c5e32 thru 0xd4c82d6 (0x24a5 bytes) 2024-09-11T06:17:55.643 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:55.643 INFO:teuthology.orchestra.run.smithi070.stdout:2046 write 0x6839781 thru 0x68433e7 (0x9c67 bytes) 2024-09-11T06:17:55.647 INFO:teuthology.orchestra.run.smithi070.stdout:2047 read 0x71cd362 thru 0x71d7224 (0x9ec3 bytes) 2024-09-11T06:17:55.647 INFO:teuthology.orchestra.run.smithi070.stdout:2048 read 0xc98bc3 thru 0xca72d8 (0xe716 bytes) 2024-09-11T06:17:55.656 INFO:teuthology.orchestra.run.smithi070.stdout:2049 trunc from 0xd9a3a7b to 0x6a689af 2024-09-11T06:17:55.668 INFO:teuthology.orchestra.run.smithi070.stdout:2050 write 0x665a552 thru 0x665c326 (0x1dd5 bytes) 2024-09-11T06:17:55.678 INFO:teuthology.orchestra.run.smithi070.stdout:2051 trunc from 0x6a689af to 0xd004e13 2024-09-11T06:17:55.683 INFO:teuthology.orchestra.run.smithi070.stdout:2053 read 0xb37d4f4 thru 0xb38545c (0x7f69 bytes) 2024-09-11T06:17:55.683 INFO:teuthology.orchestra.run.smithi070.stdout:2054 writesame 0x89b3526 thru 0x89b46ca data_size 0x1(0x11a5 bytes) 2024-09-11T06:17:55.687 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:55.687 INFO:teuthology.orchestra.run.smithi070.stdout:2058 write 0xdf92a5 thru 0xe04ac7 (0xb823 bytes) 2024-09-11T06:17:55.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:55.686+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:55.688 INFO:teuthology.orchestra.run.smithi070.stdout:2059 writesame 0x8e0b9ad thru 0x8e1520f data_size 0x1(0x9863 bytes) 2024-09-11T06:17:55.696 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:55.696 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:55.701 INFO:teuthology.orchestra.run.smithi070.stdout:2060 punch from 0x4542c08 to 0x45500d4, (0xd4cc bytes) 2024-09-11T06:17:55.701 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:55.701 INFO:teuthology.orchestra.run.smithi070.stdout:2062 read 0x93711e8 thru 0x9376092 (0x4eab bytes) 2024-09-11T06:17:55.701 INFO:teuthology.orchestra.run.smithi070.stdout:2064 punch from 0x3d3ef56 to 0x3d40956, (0x1a00 bytes) 2024-09-11T06:17:55.701 INFO:teuthology.orchestra.run.smithi070.stdout:2066 punch from 0xc6104e8 to 0xc61bf2b, (0xba43 bytes) 2024-09-11T06:17:55.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:55.708 INFO:teuthology.orchestra.run.smithi070.stdout:2067 write 0xead58b7 thru 0xeadc796 (0x6ee0 bytes) 2024-09-11T06:17:55.711 INFO:teuthology.orchestra.run.smithi070.stdout:2068 read 0x45df7c thru 0x468b93 (0xac18 bytes) 2024-09-11T06:17:55.719 INFO:teuthology.orchestra.run.smithi070.stdout:2071 trunc from 0xeadc797 to 0x80ab109 2024-09-11T06:17:55.742 INFO:teuthology.orchestra.run.smithi070.stdout:2072 writesame 0xea470d1 thru 0xea49d1d data_size 0x1(0x2c4d bytes) 2024-09-11T06:17:55.743 INFO:teuthology.orchestra.run.smithi070.stdout:2073 writesame 0xb99ef20 thru 0xb9a3386 data_size 0xd(0x4467 bytes) 2024-09-11T06:17:55.746 INFO:teuthology.orchestra.run.smithi070.stdout:2075 write 0xaa84e8a thru 0xaa8c787 (0x78fe bytes) 2024-09-11T06:17:55.749 INFO:teuthology.orchestra.run.smithi070.stdout:2078 write 0x2aebfc1 thru 0x2aef8c3 (0x3903 bytes) 2024-09-11T06:17:55.750 INFO:teuthology.orchestra.run.smithi070.stdout:2079 write 0xdff696a thru 0xdff93e3 (0x2a7a bytes) 2024-09-11T06:17:55.753 INFO:teuthology.orchestra.run.smithi070.stdout:2080 punch from 0xbf46f7a to 0xbf4fce2, (0x8d68 bytes) 2024-09-11T06:17:55.759 INFO:teuthology.orchestra.run.smithi070.stdout:2081 trunc from 0xea49d1e to 0x8f64d0d 2024-09-11T06:17:55.779 INFO:teuthology.orchestra.run.smithi070.stdout:2082 write 0xc71b415 thru 0xc71dbd8 (0x27c4 bytes) 2024-09-11T06:17:55.782 INFO:teuthology.orchestra.run.smithi070.stdout:2083 read 0xe4e725 thru 0xe52394 (0x3c70 bytes) 2024-09-11T06:17:55.783 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:55.783 INFO:teuthology.orchestra.run.smithi070.stdout:2086 read 0xbc99705 thru 0xbca3c17 (0xa513 bytes) 2024-09-11T06:17:55.783 INFO:teuthology.orchestra.run.smithi070.stdout:2087 clone 12 order 25 su 16777216 sc 5 2024-09-11T06:17:55.788 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:55.787+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:55.821 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:55.821 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:55.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:55.888 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:55.887+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:55.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:17:55.977 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:55.977 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:55.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:55.989 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:55.987+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:56.038 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:56.039 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:56.039 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:17:56.056 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:56.056 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:56.072 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:56.089 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:56.089 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:56.090 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:56.089+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:56.093 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:56.093 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:56.093 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:56.093 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:56.093 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:56.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:56.105 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:56.106 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:56.123 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:56.124 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:56.140 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:56.140 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:56.143 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:17:56.144 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:17:56.191 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:56.190+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2271 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.950651626000003, 2024-09-11T06:17:56.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012468982999999999, 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258004+0000", 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6419999999999999e-06 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258011+0000", 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4599999999999997e-06 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258025+0000", 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3804e-05 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258033+0000", 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4239999999999993e-06 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258089+0000", 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.588e-05 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258147+0000", 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000002e-05 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.260204+0000", 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020570269999999999 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270393+0000", 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010188657 2024-09-11T06:17:56.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270403+0000", 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270437+0000", 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3373e-05 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270471+0000", 2024-09-11T06:17:56.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4073999999999999e-05 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2403 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.767014725000003, 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018324528999999999, 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2403 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441640+0000", 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441646+0000", 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441656+0000", 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0257e-05 2024-09-11T06:17:56.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441661+0000", 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0549999999999999e-06 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441710+0000", 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8446999999999999e-05 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441761+0000", 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1060999999999998e-05 2024-09-11T06:17:56.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.444470+0000", 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027092539999999999 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459870+0000", 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015399629 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459881+0000", 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1382e-05 2024-09-11T06:17:56.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459926+0000", 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4505000000000002e-05 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459963+0000", 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7759999999999998e-05 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28474 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2506752~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344366+0000", 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8642872190000004, 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011081840000000001, 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28474 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344366+0000", 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344366+0000", 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344367+0000", 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3799999999999998e-07 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344369+0000", 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8929999999999999e-06 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344376+0000", 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7020000000000001e-06 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344381+0000", 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.729e-06 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355262+0000", 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010881093 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355346+0000", 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3590000000000004e-05 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355448+0000", 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102495 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28475 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2834432~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8642648990000001, 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011213330000000001, 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28475 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.226 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6899999999999997e-07 2024-09-11T06:17:56.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344391+0000", 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2050000000000001e-06 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344398+0000", 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3380000000000001e-06 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344403+0000", 2024-09-11T06:17:56.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.882e-06 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355471+0000", 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011068056 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355528+0000", 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6821999999999999e-05 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355602+0000", 2024-09-11T06:17:56.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4457999999999998e-05 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28476 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3162112~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8642448959999998, 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464858, 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28476 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3700000000000001e-07 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344411+0000", 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.052e-06 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344417+0000", 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344422+0000", 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7589999999999997e-06 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355649+0000", 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011227305999999999 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355742+0000", 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2974999999999997e-05 2024-09-11T06:17:56.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355874+0000", 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013158000000000001 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28477 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3489792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8642255570000001, 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011629143999999999, 2024-09-11T06:17:56.234 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28477 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344429+0000", 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.06e-07 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344445+0000", 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6001000000000001e-05 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344451+0000", 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9569999999999996e-06 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344456+0000", 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8350000000000003e-06 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355921+0000", 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464919 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355991+0000", 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9424000000000005e-05 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356057+0000", 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6501999999999994e-05 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28478 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3817472~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8641895999999996, 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011937405, 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28478 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000003e-07 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344467+0000", 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344473+0000", 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344478+0000", 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8720000000000001e-06 2024-09-11T06:17:56.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356268+0000", 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011790629 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356317+0000", 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8594999999999998e-05 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356401+0000", 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4469999999999996e-05 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28479 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4145152~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8641693999999998, 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012172307, 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28479 2024-09-11T06:17:56.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344485+0000", 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344486+0000", 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.894e-06 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344493+0000", 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344497+0000", 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.464e-06 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356440+0000", 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011942790999999999 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356532+0000", 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2093000000000001e-05 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356656+0000", 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012460800000000001 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28824 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3129344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8424939440000001, 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011315202, 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28824 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:17:56.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366162+0000", 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8360000000000001e-06 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366167+0000", 2024-09-11T06:17:56.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366172+0000", 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377208+0000", 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011035872 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377326+0000", 2024-09-11T06:17:56.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118474 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377475+0000", 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148675 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28825 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3342336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8424760329999996, 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011577013000000001, 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28825 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366180+0000", 2024-09-11T06:17:56.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7880000000000001e-06 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366185+0000", 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7309999999999998e-06 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366190+0000", 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377508+0000", 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011317763 2024-09-11T06:17:56.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377595+0000", 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6674000000000004e-05 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377755+0000", 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015964899999999999 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.255 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28826 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3457024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.842457273, 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011917782, 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28826 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366197+0000", 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-07 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366233+0000", 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6746999999999999e-05 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366283+0000", 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9579000000000001e-05 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366289+0000", 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8799999999999996e-06 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377787+0000", 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011498058 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378003+0000", 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215553 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378114+0000", 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111576 2024-09-11T06:17:56.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28827 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3670016~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8423544209999996, 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012035376, 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28827 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366300+0000", 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000004e-07 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366307+0000", 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5850000000000002e-06 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366315+0000", 2024-09-11T06:17:56.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4290000000000004e-06 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366319+0000", 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6310000000000002e-06 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378147+0000", 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011827725000000001 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378228+0000", 2024-09-11T06:17:56.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1207999999999999e-05 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378335+0000", 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010620699999999999 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28828 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3784704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8423272820000003, 2024-09-11T06:17:56.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012221928999999999, 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28828 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366327+0000", 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366359+0000", 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2202000000000001e-05 2024-09-11T06:17:56.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366415+0000", 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5828000000000001e-05 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366425+0000", 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0176e-05 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378366+0000", 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011941139 2024-09-11T06:17:56.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378446+0000", 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0144999999999999e-05 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378548+0000", 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010201599999999999 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.268 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28829 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3997696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8422182019999997, 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012320490999999999, 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28829 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:17:56.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366436+0000", 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2200000000000003e-07 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366439+0000", 2024-09-11T06:17:56.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366446+0000", 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9580000000000001e-06 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366451+0000", 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378579+0000", 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012127816 2024-09-11T06:17:56.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378660+0000", 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1391999999999996e-05 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378756+0000", 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5610000000000001e-05 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.272 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28830 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4112384~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8421945590000002, 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012505113, 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28830 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366461+0000", 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0159999999999998e-06 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366467+0000", 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7679999999999997e-06 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366472+0000", 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378786+0000", 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012313783 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378863+0000", 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7307999999999999e-05 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378964+0000", 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101242 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.276 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28832 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8405990220000001, 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011082763000000001, 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28832 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368056+0000", 2024-09-11T06:17:56.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6500000000000008e-07 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368060+0000", 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3800000000000004e-06 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368069+0000", 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0280000000000006e-06 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368076+0000", 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0690000000000004e-06 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378995+0000", 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010918638 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379071+0000", 2024-09-11T06:17:56.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379137+0000", 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6068000000000005e-05 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28892 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.838172932, 2024-09-11T06:17:56.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011111242, 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28892 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6699999999999999e-07 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370483+0000", 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7320000000000001e-06 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370609+0000", 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012621900000000001 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370907+0000", 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029802600000000001 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381393+0000", 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010486430999999999 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381481+0000", 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7565999999999995e-05 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381592+0000", 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110901 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28895 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3686400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8376129150000002, 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011282359, 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28895 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4799999999999999e-07 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371047+0000", 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371055+0000", 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6149999999999999e-06 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371060+0000", 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.853e-06 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382125+0000", 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011064978 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382209+0000", 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3665000000000006e-05 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382323+0000", 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001145 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.289 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28896 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4014080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8375863599999995, 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011490497000000001, 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28896 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371068+0000", 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371070+0000", 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.091e-06 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371076+0000", 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4389999999999997e-06 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371080+0000", 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2350000000000001e-06 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382360+0000", 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011279811000000001 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382447+0000", 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7306999999999996e-05 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382558+0000", 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110216 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:33858 3.1 e66/24 3:813e6a9a:::rbd_header.116de94696bd:head v 66'309, mlcod=65'307)", 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9915410019999999, 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.031257166000000003, 2024-09-11T06:17:56.294 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7700000000000001e-07 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217117+0000", 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247505+0000", 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030387882000000001 2024-09-11T06:17:56.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247521+0000", 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5610000000000001e-05 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247591+0000", 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0219e-05 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247617+0000", 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6393999999999998e-05 2024-09-11T06:17:56.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248310+0000", 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000693094 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248370+0000", 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9338e-05 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.298 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:56.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:17:56.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:56.301 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:56.299+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:56.401 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:56.400+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:56.446 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:17:56.446 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:56.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:56.541 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:56.541+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:56.600 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:17:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:17:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:17:56.600 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:56.603 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:56.602+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:56.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:56.704 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:56.703+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:56.753 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.132299545999999, 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:17:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:17:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.837863968000001, 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:17:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:17:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:17:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16822 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 163840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563951079999999, 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038088416999999999, 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16822 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187978+0000", 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8700000000000001e-07 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187980+0000", 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187987+0000", 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0809999999999999e-06 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187991+0000", 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2420000000000002e-06 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225884+0000", 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037893139999999999 2024-09-11T06:17:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.225957+0000", 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3306000000000006e-05 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226066+0000", 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109103 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16823 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563932359999999, 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038574642999999999, 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16823 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187997+0000", 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.187999+0000", 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.12e-06 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188005+0000", 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-06 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188010+0000", 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-06 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226107+0000", 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03809676 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226463+0000", 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035599299999999998 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226571+0000", 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108725 2024-09-11T06:17:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16824 3.9 3:9546e80a:::rbd_data.116d3c8aaf0c.000000000000002c:b [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563913631999998, 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039232345000000002, 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16824 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188015+0000", 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188016+0000", 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188018+0000", 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.933e-06 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188024+0000", 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2310000000000001e-06 2024-09-11T06:17:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188038+0000", 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3837e-05 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226631+0000", 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038593589999999997 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226743+0000", 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111192 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227248+0000", 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050521599999999996 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16915 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563442085999998, 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038728892000000001, 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16915 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188487+0000", 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188489+0000", 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9190000000000002e-06 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188495+0000", 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6930000000000004e-06 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188505+0000", 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0203999999999999e-05 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226603+0000", 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038097497000000001 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.226680+0000", 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7115999999999998e-05 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227216+0000", 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000536123 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16916 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563413616999998, 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.03972564, 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16916 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188515+0000", 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188516+0000", 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:17:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188518+0000", 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.058e-06 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188524+0000", 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.015e-06 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188528+0000", 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4739999999999999e-06 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227244+0000", 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038716172 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.227328+0000", 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3120000000000004e-05 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228241+0000", 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091343800000000003 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16917 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563394658, 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039912402999999999, 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16917 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188534+0000", 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188535+0000", 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-07 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188539+0000", 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8940000000000003e-06 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188544+0000", 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6250000000000004e-06 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188553+0000", 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2359999999999993e-06 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228275+0000", 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039721226999999998 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228354+0000", 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370999999999996e-05 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228447+0000", 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2692e-05 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16918 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563369479999999, 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040097763000000002, 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16918 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188560+0000", 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2e-07 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188562+0000", 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188568+0000", 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1419999999999998e-06 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188573+0000", 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6940000000000003e-06 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228491+0000", 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.039918355000000003 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228564+0000", 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2621999999999997e-05 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228657+0000", 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517000000000006e-05 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16919 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.56335065, 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040276407, 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16919 2024-09-11T06:17:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188578+0000", 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188579+0000", 2024-09-11T06:17:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188581+0000", 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.838e-06 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188586+0000", 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8409999999999996e-06 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188601+0000", 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4545999999999999e-05 2024-09-11T06:17:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228687+0000", 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040086418999999998 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228761+0000", 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3761000000000001e-05 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228855+0000", 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3628000000000005e-05 2024-09-11T06:17:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16920 3.11 3:8a937279:::rbd_data.116d3c8aaf0c.000000000000007b:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563320817000001, 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040512056999999997, 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16920 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188608+0000", 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188609+0000", 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0399999999999996e-07 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188611+0000", 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.176e-06 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188618+0000", 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4769999999999997e-06 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188623+0000", 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8060000000000002e-06 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228884+0000", 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040261107999999997 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.228959+0000", 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5100999999999998e-05 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229120+0000", 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016078500000000001 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16927 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563213653999998, 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040618147, 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16927 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188715+0000", 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188716+0000", 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188717+0000", 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.283e-06 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188721+0000", 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9020000000000001e-06 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188723+0000", 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5950000000000001e-06 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229151+0000", 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040427053999999997 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229230+0000", 2024-09-11T06:17:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9467000000000003e-05 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229334+0000", 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010351799999999999 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16928 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563202662999998, 2024-09-11T06:17:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040816636000000003, 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16928 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188726+0000", 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188727+0000", 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188728+0000", 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0690000000000001e-06 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188731+0000", 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.982e-06 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188733+0000", 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.458e-06 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229364+0000", 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040631035000000003 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229445+0000", 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0925000000000002e-05 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229543+0000", 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7956999999999997e-05 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16929 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563192904000001, 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041025210999999999, 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16929 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188737+0000", 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0380000000000001e-06 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188740+0000", 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188744+0000", 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229575+0000", 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040831329 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229656+0000", 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0924e-05 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229761+0000", 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105171 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16930 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.563179241, 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041241585999999997, 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16930 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188752+0000", 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188758+0000", 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188762+0000", 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229808+0000", 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041046760000000002 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229854+0000", 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5365999999999999e-05 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229991+0000", 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013750200000000001 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27145 3.1d 3:bfb304f8:::rbd_data.116d770b822.0000000000000001:13 [read 5292032~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.240275+0000", 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5116538770000005, 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038166796000000003, 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27145 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240275+0000", 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240275+0000", 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240907+0000", 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00063139100000000003 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240911+0000", 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7729999999999999e-06 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240920+0000", 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9299999999999992e-06 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.240927+0000", 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.278339+0000", 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.037412051000000002 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.278382+0000", 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3371000000000002e-05 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.278442+0000", 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9444999999999998e-05 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27166 3.1d 3:b81da1e4:::rbd_data.116d770b822.0000000000000003:13 [read 999424~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.241009+0000", 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5109202249999996, 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038187825000000002, 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27166 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241009+0000", 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241009+0000", 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241009+0000", 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241011+0000", 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0140000000000001e-06 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241017+0000", 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0739999999999998e-06 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241022+0000", 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.87e-06 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279079+0000", 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038056517999999998 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279142+0000", 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2886999999999996e-05 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279197+0000", 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5067e-05 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27167 3.1d 3:b81da1e4:::rbd_data.116d770b822.0000000000000003:13 [read 1327104~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.241028+0000", 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5109012330000002, 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038322044999999999, 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27167 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241028+0000", 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241028+0000", 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241028+0000", 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241030+0000", 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241036+0000", 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3900000000000001e-06 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241040+0000", 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6290000000000001e-06 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279239+0000", 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0381991 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279288+0000", 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8408000000000001e-05 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279350+0000", 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1966999999999998e-05 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27168 3.1d 3:b81da1e4:::rbd_data.116d770b822.0000000000000003:13 [read 1654784~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.241046+0000", 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5108829710000009, 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038409984000000001, 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27168 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241046+0000", 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241046+0000", 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241046+0000", 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.58e-07 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241048+0000", 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9740000000000001e-06 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241054+0000", 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6010000000000002e-06 2024-09-11T06:17:56.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241059+0000", 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5299999999999998e-06 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279364+0000", 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038305937999999998 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279404+0000", 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9771999999999998e-05 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279456+0000", 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1811000000000003e-05 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:27169 3.1d 3:b81da1e4:::rbd_data.116d770b822.0000000000000003:13 [read 1982464~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.241071+0000", 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5108582380000009, 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.038518973999999997, 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:17:56.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 27169 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241071+0000", 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.241071+0000", 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:17:56.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.242906+0000", 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018353460000000001 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.242912+0000", 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9399999999999999e-06 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.242923+0000", 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.242931+0000", 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0139999999999998e-06 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279491+0000", 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.036560702 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279534+0000", 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2734000000000001e-05 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:17:56.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.279590+0000", 2024-09-11T06:17:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5658999999999997e-05 2024-09-11T06:17:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:17:56.841 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:17:56.841 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:17:56.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:17:56.843 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:56.841+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:56.943 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:56.942+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:56.954 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:56.954 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:56.954 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:56.962 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:17:57.044 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:57.044+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:57.065 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:57.065 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:57.065 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:57.065 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:57.065 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:57.074 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:17:57.145 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:57.144+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:57.179 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.861838464999998, 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.180 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:17:57.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:17:57.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:17:57.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:17:57.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:17:57.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:17:57.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:17:57.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:17:57.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.549265247000001, 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:17:57.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:17:57.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:57.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.192 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16521 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 114688~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.002411795, 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095026380000000008, 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.193 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16521 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175432+0000", 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175438+0000", 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175445+0000", 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2219999999999996e-06 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184800+0000", 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009354322 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184848+0000", 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8398e-05 2024-09-11T06:17:57.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184932+0000", 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4132e-05 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16522 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 151552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.002320593, 2024-09-11T06:17:57.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096235079999999994, 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16522 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175522+0000", 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1099999999999995e-07 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175525+0000", 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.619e-06 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175535+0000", 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6590000000000002e-06 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175542+0000", 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2570000000000001e-06 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184976+0000", 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094335619999999995 2024-09-11T06:17:57.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185064+0000", 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8530999999999997e-05 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185144+0000", 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0168999999999998e-05 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16523 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 188416~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.002289131000001, 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099147300000000001, 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16523 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175553+0000", 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175561+0000", 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5369999999999997e-06 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175571+0000", 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7480000000000005e-06 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175577+0000", 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-06 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185174+0000", 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095965570000000004 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185253+0000", 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8889999999999999e-05 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185467+0000", 2024-09-11T06:17:57.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021430099999999999 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16524 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.002255133999999, 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010599717999999999, 2024-09-11T06:17:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.207 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.207 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.207 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16524 2024-09-11T06:17:57.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.207 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175587+0000", 2024-09-11T06:17:57.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:17:57.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175589+0000", 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175596+0000", 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175601+0000", 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185553+0000", 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099520630000000006 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185649+0000", 2024-09-11T06:17:57.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6086000000000001e-05 2024-09-11T06:17:57.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186186+0000", 2024-09-11T06:17:57.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053697800000000002 2024-09-11T06:17:57.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.213 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.213 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16553 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.213 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:57.213 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001505743999999, 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010060193, 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16553 2024-09-11T06:17:57.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:57.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:17:57.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:17:57.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176340+0000", 2024-09-11T06:17:57.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.405e-06 2024-09-11T06:17:57.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176348+0000", 2024-09-11T06:17:57.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8199999999999997e-06 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176354+0000", 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186219+0000", 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098650109999999999 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186298+0000", 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9383999999999998e-05 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186396+0000", 2024-09-11T06:17:57.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7387999999999997e-05 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16554 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001478628000001, 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010247795000000001, 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16554 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:17:57.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176364+0000", 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5799999999999998e-07 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176366+0000", 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176373+0000", 2024-09-11T06:17:57.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4289999999999998e-06 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176377+0000", 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186427+0000", 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010049742 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186511+0000", 2024-09-11T06:17:57.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3991000000000003e-05 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186611+0000", 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9565e-05 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16555 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001456414, 2024-09-11T06:17:57.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010729601, 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16555 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176386+0000", 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176388+0000", 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176395+0000", 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176400+0000", 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186644+0000", 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010244052 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186742+0000", 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8159999999999995e-05 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187115+0000", 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037263900000000002 2024-09-11T06:17:57.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16593 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001406095, 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011057091, 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16593 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176436+0000", 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176439+0000", 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4509999999999999e-06 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176443+0000", 2024-09-11T06:17:57.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6240000000000001e-06 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176446+0000", 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0649999999999999e-06 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187152+0000", 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010706194 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187231+0000", 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8234999999999999e-05 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187492+0000", 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026178300000000002 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16594 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:57.233 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001386997000001, 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011362636000000001, 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16594 2024-09-11T06:17:57.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:57.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176455+0000", 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176457+0000", 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176463+0000", 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176469+0000", 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187542+0000", 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011073037000000001 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187615+0000", 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3013e-05 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187817+0000", 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020221099999999999 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.238 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16595 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001367932000001, 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011570079, 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.239 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16595 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176478+0000", 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176482+0000", 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176485+0000", 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9050000000000001e-06 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187855+0000", 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011370066999999999 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187951+0000", 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5435999999999999e-05 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188044+0000", 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3010000000000006e-05 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16596 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001345862000001, 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011742973, 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.243 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16596 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176498+0000", 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0889999999999998e-06 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176504+0000", 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176509+0000", 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188070+0000", 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01156101 2024-09-11T06:17:57.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188138+0000", 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7527999999999994e-05 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188239+0000", 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100725 2024-09-11T06:17:57.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.248 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.248 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.248 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16597 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.248 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:57.248 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001325945000001, 2024-09-11T06:17:57.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011917311999999999, 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16597 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176516+0000", 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176517+0000", 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.658e-06 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176521+0000", 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9269999999999998e-06 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176526+0000", 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1110000000000001e-06 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188263+0000", 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011737632 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188340+0000", 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7113000000000005e-05 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188433+0000", 2024-09-11T06:17:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2538000000000001e-05 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16598 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001306587999998, 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012870312, 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16598 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176538+0000", 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176546+0000", 2024-09-11T06:17:57.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176550+0000", 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.797e-06 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188466+0000", 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011915965000000001 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188550+0000", 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3446e-05 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189405+0000", 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085535500000000003 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16619 3.6 3:6708c1ee:::rbd_data.116d3c8aaf0c.000000000000002e:b [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.001055862000001, 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012975781, 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16619 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:17:57.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7199999999999998e-07 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176789+0000", 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-06 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176797+0000", 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6310000000000003e-06 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176803+0000", 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6710000000000004e-06 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189440+0000", 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012637438000000001 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189511+0000", 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1421000000000006e-05 2024-09-11T06:17:57.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189761+0000", 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024988799999999998 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:17472 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.946968623, 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013625929, 2024-09-11T06:17:57.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 17472 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230874+0000", 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2999999999999999e-07 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230878+0000", 2024-09-11T06:17:57.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4209999999999997e-06 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230888+0000", 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0356e-05 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230895+0000", 2024-09-11T06:17:57.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9530000000000002e-06 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230940+0000", 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4589000000000003e-05 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230995+0000", 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5390000000000003e-05 2024-09-11T06:17:57.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231196+0000", 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020024499999999999 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231787+0000", 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059133700000000005 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244412+0000", 2024-09-11T06:17:57.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012624803 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244460+0000", 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7802000000000001e-05 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244499+0000", 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9202999999999997e-05 2024-09-11T06:17:57.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18219 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.922941946999998, 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011081077, 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18219 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254900+0000", 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-07 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254905+0000", 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254916+0000", 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0949e-05 2024-09-11T06:17:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254925+0000", 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254972+0000", 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6826999999999997e-05 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255031+0000", 2024-09-11T06:17:57.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9364000000000003e-05 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255240+0000", 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020845600000000001 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255893+0000", 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00065294500000000004 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:57.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265665+0000", 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097724279999999997 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265932+0000", 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267197 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265981+0000", 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8083e-05 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.274 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:31264 3.2 3:40b07a46:::rbd_object_map.116d6ab4d031.0000000000000014:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.627724+0000", 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.5501176539999992, 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0093856240000000004, 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.275 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 31264 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627724+0000", 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627724+0000", 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627725+0000", 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.47e-07 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627730+0000", 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1290000000000004e-06 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627741+0000", 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0701e-05 2024-09-11T06:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627765+0000", 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4634000000000002e-05 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627814+0000", 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8896000000000001e-05 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627883+0000", 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9251000000000005e-05 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628080+0000", 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000196727 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.629253+0000", 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011732190000000001 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637023+0000", 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.007770033 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637072+0000", 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8183000000000003e-05 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637109+0000", 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7904000000000002e-05 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.280 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:31265 3.6 3:6434a7af:::rbd_data.116d6ab4d031.0000000000000065:head [write 0~16384 [fadvise_sequential+fadvise_nocache],write 32768~49152 [fadvise_sequential+fadvise_nocache],write 98304~49152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.5498654340000009, 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094624770000000004, 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.281 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 31265 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627977+0000", 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628146+0000", 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000169629 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628156+0000", 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:17:57.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628163+0000", 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.058e-06 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628226+0000", 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3001000000000002e-05 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628379+0000", 2024-09-11T06:17:57.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000153215 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628572+0000", 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019296999999999999 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.630117+0000", 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015450259999999999 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637285+0000", 2024-09-11T06:17:57.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071677729999999997 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637393+0000", 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108248 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637438+0000", 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5555e-05 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.286 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:17:57.289 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:17:57.289 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:57.286+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:57.389 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:57.387+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:57.434 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:57.434 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:57.443 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:17:57.527 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:57.527+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:57.587 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:57.587 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:57.587 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:57.587 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:57.587 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:57.590 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:57.589+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:57.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:17:57.691 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:57.690+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29678 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3145728~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3038308910000005, 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025653072999999998, 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29678 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:17:57.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4699999999999998e-07 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436314+0000", 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1349999999999999e-06 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436317+0000", 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9689999999999999e-06 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436319+0000", 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5959999999999998e-06 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461843+0000", 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025523883000000001 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461888+0000", 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5073e-05 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461965+0000", 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7169999999999995e-05 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29679 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3260416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.746 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3038211210000004, 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025777099000000001, 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29679 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:17:57.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436323+0000", 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0079999999999999e-06 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436326+0000", 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436329+0000", 2024-09-11T06:17:57.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461989+0000", 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025660388999999999 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462029+0000", 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9854000000000002e-05 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462099+0000", 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0167999999999996e-05 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29680 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3473408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3038116029999998, 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025900241000000001, 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.751 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29680 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436332+0000", 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1899999999999999e-07 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436333+0000", 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.049e-06 2024-09-11T06:17:57.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436336+0000", 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8830000000000002e-06 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436338+0000", 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4700000000000001e-06 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462122+0000", 2024-09-11T06:17:57.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025784081 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462162+0000", 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9774999999999998e-05 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462232+0000", 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9764000000000005e-05 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29681 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3588096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3038000449999991, 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026043075999999998, 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.756 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29681 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436344+0000", 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436348+0000", 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-06 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436350+0000", 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462257+0000", 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025906966999999999 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462304+0000", 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7448999999999999e-05 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462386+0000", 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.174e-05 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.760 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29682 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037900360000005, 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026216950999999999, 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29682 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436354+0000", 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436357+0000", 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436360+0000", 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.464e-06 2024-09-11T06:17:57.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462412+0000", 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026052230999999999 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462459+0000", 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7207999999999999e-05 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462570+0000", 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110968 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29683 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037805999999996, 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026370945, 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.765 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29683 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:17:57.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436363+0000", 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436364+0000", 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:17:57.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436367+0000", 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436369+0000", 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5059999999999998e-06 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462606+0000", 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026237114999999998 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462653+0000", 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462733+0000", 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0605999999999994e-05 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.769 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29684 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037709940000006, 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026632194000000001, 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.770 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29684 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436373+0000", 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6899999999999996e-07 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436376+0000", 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9699999999999999e-06 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436379+0000", 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462758+0000", 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026378990000000001 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462846+0000", 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8641999999999996e-05 2024-09-11T06:17:57.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463004+0000", 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015788 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29685 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037614800000004, 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026764263, 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.774 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29685 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:17:57.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436383+0000", 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436386+0000", 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436388+0000", 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6570000000000001e-06 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463023+0000", 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026634722 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463068+0000", 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5025999999999999e-05 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463146+0000", 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7729000000000001e-05 2024-09-11T06:17:57.778 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29686 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037514909999999, 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026966905999999999, 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.779 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.780 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29686 2024-09-11T06:17:57.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.780 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436393+0000", 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436396+0000", 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.915e-06 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436398+0000", 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463173+0000", 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026774703 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463242+0000", 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9770000000000005e-05 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463358+0000", 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116038 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29687 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037422630000002, 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027120658999999998, 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.784 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29687 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436402+0000", 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436405+0000", 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8899999999999999e-06 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436407+0000", 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463391+0000", 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026983285999999999 2024-09-11T06:17:57.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463433+0000", 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2481999999999997e-05 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463521+0000", 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8373000000000002e-05 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29688 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037328620000004, 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027291494999999999, 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29688 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.789 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:17:57.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436411+0000", 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-06 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436414+0000", 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8940000000000002e-06 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436417+0000", 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5069999999999999e-06 2024-09-11T06:17:57.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463562+0000", 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027144622 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463621+0000", 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9108999999999999e-05 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463702+0000", 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29689 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037233350000008, 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027435349000000001, 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.793 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29689 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:17:57.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436423+0000", 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436426+0000", 2024-09-11T06:17:57.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0010000000000002e-06 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436429+0000", 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4739999999999999e-06 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463726+0000", 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027297482000000001 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463780+0000", 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3714000000000001e-05 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463855+0000", 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5278000000000007e-05 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29690 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037115220000004, 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027575023000000001, 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29690 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436433+0000", 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436436+0000", 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8959999999999999e-06 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436438+0000", 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.514e-06 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463880+0000", 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027442151000000001 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463924+0000", 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3983000000000002e-05 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464007+0000", 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2274000000000005e-05 2024-09-11T06:17:57.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29691 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3037014249999999, 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027733827999999999, 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29691 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:17:57.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:17:57.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:17:57.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436443+0000", 2024-09-11T06:17:57.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.279e-06 2024-09-11T06:17:57.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436446+0000", 2024-09-11T06:17:57.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:17:57.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436449+0000", 2024-09-11T06:17:57.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:17:57.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464034+0000", 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027585492 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464082+0000", 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7444999999999997e-05 2024-09-11T06:17:57.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464175+0000", 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3954000000000002e-05 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.809 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29692 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5439488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.809 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:17:57.809 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3036915950000001, 2024-09-11T06:17:57.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027927924, 2024-09-11T06:17:57.809 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.809 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.809 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29692 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:17:57.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436452+0000", 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436453+0000", 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1179999999999999e-06 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436456+0000", 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436458+0000", 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464214+0000", 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027755618999999999 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464266+0000", 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2354000000000001e-05 2024-09-11T06:17:57.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464379+0000", 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011328900000000001 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29693 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5554176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3036821930000002, 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028112022, 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29693 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436462+0000", 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.031e-06 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436465+0000", 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3230000000000002e-06 2024-09-11T06:17:57.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436468+0000", 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4870000000000001e-06 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464414+0000", 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027946104999999999 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464468+0000", 2024-09-11T06:17:57.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3637999999999997e-05 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464573+0000", 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105232 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29694 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5767168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3036722520000001, 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028256073999999999, 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29694 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436472+0000", 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436475+0000", 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8870000000000001e-06 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436478+0000", 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464591+0000", 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028113171999999999 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464643+0000", 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950999999999998e-05 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464727+0000", 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4133000000000002e-05 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.824 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29695 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5881856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3036625540000006, 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02845924, 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29695 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436482+0000", 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.111e-06 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436485+0000", 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436487+0000", 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5859999999999999e-06 2024-09-11T06:17:57.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464762+0000", 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028274773 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464848+0000", 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6269999999999999e-05 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464940+0000", 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1345e-05 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29696 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6094848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3036528240000003, 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028603799999999999, 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.829 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29696 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436491+0000", 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.879999999999999e-07 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436494+0000", 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8339999999999999e-06 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436497+0000", 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.328e-06 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464970+0000", 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028473196999999999 2024-09-11T06:17:57.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465017+0000", 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465094+0000", 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6606999999999993e-05 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.833 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29697 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6209536~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.3036402089999992, 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028751832000000001, 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29697 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:57.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436504+0000", 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.319e-06 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436508+0000", 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2729999999999998e-06 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436510+0000", 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465125+0000", 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028614537999999998 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465174+0000", 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8965000000000003e-05 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465255+0000", 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0798999999999997e-05 2024-09-11T06:17:57.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:57.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:57.838 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:57.839 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:17:57.840 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:57.838+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:57.939 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:57.939+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:17:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:57.992 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:17:58.077 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:58.076+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:58.135 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:58.135 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:17:58.135 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:17:58.135 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:17:58.135 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:58.141 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:58.141+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:58.143 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:17:58.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:17:58.242 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:58.242+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:58.272 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:17:58.273 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:17:58.273 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:17:58.290 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:17:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:17:58.291 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7643558699999993, 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.292 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.296 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7643374210000005, 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.297 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:17:58.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:17:58.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7643066239999996, 2024-09-11T06:17:58.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:17:58.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7642876160000007, 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:58.306 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:58.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:17:58.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7642689479999998, 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:17:58.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7642468890000007, 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.316 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.319 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7642280249999995, 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:17:58.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:17:58.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7642082440000006, 2024-09-11T06:17:58.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7641893159999995, 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.328 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:17:58.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7641488360000004, 2024-09-11T06:17:58.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.336 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7641187269999996, 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:17:58.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:17:58.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7620275309999993, 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.341 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:17:58.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7619506099999995, 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.348 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7619263099999998, 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:17:58.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:17:58.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7618908910000002, 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.354 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:17:58.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:17:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7618736869999996, 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:17:58.358 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:17:58.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7618574240000004, 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:17:58.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:58.367 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7618404470000009, 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:17:58.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:17:58.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7618244619999999, 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:58.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:17:58.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:17:58.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:17:58.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.7618064929999999, 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:17:58.377 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:17:58.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:17:58.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:17:58.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.381 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:17:58.381 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:17:58.381 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:17:58.382 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:17:58.382 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:17:58.383 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:17:58.383 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:17:58.384 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:17:58.384 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:58.382+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:58.384 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:17:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:17:58.385 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:17:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:17:58.386 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-11T06:17:58.386 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:17:58.386 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:17:58.387 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:17:58.387 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:17:58.483 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:58.482+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:58.530 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:58.530 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:58.538 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:17:58.615 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:58.616 INFO:teuthology.orchestra.run.smithi070.stdout:2090 write 0x5d44ca9 thru 0x5d546d3 (0xfa2b bytes) 2024-09-11T06:17:58.621 INFO:teuthology.orchestra.run.smithi070.stdout:2091 punch from 0x5bfa807 to 0x5bff3ed, (0x4be6 bytes) 2024-09-11T06:17:58.621 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:17:58.622 INFO:teuthology.orchestra.run.smithi070.stdout:2093 trunc from 0xc71dbd9 to 0xd49e516 2024-09-11T06:17:58.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:58.622+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:58.628 INFO:teuthology.orchestra.run.smithi070.stdout:2094 write 0x392d390 thru 0x393724d (0x9ebe bytes) 2024-09-11T06:17:58.630 INFO:teuthology.orchestra.run.smithi070.stdout:2095 write 0x2cc7b72 thru 0x2cd5aa5 (0xdf34 bytes) 2024-09-11T06:17:58.631 INFO:teuthology.orchestra.run.smithi070.stdout:2096 writesame 0x943b69d thru 0x9440b2d data_size 0x1(0x5491 bytes) 2024-09-11T06:17:58.642 INFO:teuthology.orchestra.run.smithi070.stdout:2097 read 0x25d5bf2 thru 0x25e0fb1 (0xb3c0 bytes) 2024-09-11T06:17:58.642 INFO:teuthology.orchestra.run.smithi070.stdout:2098 punch from 0x920d982 to 0x920ebcf, (0x124d bytes) 2024-09-11T06:17:58.642 INFO:teuthology.orchestra.run.smithi070.stdout:2099 write 0x63b05ef thru 0x63b2d26 (0x2738 bytes) 2024-09-11T06:17:58.644 INFO:teuthology.orchestra.run.smithi070.stdout:2100 read 0x50ccc09 thru 0x50d8240 (0xb638 bytes) 2024-09-11T06:17:58.644 INFO:teuthology.orchestra.run.smithi070.stdout:2101 read 0xa1350a9 thru 0xa1358cf (0x827 bytes) 2024-09-11T06:17:58.644 INFO:teuthology.orchestra.run.smithi070.stdout:2102 read 0x377c35b thru 0x3786882 (0xa528 bytes) 2024-09-11T06:17:58.645 INFO:teuthology.orchestra.run.smithi070.stdout:2103 writesame 0x3021657 thru 0x302e4d5 data_size 0x43(0xce7f bytes) 2024-09-11T06:17:58.646 INFO:teuthology.orchestra.run.smithi070.stdout:2105 writesame 0xac76051 thru 0xac7c608 data_size 0x18(0x65b8 bytes) 2024-09-11T06:17:58.650 INFO:teuthology.orchestra.run.smithi070.stdout:2106 clone 13 order 23 su 65536 sc 12 2024-09-11T06:17:58.684 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:58.683+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:58.685 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:58.685 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:58.694 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:17:58.785 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:17:58.784+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:17:58.837 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:58.837 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:58.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:17:58.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:17:58.885+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:17:58.949 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:58.950 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:58.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:17:58.986 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:58.986+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:59.060 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:59.061 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:59.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:17:59.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:59.087+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:17:59.171 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:59.171 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:59.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:17:59.188 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:17:59.188+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:17:59.287 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:59.287 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:59.288 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:59.288+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:59.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:17:59.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:17:59.390 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:17:59.389+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:17:59.442 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:59.442 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:59.451 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:17:59.491 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:59.490+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:59.592 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:59.591+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:59.595 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:59.596 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:59.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:17:59.692 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:59.692+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:59.749 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:59.749 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:59.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:17:59.794 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:17:59.793+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:17:59.837 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-11T06:17:59.837 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:17:59.838 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T06:17:59.838 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.019288 2024-09-11T06:17:59.838 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0.019287816338480535 2024-09-11T06:17:59.895 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:17:59.894+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:17:59.903 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:17:59.903 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:17:59.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:17:59.995 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:17:59.995+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:00.059 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:00.060 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:00.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:00.113 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:00.113+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:00.184 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:00.184 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:00.194 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:00.235 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:00.234+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:00.244 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:18:00.244 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.7 primary-affinity to 0.0192878 (812642) 2024-09-11T06:18:00.298 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:00.297+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:00.341 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:00.341 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:00.350 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:00.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:00.433 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:00.432+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:00.455 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:00.455 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:00.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:00.499 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:00.498+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:00.509 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:00.509 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:00.510 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:18:00.526 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:00.526 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:00.542 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:00.542 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:00.558 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:00.567 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:00.567 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:00.575 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:00.575 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:00.576 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:00.591 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:00.607 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:00.610 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:00.610 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:00.620 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:00.620+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:00.679 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:00.680 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:00.680 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:00.680 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:00.680 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:00.688 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:00.701 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:00.701+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:00.802 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:00.802+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:00.833 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:00.833 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:00.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:00.833 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:00.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.833 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29678 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3145728~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.833 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:00.833 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395332307, 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025653072999999998, 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29678 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:00.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4699999999999998e-07 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436314+0000", 2024-09-11T06:18:00.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1349999999999999e-06 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436317+0000", 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9689999999999999e-06 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436319+0000", 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5959999999999998e-06 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461843+0000", 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025523883000000001 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461888+0000", 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5073e-05 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461965+0000", 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7169999999999995e-05 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.837 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29679 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3260416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395322537, 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025777099000000001, 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.838 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29679 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436323+0000", 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0079999999999999e-06 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436326+0000", 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:18:00.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436329+0000", 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461989+0000", 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025660388999999999 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462029+0000", 2024-09-11T06:18:00.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9854000000000002e-05 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462099+0000", 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0167999999999996e-05 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29680 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3473408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395313019, 2024-09-11T06:18:00.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025900241000000001, 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29680 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436332+0000", 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1899999999999999e-07 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436333+0000", 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.049e-06 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436336+0000", 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8830000000000002e-06 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436338+0000", 2024-09-11T06:18:00.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4700000000000001e-06 2024-09-11T06:18:00.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462122+0000", 2024-09-11T06:18:00.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025784081 2024-09-11T06:18:00.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462162+0000", 2024-09-11T06:18:00.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9774999999999998e-05 2024-09-11T06:18:00.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462232+0000", 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9764000000000005e-05 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29681 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3588096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395301461000001, 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026043075999999998, 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.848 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29681 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436344+0000", 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436348+0000", 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-06 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436350+0000", 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462257+0000", 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025906966999999999 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462304+0000", 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7448999999999999e-05 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462386+0000", 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.174e-05 2024-09-11T06:18:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29682 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395291452, 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026216950999999999, 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29682 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436354+0000", 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436357+0000", 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436360+0000", 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.464e-06 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462412+0000", 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026052230999999999 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462459+0000", 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7207999999999999e-05 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462570+0000", 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110968 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29683 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395282015999999, 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026370945, 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29683 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436363+0000", 2024-09-11T06:18:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436364+0000", 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436367+0000", 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436369+0000", 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5059999999999998e-06 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462606+0000", 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026237114999999998 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462653+0000", 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:18:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462733+0000", 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0605999999999994e-05 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29684 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.39527241, 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026632194000000001, 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29684 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436373+0000", 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6899999999999996e-07 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436376+0000", 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9699999999999999e-06 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436379+0000", 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462758+0000", 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026378990000000001 2024-09-11T06:18:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462846+0000", 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8641999999999996e-05 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463004+0000", 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015788 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29685 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395262896, 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026764263, 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29685 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436383+0000", 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436386+0000", 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436388+0000", 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6570000000000001e-06 2024-09-11T06:18:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463023+0000", 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026634722 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463068+0000", 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5025999999999999e-05 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463146+0000", 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7729000000000001e-05 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29686 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395252907, 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026966905999999999, 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29686 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436393+0000", 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436396+0000", 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.915e-06 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436398+0000", 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463173+0000", 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026774703 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463242+0000", 2024-09-11T06:18:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9770000000000005e-05 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463358+0000", 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116038 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29687 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395243679, 2024-09-11T06:18:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027120658999999998, 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29687 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436402+0000", 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436405+0000", 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8899999999999999e-06 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436407+0000", 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463391+0000", 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026983285999999999 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463433+0000", 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2481999999999997e-05 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463521+0000", 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8373000000000002e-05 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29688 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395234278, 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027291494999999999, 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29688 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436411+0000", 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-06 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436414+0000", 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8940000000000002e-06 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436417+0000", 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5069999999999999e-06 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463562+0000", 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027144622 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463621+0000", 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9108999999999999e-05 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463702+0000", 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29689 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395224751000001, 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027435349000000001, 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29689 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436423+0000", 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436426+0000", 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0010000000000002e-06 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436429+0000", 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4739999999999999e-06 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463726+0000", 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027297482000000001 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463780+0000", 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3714000000000001e-05 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463855+0000", 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5278000000000007e-05 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29690 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395212938, 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027575023000000001, 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29690 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436433+0000", 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436436+0000", 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8959999999999999e-06 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436438+0000", 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.514e-06 2024-09-11T06:18:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463880+0000", 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027442151000000001 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463924+0000", 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3983000000000002e-05 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464007+0000", 2024-09-11T06:18:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2274000000000005e-05 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29691 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395202841, 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027733827999999999, 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29691 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436443+0000", 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.279e-06 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436446+0000", 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436449+0000", 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464034+0000", 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027585492 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464082+0000", 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7444999999999997e-05 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464175+0000", 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3954000000000002e-05 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29692 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5439488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395193011, 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027927924, 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29692 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436452+0000", 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436453+0000", 2024-09-11T06:18:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1179999999999999e-06 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436456+0000", 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436458+0000", 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464214+0000", 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027755618999999999 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464266+0000", 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2354000000000001e-05 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464379+0000", 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011328900000000001 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29693 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5554176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395183609, 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028112022, 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29693 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436462+0000", 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.031e-06 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436465+0000", 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3230000000000002e-06 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436468+0000", 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4870000000000001e-06 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464414+0000", 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027946104999999999 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464468+0000", 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3637999999999997e-05 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464573+0000", 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105232 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29694 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5767168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395173668, 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028256073999999999, 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29694 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436472+0000", 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436475+0000", 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8870000000000001e-06 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436478+0000", 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464591+0000", 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028113171999999999 2024-09-11T06:18:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464643+0000", 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950999999999998e-05 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464727+0000", 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4133000000000002e-05 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29695 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5881856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.39516397, 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02845924, 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29695 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436482+0000", 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.111e-06 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436485+0000", 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436487+0000", 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5859999999999999e-06 2024-09-11T06:18:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464762+0000", 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028274773 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464848+0000", 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6269999999999999e-05 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464940+0000", 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1345e-05 2024-09-11T06:18:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29696 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6094848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.39515424, 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028603799999999999, 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29696 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436491+0000", 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.879999999999999e-07 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436494+0000", 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8339999999999999e-06 2024-09-11T06:18:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436497+0000", 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.328e-06 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464970+0000", 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028473196999999999 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465017+0000", 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465094+0000", 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6606999999999993e-05 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29697 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6209536~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.395141625000001, 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028751832000000001, 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29697 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436504+0000", 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.319e-06 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436508+0000", 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2729999999999998e-06 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436510+0000", 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465125+0000", 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028614537999999998 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465174+0000", 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8965000000000003e-05 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465255+0000", 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0798999999999997e-05 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:00.924 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:00.925 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:00.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:00.924+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:01.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:01.025+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:01.070 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:01.070 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:01.070 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:01.079 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:01.162 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:01.162+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:01.222 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:01.222 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:01.222 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:01.222 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:01.223 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:01.227 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:01.226+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:01.231 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:01.327 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:01.326+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:01.391 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:01.391 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:01.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:01.391 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:01.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.863168689, 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.392 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:18:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.86315024, 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:18:01.396 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:18:01.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:18:01.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.400 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.863119443, 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.863100435, 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:18:01.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:18:01.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.863081767000001, 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.863059708, 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.413 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:01.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.863040844, 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.417 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.863021063, 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.421 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:18:01.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.863002135, 2024-09-11T06:18:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:18:01.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:18:01.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:01.429 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.862961654999999, 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:18:01.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.433 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.862931546, 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:01.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.86084035, 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.860763429, 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:18:01.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:01.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.860739129000001, 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.446 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.860703709999999, 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:18:01.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.860686506, 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:18:01.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.860670243, 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:18:01.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.860653266, 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.465 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.860637281000001, 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.466 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.469 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.860619312000001, 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:01.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:18:01.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.473 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:01.475 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:01.475 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:01.474+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:01.576 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:01.575+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:01.578 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:01.578 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:01.578 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:01.578 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:01.586 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:01.677 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:01.676+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:01.688 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:01.688 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:01.688 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:01.688 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:01.688 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:01.696 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:01.781 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:01.780+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600560072, 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:01.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:18:01.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:18:01.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600547334, 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.846 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:18:01.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.850 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600536201000001, 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:01.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:18:01.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:18:01.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600525613, 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.855 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:18:01.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600515118000001, 2024-09-11T06:18:01.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:18:01.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.863 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600504805, 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:18:01.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600494263, 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:18:01.868 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:18:01.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600483957, 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.873 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:01.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:18:01.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:18:01.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600468379, 2024-09-11T06:18:01.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:18:01.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:18:01.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.600449374, 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.882 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:18:01.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:18:01.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:01.886 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540920001, 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:18:01.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:18:01.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540901529999999, 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540883040000001, 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540865972000001, 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.899 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:18:01.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540847940999999, 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.903 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:01.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:18:01.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:18:01.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540825757, 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:18:01.907 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:01.911 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540807765, 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:01.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:18:01.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.915 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540790111, 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:01.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:18:01.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540767195000001, 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:18:01.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:18:01.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:18:01.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.540748807, 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:01.924 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:01.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:18:01.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.927 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:01.928 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:01.928 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:01.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:01.928+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:01.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:02.029 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:02.029+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:02.036 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:02.036 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:02.037 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:02.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:02.130 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:02.129+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:02.148 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:02.148 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:02.148 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:02.148 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:02.148 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:02.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:02.231 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:02.230+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:02.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:18:02.264 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.579072699999998, 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:18:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.459076461999999, 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28882 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3637248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.892231500999999, 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020043653000000002, 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28882 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000002e-07 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370273+0000", 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4075e-05 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370280+0000", 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.007e-06 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370286+0000", 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3380000000000004e-06 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390099+0000", 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019812923999999999 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390172+0000", 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3375999999999997e-05 2024-09-11T06:18:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390303+0000", 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130512 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28883 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.892196160999999, 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020291813999999998, 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28883 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370295+0000", 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370297+0000", 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.21e-06 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370303+0000", 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4479999999999999e-06 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370309+0000", 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3040000000000004e-06 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390350+0000", 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020040842 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390438+0000", 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8446e-05 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390586+0000", 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014808399999999999 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:37169 3.1d e71/24 3:bf1f3ef1:::rbd_data.116d2df99cf8.0000000000000001:head v 71'281, mlcod=69'279)", 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:57.300774+0000", 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9617166489999995, 2024-09-11T06:18:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019992135000000001, 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.300774+0000", 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.300774+0000", 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.300775+0000", 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.310098+0000", 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093222700000000006 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.310117+0000", 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9432999999999998e-05 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.310127+0000", 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8779999999999993e-06 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.310189+0000", 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2028999999999999e-05 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.310209+0000", 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0335000000000001e-05 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.320722+0000", 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010513074000000001 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.320766+0000", 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3503e-05 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38581 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.975137319, 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020052018000000001, 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38581 2024-09-11T06:18:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287354+0000", 2024-09-11T06:18:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287356+0000", 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4030000000000001e-06 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287362+0000", 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9710000000000001e-06 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287367+0000", 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307187+0000", 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019820397999999999 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307279+0000", 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1417999999999998e-05 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307405+0000", 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126265 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38582 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3211264~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97511583800000001, 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020273138999999999, 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38582 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287377+0000", 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0990000000000001e-06 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287383+0000", 2024-09-11T06:18:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T06:18:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287388+0000", 2024-09-11T06:18:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8149999999999996e-06 2024-09-11T06:18:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307438+0000", 2024-09-11T06:18:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020050081000000001 2024-09-11T06:18:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307527+0000", 2024-09-11T06:18:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9476999999999997e-05 2024-09-11T06:18:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307648+0000", 2024-09-11T06:18:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120226 2024-09-11T06:18:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38583 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3997696~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97509660200000003, 2024-09-11T06:18:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020512203999999999, 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38583 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287401+0000", 2024-09-11T06:18:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1500000000000002e-06 2024-09-11T06:18:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287408+0000", 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1750000000000002e-06 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287413+0000", 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0640000000000001e-06 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307690+0000", 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020277067999999999 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307779+0000", 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9071000000000002e-05 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307906+0000", 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012727600000000001 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38584 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 4784128~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97507076699999995, 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020729899, 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38584 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287422+0000", 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1560000000000002e-06 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287427+0000", 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2299999999999999e-06 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287439+0000", 2024-09-11T06:18:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1263999999999999e-05 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307939+0000", 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020499962 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308026+0000", 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7787000000000005e-05 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308150+0000", 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123082 2024-09-11T06:18:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38585 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 5570560~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97490727899999996, 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782914, 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38585 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287584+0000", 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-07 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287587+0000", 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3979999999999999e-06 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287595+0000", 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6899999999999992e-06 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287601+0000", 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308194+0000", 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593066 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308290+0000", 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6405999999999998e-05 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308366+0000", 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5727000000000002e-05 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38586 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 6356992~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97487981499999998, 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021009344999999999, 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38586 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287613+0000", 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.43e-06 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287620+0000", 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0789999999999997e-06 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287630+0000", 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0328e-05 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308412+0000", 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782281999999999 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308505+0000", 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2492999999999997e-05 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308620+0000", 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115283 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38587 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7143424~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97485279700000005, 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021158300000000001, 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38587 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287641+0000", 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.836e-06 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287648+0000", 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7710000000000001e-06 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287652+0000", 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6450000000000004e-06 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308654+0000", 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021001899000000001 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308701+0000", 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6551000000000002e-05 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308796+0000", 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5192000000000006e-05 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38588 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7929856~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97483146600000004, 2024-09-11T06:18:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021338811999999999, 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38588 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287662+0000", 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1679999999999998e-06 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287668+0000", 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.302e-06 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287672+0000", 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308828+0000", 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02115616 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308890+0000", 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1845000000000002e-05 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308998+0000", 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010743000000000001 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38589 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 8716288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97481179200000001, 2024-09-11T06:18:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021462365000000001, 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38589 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287681+0000", 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2290000000000002e-06 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287687+0000", 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.784e-06 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287691+0000", 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309029+0000", 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021337805000000001 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309076+0000", 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-05 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309141+0000", 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5264000000000004e-05 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38590 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 9502720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97479281799999995, 2024-09-11T06:18:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021714906999999999, 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38590 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287700+0000", 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1490000000000001e-06 2024-09-11T06:18:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287706+0000", 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287711+0000", 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0429999999999998e-06 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309190+0000", 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021479043 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309284+0000", 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3968999999999994e-05 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309413+0000", 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012823700000000001 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38591 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 10289152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97477300099999997, 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021935667999999998, 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38591 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287718+0000", 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287726+0000", 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6829999999999997e-06 2024-09-11T06:18:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287734+0000", 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0079999999999996e-06 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287738+0000", 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309447+0000", 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021708284000000001 2024-09-11T06:18:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309534+0000", 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7379000000000005e-05 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309653+0000", 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011905600000000001 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38592 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11075584~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97474519299999995, 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022188494999999999, 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38592 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287746+0000", 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287748+0000", 2024-09-11T06:18:02.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3420000000000002e-06 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287754+0000", 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5259999999999999e-06 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287759+0000", 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4129999999999999e-06 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309724+0000", 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021965179000000001 2024-09-11T06:18:02.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309813+0000", 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8825000000000004e-05 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309934+0000", 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120809 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38593 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11862016~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.344 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.974725171, 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022391579000000002, 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38593 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:02.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287766+0000", 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287768+0000", 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1459999999999999e-06 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287774+0000", 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.421e-06 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287779+0000", 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4569999999999998e-06 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309967+0000", 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022187944000000001 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310048+0000", 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1528999999999998e-05 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310157+0000", 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108729 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.348 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38594 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 12648448~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97470528199999995, 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022597002000000001, 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38594 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287786+0000", 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4000000000000002e-07 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287788+0000", 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1239999999999999e-06 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287794+0000", 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.725e-06 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287799+0000", 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0139999999999998e-06 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310186+0000", 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022386306000000002 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310270+0000", 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4507999999999998e-05 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310382+0000", 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111885 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38595 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [read 13434880~23206 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.97468527299999996, 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022896125, 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38595 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:02.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287806+0000", 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:02.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287813+0000", 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.199e-06 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287819+0000", 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5950000000000004e-06 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287831+0000", 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1600000000000001e-05 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310413+0000", 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022582015 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310492+0000", 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9291999999999999e-05 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310701+0000", 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000209061 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.356 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:02.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:02.357 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:02.358 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:02.358 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:02.357+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:02.401 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-11T06:18:02.459 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:02.458+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:02.524 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:02.524 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:02.524 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:02.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:02.574 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:02.573+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:02.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:02.645 INFO:teuthology.orchestra.run.smithi070.stdout:2107 read 0xb93e903 thru 0xb9422d7 (0x39d5 bytes) 2024-09-11T06:18:02.645 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.646 INFO:teuthology.orchestra.run.smithi070.stdout:2109 write 0x15befed thru 0x15c13d5 (0x23e9 bytes) 2024-09-11T06:18:02.652 INFO:teuthology.orchestra.run.smithi070.stdout:2111 writesame 0xcfe774d thru 0xcff3c0f data_size 0x1(0xc4c3 bytes) 2024-09-11T06:18:02.660 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:02.659+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:02.675 INFO:teuthology.orchestra.run.smithi070.stdout:2113 read 0x1ff10a thru 0x20cb62 (0xda59 bytes) 2024-09-11T06:18:02.676 INFO:teuthology.orchestra.run.smithi070.stdout:2114 writesame 0x7ed1a7b thru 0x7edace6 data_size 0x2(0x926c bytes) 2024-09-11T06:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:02.684 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:02.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:02.696 INFO:teuthology.orchestra.run.smithi070.stdout:2118 trunc from 0xd49e516 to 0x5af6ee7 2024-09-11T06:18:02.719 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0xed50e78 2024-09-11T06:18:02.730 INFO:teuthology.orchestra.run.smithi070.stdout:2119 trunc from 0x5af6ee7 to 0xed50e78 2024-09-11T06:18:02.738 INFO:teuthology.orchestra.run.smithi070.stdout:2120 punch from 0x6f7525c to 0x6f8437a, (0xf11e bytes) 2024-09-11T06:18:02.740 INFO:teuthology.orchestra.run.smithi070.stdout:2121 trunc from 0xed50e78 to 0xd7c11ba 2024-09-11T06:18:02.745 INFO:teuthology.orchestra.run.smithi070.stdout:2122 writesame 0x92b0344 thru 0x92bf755 data_size 0x7(0xf412 bytes) 2024-09-11T06:18:02.751 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:18:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:2124 read 0xc75eb25 thru 0xc76b992 (0xce6e bytes) 2024-09-11T06:18:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:2125 read 0x3d4666d thru 0x3d54672 (0xe006 bytes) 2024-09-11T06:18:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:2127 trunc from 0xd7c11ba to 0x93737f9 2024-09-11T06:18:02.760 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:02.760+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:02.770 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:02.770 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:02.773 INFO:teuthology.orchestra.run.smithi070.stdout:2128 write 0xa47fe09 thru 0xa48dd04 (0xdefc bytes) 2024-09-11T06:18:02.778 INFO:teuthology.orchestra.run.smithi070.stdout:2131 write 0x5446 thru 0xc567 (0x7122 bytes) 2024-09-11T06:18:02.779 INFO:teuthology.orchestra.run.smithi070.stdout:2133 write 0x806c112 thru 0x8079e59 (0xdd48 bytes) 2024-09-11T06:18:02.782 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.782 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.782 INFO:teuthology.orchestra.run.smithi070.stdout:2137 read 0x10b508d thru 0x10c08af (0xb823 bytes) 2024-09-11T06:18:02.783 INFO:teuthology.orchestra.run.smithi070.stdout:2138 read 0x66ad876 thru 0x66b5914 (0x809f bytes) 2024-09-11T06:18:02.783 INFO:teuthology.orchestra.run.smithi070.stdout:2141 read 0x3a6a4fe thru 0x3a708d1 (0x63d4 bytes) 2024-09-11T06:18:02.783 INFO:teuthology.orchestra.run.smithi070.stdout:2142 read 0x78faf80 thru 0x7902b12 (0x7b93 bytes) 2024-09-11T06:18:02.784 INFO:teuthology.orchestra.run.smithi070.stdout:2143 write 0x3c665ae thru 0x3c759c5 (0xf418 bytes) 2024-09-11T06:18:02.788 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:02.789 INFO:teuthology.orchestra.run.smithi070.stdout:2144 trunc from 0xa48dd05 to 0x7b3fe06 2024-09-11T06:18:02.795 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.796 INFO:teuthology.orchestra.run.smithi070.stdout:2146 write 0x38f4076 thru 0x38fcc89 (0x8c14 bytes) 2024-09-11T06:18:02.805 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:02.810 INFO:teuthology.orchestra.run.smithi070.stdout:2151 write 0xd92707a thru 0xd931920 (0xa8a7 bytes) 2024-09-11T06:18:02.813 INFO:teuthology.orchestra.run.smithi070.stdout:2152 read 0xa63de3b thru 0xa64a676 (0xc83c bytes) 2024-09-11T06:18:02.814 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.814 INFO:teuthology.orchestra.run.smithi070.stdout:2156 read 0xa103e13 thru 0xa1063ac (0x259a bytes) 2024-09-11T06:18:02.814 INFO:teuthology.orchestra.run.smithi070.stdout:2157 punch from 0x2495e8c to 0x24a3cb0, (0xde24 bytes) 2024-09-11T06:18:02.815 INFO:teuthology.orchestra.run.smithi070.stdout:2158 writesame 0x9ecf36f thru 0x9edee3c data_size 0x52(0xface bytes) 2024-09-11T06:18:02.818 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.818 INFO:teuthology.orchestra.run.smithi070.stdout:2160 write 0x64c30d8 thru 0x64c4068 (0xf91 bytes) 2024-09-11T06:18:02.819 INFO:teuthology.orchestra.run.smithi070.stdout:2164 read 0x812b28f thru 0x812ba2a (0x79c bytes) 2024-09-11T06:18:02.819 INFO:teuthology.orchestra.run.smithi070.stdout:2165 punch from 0x1962bcc to 0x1962e6f, (0x2a3 bytes) 2024-09-11T06:18:02.819 INFO:teuthology.orchestra.run.smithi070.stdout:2166 write 0xb0455d thru 0xb0b632 (0x70d6 bytes) 2024-09-11T06:18:02.821 INFO:teuthology.orchestra.run.smithi070.stdout:2167 write 0x60ec43e thru 0x60f608d (0x9c50 bytes) 2024-09-11T06:18:02.822 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:02.822 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:02.823 INFO:teuthology.orchestra.run.smithi070.stdout:2168 write 0x2e87397 thru 0x2e87a68 (0x6d2 bytes) 2024-09-11T06:18:02.824 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.824 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.824 INFO:teuthology.orchestra.run.smithi070.stdout:2171 read 0x64884ff thru 0x648d201 (0x4d03 bytes) 2024-09-11T06:18:02.824 INFO:teuthology.orchestra.run.smithi070.stdout:2172 write 0xb8abccf thru 0xb8b2798 (0x6aca bytes) 2024-09-11T06:18:02.824 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:02.825 INFO:teuthology.orchestra.run.smithi070.stdout:2176 punch from 0x7b90495 to 0x7b9f078, (0xebe3 bytes) 2024-09-11T06:18:02.825 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.825 INFO:teuthology.orchestra.run.smithi070.stdout:2178 write 0x95be0b0 thru 0x95c02db (0x222c bytes) 2024-09-11T06:18:02.826 INFO:teuthology.orchestra.run.smithi070.stdout:2179 punch from 0xa4d7b78 to 0xa4da468, (0x28f0 bytes) 2024-09-11T06:18:02.832 INFO:teuthology.orchestra.run.smithi070.stdout:2180 writesame 0xdc44066 thru 0xdc4462a data_size 0x1(0x5c5 bytes) 2024-09-11T06:18:02.832 INFO:teuthology.orchestra.run.smithi070.stdout:2181 read 0xd0d11c9 thru 0xd0d2cdf (0x1b17 bytes) 2024-09-11T06:18:02.833 INFO:teuthology.orchestra.run.smithi070.stdout:2185 read 0x968b788 thru 0x96955b1 (0x9e2a bytes) 2024-09-11T06:18:02.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:02.834 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:02.839 INFO:teuthology.orchestra.run.smithi070.stdout:2189 trunc from 0xdc4462b to 0x86ad0e6 2024-09-11T06:18:02.842 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:02.842 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:02.850 INFO:teuthology.orchestra.run.smithi070.stdout:2191 punch from 0x3888935 to 0x388aedc, (0x25a7 bytes) 2024-09-11T06:18:02.850 INFO:teuthology.orchestra.run.smithi070.stdout:2193 read 0x5b5fc2b thru 0x5b688f5 (0x8ccb bytes) 2024-09-11T06:18:02.850 INFO:teuthology.orchestra.run.smithi070.stdout:2194 read 0x1730495 thru 0x1739a33 (0x959f bytes) 2024-09-11T06:18:02.851 INFO:teuthology.orchestra.run.smithi070.stdout:2196 read 0x4fbd176 thru 0x4fbd8f2 (0x77d bytes) 2024-09-11T06:18:02.851 INFO:teuthology.orchestra.run.smithi070.stdout:2197 punch from 0x5ec731 to 0x5ecfd4, (0x8a3 bytes) 2024-09-11T06:18:02.852 INFO:teuthology.orchestra.run.smithi070.stdout:2198 read 0x533441e thru 0x5335812 (0x13f5 bytes) 2024-09-11T06:18:02.852 INFO:teuthology.orchestra.run.smithi070.stdout:2200 read 0x4082648 thru 0x408fad2 (0xd48b bytes) 2024-09-11T06:18:02.852 INFO:teuthology.orchestra.run.smithi070.stdout:2202 write 0x2f33ee6 thru 0x2f3ccec (0x8e07 bytes) 2024-09-11T06:18:02.854 INFO:teuthology.orchestra.run.smithi070.stdout:2203 write 0x4b111c thru 0x4c001c (0xef01 bytes) 2024-09-11T06:18:02.856 INFO:teuthology.orchestra.run.smithi070.stdout:2209 punch from 0x40df3d2 to 0x40e1751, (0x237f bytes) 2024-09-11T06:18:02.860 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:02.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:02.860+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:02.864 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:02.864 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:02.869 INFO:teuthology.orchestra.run.smithi070.stdout:2210 writesame 0xe5a9107 thru 0xe5b630d data_size 0x1(0xd207 bytes) 2024-09-11T06:18:02.869 INFO:teuthology.orchestra.run.smithi070.stdout:2211 read 0x103b3ba thru 0x104687a (0xb4c1 bytes) 2024-09-11T06:18:02.870 INFO:teuthology.orchestra.run.smithi070.stdout:2212 writesame 0x2fff0fb thru 0x3008e5d data_size 0x1(0x9d63 bytes) 2024-09-11T06:18:02.887 INFO:teuthology.orchestra.run.smithi070.stdout:2213 writesame 0xdf32d3c thru 0xdf334c2 data_size 0x1(0x787 bytes) 2024-09-11T06:18:02.890 INFO:teuthology.orchestra.run.smithi070.stdout:2214 write 0xb6f1310 thru 0xb6f78c1 (0x65b2 bytes) 2024-09-11T06:18:02.894 INFO:teuthology.orchestra.run.smithi070.stdout:2215 punch from 0x304225e to 0x304d1a7, (0xaf49 bytes) 2024-09-11T06:18:02.894 INFO:teuthology.orchestra.run.smithi070.stdout:2216 write 0x3bc106b thru 0x3bc8d66 (0x7cfc bytes) 2024-09-11T06:18:02.900 INFO:teuthology.orchestra.run.smithi070.stdout:2217 write 0xe9f5ff4 thru 0xe9f816d (0x217a bytes) 2024-09-11T06:18:02.903 INFO:teuthology.orchestra.run.smithi070.stdout:2218 clone 14 order 21 su 32768 sc 14 2024-09-11T06:18:02.946 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:02.946 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:02.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:02.961 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:02.960+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:03.062 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:03.062+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:03.097 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:03.097 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:03.106 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:03.163 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:03.163+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:03.208 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:03.209 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:03.217 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:03.260 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:18:03.264 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:03.263+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:03.331 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:03.331 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:03.340 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:03.365 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:03.365+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:03.442 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:03.442 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:03.450 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:03.495 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:03.494+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:03.553 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:03.553 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:03.562 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:03.603 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:03.602+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:03.666 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:03.666+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:03.706 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:03.706 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:03.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:03.798 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:03.798+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:03.858 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:03.858 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:03.866 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:03.868 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:03.867+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:03.968 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:03.968+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:04.011 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:04.011 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:04.019 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:04.104 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:04.103+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:04.164 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:04.164 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:04.169 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:04.169+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:04.173 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:04.270 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:04.270+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:04.353 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:04.353 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:04.367 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:04.409 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:04.408+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:04.473 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:04.472+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:04.573 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:04.573+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:04.591 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:04.591 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:04.604 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:04.674 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:04.673+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:04.748 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:04.748 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:04.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:04.799 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:04.799+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:04.858 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:04.858 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:04.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:04.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:04.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:04.907+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:04.977 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:04.976+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:04.985 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:04.986 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:04.986 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:18:05.002 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:05.035 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:05.035 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:05.036 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:05.036 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:05.037 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:05.050 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:05.051 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:05.067 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:05.068 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:05.077 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:05.076+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:05.084 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:05.084 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:05.088 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:05.088 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:05.142 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:05.143 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:05.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:05.178 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:05.178+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:05.253 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:05.253 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:05.260 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-11T06:18:05.261 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:18:05.261 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-11T06:18:05.261 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T06:18:05.261 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T06:18:05.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-11T06:18:05.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:05.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:18:05.305 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:05.304+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:05.380 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:05.380+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:05.415 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T06:18:05.415 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.731525353999999, 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:18:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:18:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:18:05.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:05.422 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.611529116, 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:05.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:05.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:05.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:05.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28882 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3637248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.044684154999999, 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020043653000000002, 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28882 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:05.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000002e-07 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370273+0000", 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4075e-05 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370280+0000", 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.007e-06 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370286+0000", 2024-09-11T06:18:05.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3380000000000004e-06 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390099+0000", 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019812923999999999 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390172+0000", 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3375999999999997e-05 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390303+0000", 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130512 2024-09-11T06:18:05.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28883 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.044648814999999, 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020291813999999998, 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28883 2024-09-11T06:18:05.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370295+0000", 2024-09-11T06:18:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370297+0000", 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.21e-06 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370303+0000", 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4479999999999999e-06 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370309+0000", 2024-09-11T06:18:05.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3040000000000004e-06 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390350+0000", 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020040842 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390438+0000", 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8446e-05 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390586+0000", 2024-09-11T06:18:05.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014808399999999999 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38581 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1275899730000001, 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020052018000000001, 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38581 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287354+0000", 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287356+0000", 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4030000000000001e-06 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287362+0000", 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9710000000000001e-06 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287367+0000", 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307187+0000", 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019820397999999999 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307279+0000", 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1417999999999998e-05 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307405+0000", 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126265 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38582 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3211264~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.127568492, 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020273138999999999, 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38582 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287377+0000", 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0990000000000001e-06 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287383+0000", 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287388+0000", 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8149999999999996e-06 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307438+0000", 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020050081000000001 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307527+0000", 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9476999999999997e-05 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307648+0000", 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120226 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38583 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3997696~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.127549256, 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020512203999999999, 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38583 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287401+0000", 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1500000000000002e-06 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287408+0000", 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1750000000000002e-06 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287413+0000", 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0640000000000001e-06 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307690+0000", 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020277067999999999 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307779+0000", 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9071000000000002e-05 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307906+0000", 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012727600000000001 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38584 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 4784128~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.448 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1275234210000002, 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020729899, 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38584 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:05.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287422+0000", 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1560000000000002e-06 2024-09-11T06:18:05.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287427+0000", 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2299999999999999e-06 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287439+0000", 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1263999999999999e-05 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307939+0000", 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020499962 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308026+0000", 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7787000000000005e-05 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308150+0000", 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123082 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38585 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 5570560~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.452 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1273599330000001, 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782914, 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38585 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:05.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287584+0000", 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-07 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287587+0000", 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3979999999999999e-06 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287595+0000", 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6899999999999992e-06 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287601+0000", 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308194+0000", 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593066 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308290+0000", 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6405999999999998e-05 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308366+0000", 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5727000000000002e-05 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38586 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 6356992~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1273324689999997, 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021009344999999999, 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38586 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287613+0000", 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.43e-06 2024-09-11T06:18:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287620+0000", 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0789999999999997e-06 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287630+0000", 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0328e-05 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308412+0000", 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782281999999999 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308505+0000", 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2492999999999997e-05 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308620+0000", 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115283 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38587 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7143424~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1273054509999998, 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021158300000000001, 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38587 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287641+0000", 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.836e-06 2024-09-11T06:18:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287648+0000", 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7710000000000001e-06 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287652+0000", 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6450000000000004e-06 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308654+0000", 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021001899000000001 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308701+0000", 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6551000000000002e-05 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308796+0000", 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5192000000000006e-05 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38588 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7929856~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1272841199999997, 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021338811999999999, 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38588 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287662+0000", 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1679999999999998e-06 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287668+0000", 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.302e-06 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287672+0000", 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308828+0000", 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02115616 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308890+0000", 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1845000000000002e-05 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308998+0000", 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010743000000000001 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38589 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 8716288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1272644459999999, 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021462365000000001, 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38589 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287681+0000", 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2290000000000002e-06 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287687+0000", 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.784e-06 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287691+0000", 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309029+0000", 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021337805000000001 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309076+0000", 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-05 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309141+0000", 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5264000000000004e-05 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38590 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 9502720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1272454720000002, 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021714906999999999, 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38590 2024-09-11T06:18:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287700+0000", 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1490000000000001e-06 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287706+0000", 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287711+0000", 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0429999999999998e-06 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309190+0000", 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021479043 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309284+0000", 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3968999999999994e-05 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309413+0000", 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012823700000000001 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38591 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 10289152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1272256550000002, 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021935667999999998, 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38591 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287718+0000", 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287726+0000", 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6829999999999997e-06 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287734+0000", 2024-09-11T06:18:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0079999999999996e-06 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287738+0000", 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309447+0000", 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021708284000000001 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309534+0000", 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7379000000000005e-05 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309653+0000", 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011905600000000001 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38592 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11075584~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1271978469999997, 2024-09-11T06:18:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022188494999999999, 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38592 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287746+0000", 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287748+0000", 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3420000000000002e-06 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287754+0000", 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5259999999999999e-06 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287759+0000", 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4129999999999999e-06 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309724+0000", 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021965179000000001 2024-09-11T06:18:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309813+0000", 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8825000000000004e-05 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309934+0000", 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120809 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38593 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11862016~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1271778250000004, 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022391579000000002, 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38593 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287766+0000", 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287768+0000", 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1459999999999999e-06 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287774+0000", 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.421e-06 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287779+0000", 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4569999999999998e-06 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309967+0000", 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022187944000000001 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310048+0000", 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1528999999999998e-05 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310157+0000", 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108729 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38594 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 12648448~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1271579359999997, 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022597002000000001, 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38594 2024-09-11T06:18:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287786+0000", 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4000000000000002e-07 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287788+0000", 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1239999999999999e-06 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287794+0000", 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.725e-06 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287799+0000", 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0139999999999998e-06 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310186+0000", 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022386306000000002 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310270+0000", 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4507999999999998e-05 2024-09-11T06:18:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310382+0000", 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111885 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38595 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [read 13434880~23206 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1271379269999997, 2024-09-11T06:18:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022896125, 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38595 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287806+0000", 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287813+0000", 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.199e-06 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287819+0000", 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5950000000000004e-06 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287831+0000", 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1600000000000001e-05 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310413+0000", 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022582015 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310492+0000", 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9291999999999999e-05 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310701+0000", 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000209061 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:39792 3.15 3:ac0e7d03:::rbd_data.116db5c39c9d.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.7599051270000001, 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020275054000000001, 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39792 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655040+0000", 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1610000000000001e-06 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655051+0000", 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1126e-05 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655069+0000", 2024-09-11T06:18:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8039000000000001e-05 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655080+0000", 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0852999999999999e-05 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655160+0000", 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0135000000000004e-05 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655320+0000", 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160166 2024-09-11T06:18:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.658973+0000", 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003652335 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675201+0000", 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016227772000000001 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675214+0000", 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3508e-05 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675255+0000", 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0636999999999997e-05 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675313+0000", 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8322000000000002e-05 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:05.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:05.507 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-11T06:18:05.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:05.505+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:05.607 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:05.606+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:05.624 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:05.624 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:05.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:05.699 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:05.699 INFO:teuthology.orchestra.run.smithi070.stdout:2221 writesame 0x68b59dc thru 0x68c0c85 data_size 0x4d(0xb2aa bytes) 2024-09-11T06:18:05.704 INFO:teuthology.orchestra.run.smithi070.stdout:2222 write 0x4ffd1a8 thru 0x5009bd2 (0xca2b bytes) 2024-09-11T06:18:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:2223 read 0x8a51cc5 thru 0x8a55082 (0x33be bytes) 2024-09-11T06:18:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:2224 read 0x5a98caa thru 0x5a9fdeb (0x7142 bytes) 2024-09-11T06:18:05.707 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:05.706+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:2225 writesame 0xae29ba1 thru 0xae2e363 data_size 0x1(0x47c3 bytes) 2024-09-11T06:18:05.717 INFO:teuthology.orchestra.run.smithi070.stdout:2227 read 0x583c7e7 thru 0x5840b89 (0x43a3 bytes) 2024-09-11T06:18:05.718 INFO:teuthology.orchestra.run.smithi070.stdout:2228 writesame 0x8fc9488 thru 0x8fca160 data_size 0xd(0xcd9 bytes) 2024-09-11T06:18:05.719 INFO:teuthology.orchestra.run.smithi070.stdout:2229 writesame 0xcd625d5 thru 0xcd6e233 data_size 0x7(0xbc5f bytes) 2024-09-11T06:18:05.723 INFO:teuthology.orchestra.run.smithi070.stdout:2230 read 0x740d1b1 thru 0x7416e39 (0x9c89 bytes) 2024-09-11T06:18:05.723 INFO:teuthology.orchestra.run.smithi070.stdout:2231 write 0x68aeb88 thru 0x68afc3b (0x10b4 bytes) 2024-09-11T06:18:05.730 INFO:teuthology.orchestra.run.smithi070.stdout:2232 write 0x1030c1 thru 0x10ea80 (0xb9c0 bytes) 2024-09-11T06:18:05.731 INFO:teuthology.orchestra.run.smithi070.stdout:2234 read 0x9418714 thru 0x9420ed5 (0x87c2 bytes) 2024-09-11T06:18:05.732 INFO:teuthology.orchestra.run.smithi070.stdout:2235 writesame 0x215df9a thru 0x2167251 data_size 0x3c(0x92b8 bytes) 2024-09-11T06:18:05.734 INFO:teuthology.orchestra.run.smithi070.stdout:2236 read 0xcf30af7 thru 0xcf3516e (0x4678 bytes) 2024-09-11T06:18:05.734 INFO:teuthology.orchestra.run.smithi070.stdout:2237 writesame 0x6f18dd1 thru 0x6f1de45 data_size 0x1(0x5075 bytes) 2024-09-11T06:18:05.742 INFO:teuthology.orchestra.run.smithi070.stdout:2239 write 0x95e1b0e thru 0x95e59c0 (0x3eb3 bytes) 2024-09-11T06:18:05.743 INFO:teuthology.orchestra.run.smithi070.stdout:2241 punch from 0xd605243 to 0xd6144a3, (0xf260 bytes) 2024-09-11T06:18:05.743 INFO:teuthology.orchestra.run.smithi070.stdout:2242 writesame 0x909f428 thru 0x90ad407 data_size 0x90(0xdfe0 bytes) 2024-09-11T06:18:05.745 INFO:teuthology.orchestra.run.smithi070.stdout:2244 write 0xc7aa59e thru 0xc7aabf2 (0x655 bytes) 2024-09-11T06:18:05.753 INFO:teuthology.orchestra.run.smithi070.stdout:2245 trunc from 0xe9f816e to 0x8f48a5d 2024-09-11T06:18:05.774 INFO:teuthology.orchestra.run.smithi070.stdout:2247 punch from 0x3d00273 to 0x3d0ddf6, (0xdb83 bytes) 2024-09-11T06:18:05.786 INFO:teuthology.orchestra.run.smithi070.stdout:2249 writesame 0xd93a609 thru 0xd94a1a2 data_size 0x39(0xfb9a bytes) 2024-09-11T06:18:05.786 INFO:teuthology.orchestra.run.smithi070.stdout:2251 trunc from 0xd94a1a3 to 0xd9ba751 2024-09-11T06:18:05.789 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:05.789 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:05.789 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:05.789 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:05.789 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:05.791 INFO:teuthology.orchestra.run.smithi070.stdout:2253 read 0x437d8ab thru 0x4381010 (0x3766 bytes) 2024-09-11T06:18:05.792 INFO:teuthology.orchestra.run.smithi070.stdout:2254 punch from 0x1d9eeb8 to 0x1da54e9, (0x6631 bytes) 2024-09-11T06:18:05.792 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:05.792 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:05.792 INFO:teuthology.orchestra.run.smithi070.stdout:2257 read 0x40de66b thru 0x40e96bd (0xb053 bytes) 2024-09-11T06:18:05.792 INFO:teuthology.orchestra.run.smithi070.stdout:2258 writesame 0x2cca5cb thru 0x2ccf2a4 data_size 0x9(0x4cda bytes) 2024-09-11T06:18:05.794 INFO:teuthology.orchestra.run.smithi070.stdout:2259 write 0x277c0a3 thru 0x2782bce (0x6b2c bytes) 2024-09-11T06:18:05.796 INFO:teuthology.orchestra.run.smithi070.stdout:2260 writesame 0x5cfad4b thru 0x5d09a0b data_size 0x59(0xecc1 bytes) 2024-09-11T06:18:05.797 INFO:teuthology.orchestra.run.smithi070.stdout:2261 read 0x98daf8f thru 0x98df93e (0x49b0 bytes) 2024-09-11T06:18:05.798 INFO:teuthology.orchestra.run.smithi070.stdout:2263 punch from 0xe3e567 to 0xe44869, (0x6302 bytes) 2024-09-11T06:18:05.798 INFO:teuthology.orchestra.run.smithi070.stdout:2265 read 0x480eb4c thru 0x481251e (0x39d3 bytes) 2024-09-11T06:18:05.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:05.799 INFO:teuthology.orchestra.run.smithi070.stdout:2266 read 0xca6b684 thru 0xca71c67 (0x65e4 bytes) 2024-09-11T06:18:05.800 INFO:teuthology.orchestra.run.smithi070.stdout:2267 write 0x1b805d7 thru 0x1b88eba (0x88e4 bytes) 2024-09-11T06:18:05.800 INFO:teuthology.orchestra.run.smithi070.stdout:2268 write 0x57d9b86 thru 0x57e0006 (0x6481 bytes) 2024-09-11T06:18:05.802 INFO:teuthology.orchestra.run.smithi070.stdout:2270 read 0x3cc3ae1 thru 0x3cc449b (0x9bb bytes) 2024-09-11T06:18:05.802 INFO:teuthology.orchestra.run.smithi070.stdout:2271 read 0x456de2a thru 0x4576dd9 (0x8fb0 bytes) 2024-09-11T06:18:05.802 INFO:teuthology.orchestra.run.smithi070.stdout:2272 read 0xb23d103 thru 0xb246cd6 (0x9bd4 bytes) 2024-09-11T06:18:05.802 INFO:teuthology.orchestra.run.smithi070.stdout:2273 read 0x33c72ef thru 0x33cacaf (0x39c1 bytes) 2024-09-11T06:18:05.803 INFO:teuthology.orchestra.run.smithi070.stdout:2274 writesame 0x56b2e8f thru 0x56b946f data_size 0x1(0x65e1 bytes) 2024-09-11T06:18:05.808 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:05.807+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:05.828 INFO:teuthology.orchestra.run.smithi070.stdout:2275 trunc from 0xd9ba751 to 0x1b2d155 2024-09-11T06:18:05.877 INFO:teuthology.orchestra.run.smithi070.stdout:2276 write 0xdfbd7e4 thru 0xdfcc91e (0xf13b bytes) 2024-09-11T06:18:05.881 INFO:teuthology.orchestra.run.smithi070.stdout:2277 punch from 0x49b920 to 0x49bc8b, (0x36b bytes) 2024-09-11T06:18:05.881 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:05.881 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:05.881 INFO:teuthology.orchestra.run.smithi070.stdout:2280 write 0x221ddaf thru 0x222b1fc (0xd44e bytes) 2024-09-11T06:18:05.886 INFO:teuthology.orchestra.run.smithi070.stdout:2281 punch from 0xc128210 to 0xc138111, (0xff01 bytes) 2024-09-11T06:18:05.886 INFO:teuthology.orchestra.run.smithi070.stdout:2282 punch from 0xa5a1990 to 0xa5b0e25, (0xf495 bytes) 2024-09-11T06:18:05.886 INFO:teuthology.orchestra.run.smithi070.stdout:2283 read 0xb03b9e8 thru 0xb03ec8f (0x32a8 bytes) 2024-09-11T06:18:05.886 INFO:teuthology.orchestra.run.smithi070.stdout:2284 writesame 0x3be92 thru 0x4062a data_size 0x1(0x4799 bytes) 2024-09-11T06:18:05.891 INFO:teuthology.orchestra.run.smithi070.stdout:2285 read 0xc35d4ce thru 0xc35d7a2 (0x2d5 bytes) 2024-09-11T06:18:05.892 INFO:teuthology.orchestra.run.smithi070.stdout:2286 clone 15 order 24 su 524288 sc 13 2024-09-11T06:18:05.909 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:05.908+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2271 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.660564759000003, 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012468982999999999, 2024-09-11T06:18:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258004+0000", 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6419999999999999e-06 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258011+0000", 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4599999999999997e-06 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258025+0000", 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3804e-05 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258033+0000", 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4239999999999993e-06 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258089+0000", 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.588e-05 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258147+0000", 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000002e-05 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.260204+0000", 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020570269999999999 2024-09-11T06:18:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270393+0000", 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010188657 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270403+0000", 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270437+0000", 2024-09-11T06:18:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3373e-05 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270471+0000", 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4073999999999999e-05 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2403 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.476927858000003, 2024-09-11T06:18:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018324528999999999, 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2403 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441640+0000", 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441646+0000", 2024-09-11T06:18:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441656+0000", 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0257e-05 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441661+0000", 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0549999999999999e-06 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441710+0000", 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8446999999999999e-05 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441761+0000", 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1060999999999998e-05 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.444470+0000", 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027092539999999999 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459870+0000", 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015399629 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459881+0000", 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1382e-05 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459926+0000", 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4505000000000002e-05 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459963+0000", 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7759999999999998e-05 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28475 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2834432~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.574178031999999, 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011213330000000001, 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28475 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6899999999999997e-07 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344391+0000", 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2050000000000001e-06 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344398+0000", 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3380000000000001e-06 2024-09-11T06:18:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344403+0000", 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.882e-06 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355471+0000", 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011068056 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355528+0000", 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6821999999999999e-05 2024-09-11T06:18:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355602+0000", 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4457999999999998e-05 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28476 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3162112~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.574158028999999, 2024-09-11T06:18:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464858, 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28476 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3700000000000001e-07 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344411+0000", 2024-09-11T06:18:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.052e-06 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344417+0000", 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344422+0000", 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7589999999999997e-06 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355649+0000", 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011227305999999999 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355742+0000", 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2974999999999997e-05 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355874+0000", 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013158000000000001 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28477 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3489792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.574138690000002, 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011629143999999999, 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28477 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344429+0000", 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.06e-07 2024-09-11T06:18:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344445+0000", 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6001000000000001e-05 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344451+0000", 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9569999999999996e-06 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344456+0000", 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8350000000000003e-06 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355921+0000", 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464919 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355991+0000", 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9424000000000005e-05 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356057+0000", 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6501999999999994e-05 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28478 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3817472~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.574102733, 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011937405, 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28478 2024-09-11T06:18:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000003e-07 2024-09-11T06:18:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344467+0000", 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344473+0000", 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344478+0000", 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8720000000000001e-06 2024-09-11T06:18:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356268+0000", 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011790629 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356317+0000", 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8594999999999998e-05 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356401+0000", 2024-09-11T06:18:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4469999999999996e-05 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28479 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4145152~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.574082532999999, 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012172307, 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28479 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344485+0000", 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344486+0000", 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.894e-06 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344493+0000", 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344497+0000", 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.464e-06 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356440+0000", 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011942790999999999 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356532+0000", 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2093000000000001e-05 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356656+0000", 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012460800000000001 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28824 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3129344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.552407077000002, 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011315202, 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28824 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366162+0000", 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8360000000000001e-06 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366167+0000", 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366172+0000", 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377208+0000", 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011035872 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377326+0000", 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118474 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377475+0000", 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148675 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28825 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3342336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.552389166000001, 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011577013000000001, 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28825 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366180+0000", 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7880000000000001e-06 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366185+0000", 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7309999999999998e-06 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366190+0000", 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377508+0000", 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011317763 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377595+0000", 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6674000000000004e-05 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377755+0000", 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015964899999999999 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28826 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3457024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.552370406000001, 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011917782, 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28826 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366197+0000", 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-07 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366233+0000", 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6746999999999999e-05 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366283+0000", 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9579000000000001e-05 2024-09-11T06:18:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366289+0000", 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8799999999999996e-06 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377787+0000", 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011498058 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378003+0000", 2024-09-11T06:18:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215553 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378114+0000", 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111576 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28827 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3670016~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.552267554, 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012035376, 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28827 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366300+0000", 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000004e-07 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366307+0000", 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5850000000000002e-06 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366315+0000", 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4290000000000004e-06 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366319+0000", 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6310000000000002e-06 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378147+0000", 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011827725000000001 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378228+0000", 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1207999999999999e-05 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378335+0000", 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010620699999999999 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28828 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3784704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.552240415, 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012221928999999999, 2024-09-11T06:18:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28828 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366327+0000", 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366359+0000", 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2202000000000001e-05 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366415+0000", 2024-09-11T06:18:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5828000000000001e-05 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366425+0000", 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0176e-05 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378366+0000", 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011941139 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378446+0000", 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0144999999999999e-05 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378548+0000", 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010201599999999999 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28829 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3997696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.552131334999999, 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012320490999999999, 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28829 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366436+0000", 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2200000000000003e-07 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366439+0000", 2024-09-11T06:18:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366446+0000", 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9580000000000001e-06 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366451+0000", 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378579+0000", 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012127816 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378660+0000", 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1391999999999996e-05 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378756+0000", 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5610000000000001e-05 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28830 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4112384~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.552107692, 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012505113, 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28830 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366461+0000", 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0159999999999998e-06 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366467+0000", 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7679999999999997e-06 2024-09-11T06:18:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366472+0000", 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378786+0000", 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012313783 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378863+0000", 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7307999999999999e-05 2024-09-11T06:18:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378964+0000", 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101242 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28832 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.550512155, 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011082763000000001, 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28832 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368056+0000", 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6500000000000008e-07 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368060+0000", 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3800000000000004e-06 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368069+0000", 2024-09-11T06:18:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0280000000000006e-06 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368076+0000", 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0690000000000004e-06 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378995+0000", 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010918638 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379071+0000", 2024-09-11T06:18:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379137+0000", 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6068000000000005e-05 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28892 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.548086065, 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011111242, 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28892 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6699999999999999e-07 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370483+0000", 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7320000000000001e-06 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370609+0000", 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012621900000000001 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370907+0000", 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029802600000000001 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381393+0000", 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010486430999999999 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381481+0000", 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7565999999999995e-05 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381592+0000", 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110901 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28895 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3686400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.547526048000002, 2024-09-11T06:18:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011282359, 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28895 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4799999999999999e-07 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371047+0000", 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371055+0000", 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6149999999999999e-06 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371060+0000", 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.853e-06 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382125+0000", 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011064978 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382209+0000", 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3665000000000006e-05 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382323+0000", 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001145 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28896 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4014080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.547499493, 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011490497000000001, 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28896 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371068+0000", 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371070+0000", 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.091e-06 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371076+0000", 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4389999999999997e-06 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371080+0000", 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2350000000000001e-06 2024-09-11T06:18:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382360+0000", 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011279811000000001 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382447+0000", 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7306999999999996e-05 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382558+0000", 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110216 2024-09-11T06:18:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:33858 3.1 e66/24 3:813e6a9a:::rbd_header.116de94696bd:head v 66'309, mlcod=65'307)", 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.701454135000001, 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.031257166000000003, 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7700000000000001e-07 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217117+0000", 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247505+0000", 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030387882000000001 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247521+0000", 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5610000000000001e-05 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247591+0000", 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0219e-05 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247617+0000", 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6393999999999998e-05 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248310+0000", 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000693094 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248370+0000", 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9338e-05 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:37167 3.14 e71/24 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:head v 71'56, mlcod=69'54)", 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6295260349999996, 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020546310000000002, 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0699999999999998e-07 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298061+0000", 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090201050000000005 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298090+0000", 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8428e-05 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298101+0000", 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1426999999999999e-05 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298180+0000", 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9118999999999999e-05 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298208+0000", 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7798999999999999e-05 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.309523+0000", 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011315488 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.309587+0000", 2024-09-11T06:18:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3637000000000001e-05 2024-09-11T06:18:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.007 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:06.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:06.049 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:06.048+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:06.110 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:06.110+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:06.150 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:06.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:06.212 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:06.211+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:06.261 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:06.261 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:06.261 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:06.261 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:06.261 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:06.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:06.275 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:18:06.331 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:06.330+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.756372032000002, 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.461936453999996, 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16929 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.18726539, 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041025210999999999, 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16929 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188737+0000", 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0380000000000001e-06 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188740+0000", 2024-09-11T06:18:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188744+0000", 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229575+0000", 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040831329 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229656+0000", 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0924e-05 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229761+0000", 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105171 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16930 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.187251727000003, 2024-09-11T06:18:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041241585999999997, 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16930 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188752+0000", 2024-09-11T06:18:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188758+0000", 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188762+0000", 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229808+0000", 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041046760000000002 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229854+0000", 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5365999999999999e-05 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229991+0000", 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013750200000000001 2024-09-11T06:18:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:37167 3.14 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:head [write 0~16777216 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0992310589999992, 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041724397000000003, 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 37167 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276774+0000", 2024-09-11T06:18:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3060000000000002e-06 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288416+0000", 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011642196 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288457+0000", 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1338999999999998e-05 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288476+0000", 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8698999999999998e-05 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288593+0000", 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116768 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288719+0000", 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012601800000000001 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288853+0000", 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013385400000000001 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.315769+0000", 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.026916852000000002 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318371+0000", 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026017319999999998 2024-09-11T06:18:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318433+0000", 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2248000000000004e-05 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318495+0000", 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1384999999999996e-05 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38415 3.14 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:1b [sparse-read 11534336~65536 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0305973789999996, 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040891906999999998, 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38415 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345405+0000", 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345406+0000", 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345412+0000", 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345417+0000", 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5950000000000001e-06 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386024+0000", 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040607277999999997 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386117+0000", 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2938999999999999e-05 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386296+0000", 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017890199999999999 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38416 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.030568358, 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040903255999999999, 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38416 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345434+0000", 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4899999999999995e-07 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345436+0000", 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345442+0000", 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345447+0000", 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386328+0000", 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040880623999999997 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386336+0000", 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5909999999999996e-06 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38417 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0305474219999997, 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040914271000000002, 2024-09-11T06:18:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38417 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345456+0000", 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.815e-06 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345462+0000", 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5790000000000003e-06 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345467+0000", 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6770000000000003e-06 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386360+0000", 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040893850000000002 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386368+0000", 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9689999999999994e-06 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38418 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0305279299999999, 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040926387000000002, 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38418 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9900000000000002e-07 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345476+0000", 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8479999999999999e-06 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345481+0000", 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7049999999999996e-06 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345486+0000", 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5260000000000004e-06 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386392+0000", 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040906388000000002 2024-09-11T06:18:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386400+0000", 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6210000000000004e-06 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38419 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0305044319999999, 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040920515999999997, 2024-09-11T06:18:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38419 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345498+0000", 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6199999999999998e-07 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345500+0000", 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9230000000000001e-06 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345505+0000", 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949999999999997e-06 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345517+0000", 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878e-05 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386413+0000", 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040895542 2024-09-11T06:18:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386418+0000", 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.916e-06 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38420 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.030463825, 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040904779000000002, 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38420 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-07 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345540+0000", 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0779999999999998e-06 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345546+0000", 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7830000000000004e-06 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345551+0000", 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2650000000000004e-06 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386436+0000", 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040884283 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386442+0000", 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8059999999999997e-06 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38421 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.030434423, 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040905730000000001, 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38421 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345568+0000", 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.82e-07 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345577+0000", 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1589999999999999e-06 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345584+0000", 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9519999999999997e-06 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345589+0000", 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7589999999999997e-06 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386465+0000", 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040876598 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386473+0000", 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38422 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0304051000000003, 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040898500999999997, 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38422 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345597+0000", 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9400000000000005e-07 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345603+0000", 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5890000000000002e-06 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345609+0000", 2024-09-11T06:18:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0460000000000002e-06 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345618+0000", 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7939999999999997e-06 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386491+0000", 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040872261999999999 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386495+0000", 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.216e-06 2024-09-11T06:18:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38423 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0303762010000002, 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040888315000000001, 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38423 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345626+0000", 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345628+0000", 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2649999999999999e-06 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345634+0000", 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6330000000000001e-06 2024-09-11T06:18:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345638+0000", 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8789999999999996e-06 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386508+0000", 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040870746999999999 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386514+0000", 2024-09-11T06:18:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38424 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0303451050000003, 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040887463999999998, 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38424 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345657+0000", 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7899999999999998e-07 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345659+0000", 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345665+0000", 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3670000000000002e-06 2024-09-11T06:18:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345670+0000", 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6840000000000004e-06 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386537+0000", 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040867045999999997 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386544+0000", 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6850000000000004e-06 2024-09-11T06:18:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38425 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0303189819999998, 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040890702000000001, 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38425 2024-09-11T06:18:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345685+0000", 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0660000000000002e-06 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345691+0000", 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7429999999999999e-06 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345703+0000", 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2520999999999999e-05 2024-09-11T06:18:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386564+0000", 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040861055 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386573+0000", 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8980000000000002e-06 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38426 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0302913760000001, 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040892365999999999, 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38426 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345711+0000", 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7000000000000005e-07 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345713+0000", 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.153e-06 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345721+0000", 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7829999999999999e-06 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345726+0000", 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.045e-06 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386597+0000", 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040871636000000003 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386602+0000", 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38427 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0302697500000004, 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040905245999999999, 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38427 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345734+0000", 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9290000000000001e-06 2024-09-11T06:18:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345741+0000", 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5270000000000004e-06 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345745+0000", 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0409999999999999e-06 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386629+0000", 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040883905999999998 2024-09-11T06:18:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386637+0000", 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4800000000000001e-06 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38428 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0302375689999996, 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040899389000000001, 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38428 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345765+0000", 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1200000000000002e-07 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345767+0000", 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6359999999999998e-06 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345774+0000", 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4330000000000001e-06 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345779+0000", 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6919999999999999e-06 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386657+0000", 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040877865999999999 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386663+0000", 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38429 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0302011289999999, 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040891017000000002, 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38429 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345801+0000", 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345803+0000", 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345809+0000", 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.229e-06 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345827+0000", 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7907e-05 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386683+0000", 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040855626999999999 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386691+0000", 2024-09-11T06:18:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.602e-06 2024-09-11T06:18:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:06.462 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:06.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:06.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:06.462+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:06.564 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:06.563+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:06.567 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:06.567 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:06.567 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:06.576 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:06.664 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:06.664+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:06.720 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:06.720 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:06.720 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:06.720 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:06.720 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:06.728 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:06.770 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:06.769+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:06.866 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:06.865+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:06.873 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.556017040999997, 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.243443823, 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16521 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 114688~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.696590370999999, 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095026380000000008, 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16521 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175432+0000", 2024-09-11T06:18:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175438+0000", 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175445+0000", 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2219999999999996e-06 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184800+0000", 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009354322 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184848+0000", 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8398e-05 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184932+0000", 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4132e-05 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16522 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 151552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.696499168999999, 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096235079999999994, 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16522 2024-09-11T06:18:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175522+0000", 2024-09-11T06:18:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1099999999999995e-07 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175525+0000", 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.619e-06 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175535+0000", 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6590000000000002e-06 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175542+0000", 2024-09-11T06:18:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2570000000000001e-06 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184976+0000", 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094335619999999995 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185064+0000", 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8530999999999997e-05 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185144+0000", 2024-09-11T06:18:06.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0168999999999998e-05 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16523 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 188416~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.696467706999996, 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099147300000000001, 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16523 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175553+0000", 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175561+0000", 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5369999999999997e-06 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175571+0000", 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7480000000000005e-06 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175577+0000", 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-06 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185174+0000", 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095965570000000004 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185253+0000", 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8889999999999999e-05 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185467+0000", 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021430099999999999 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16524 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.696433710000001, 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010599717999999999, 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.898 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16524 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:06.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175587+0000", 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175589+0000", 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175596+0000", 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175601+0000", 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185553+0000", 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099520630000000006 2024-09-11T06:18:06.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185649+0000", 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6086000000000001e-05 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186186+0000", 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053697800000000002 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16553 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695684319999998, 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010060193, 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16553 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:18:06.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176340+0000", 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.405e-06 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176348+0000", 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8199999999999997e-06 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176354+0000", 2024-09-11T06:18:06.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186219+0000", 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098650109999999999 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186298+0000", 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9383999999999998e-05 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186396+0000", 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7387999999999997e-05 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16554 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695657204, 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010247795000000001, 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16554 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176364+0000", 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5799999999999998e-07 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176366+0000", 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176373+0000", 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4289999999999998e-06 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176377+0000", 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186427+0000", 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010049742 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186511+0000", 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3991000000000003e-05 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186611+0000", 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9565e-05 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16555 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695634990000002, 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010729601, 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16555 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176386+0000", 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176388+0000", 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176395+0000", 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:18:06.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176400+0000", 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186644+0000", 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010244052 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186742+0000", 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8159999999999995e-05 2024-09-11T06:18:06.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187115+0000", 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037263900000000002 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16593 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695584670999999, 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011057091, 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.915 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16593 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176436+0000", 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176439+0000", 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4509999999999999e-06 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176443+0000", 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6240000000000001e-06 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176446+0000", 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0649999999999999e-06 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187152+0000", 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010706194 2024-09-11T06:18:06.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187231+0000", 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8234999999999999e-05 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187492+0000", 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026178300000000002 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16594 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695565573000003, 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011362636000000001, 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16594 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176455+0000", 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176457+0000", 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176463+0000", 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176469+0000", 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187542+0000", 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011073037000000001 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187615+0000", 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3013e-05 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187817+0000", 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020221099999999999 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16595 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695546508, 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011570079, 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16595 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176478+0000", 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176482+0000", 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176485+0000", 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9050000000000001e-06 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187855+0000", 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011370066999999999 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187951+0000", 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5435999999999999e-05 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188044+0000", 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3010000000000006e-05 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.927 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16596 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695524438, 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011742973, 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16596 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.928 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:18:06.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176498+0000", 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0889999999999998e-06 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176504+0000", 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176509+0000", 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:18:06.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188070+0000", 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01156101 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188138+0000", 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7527999999999994e-05 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188239+0000", 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100725 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.931 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16597 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695504520999997, 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011917311999999999, 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.932 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16597 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176516+0000", 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176517+0000", 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.658e-06 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176521+0000", 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9269999999999998e-06 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176526+0000", 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1110000000000001e-06 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188263+0000", 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011737632 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188340+0000", 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7113000000000005e-05 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188433+0000", 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2538000000000001e-05 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16598 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695485163999997, 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012870312, 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.936 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16598 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:06.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176538+0000", 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176546+0000", 2024-09-11T06:18:06.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176550+0000", 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.797e-06 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188466+0000", 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011915965000000001 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188550+0000", 2024-09-11T06:18:06.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3446e-05 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189405+0000", 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085535500000000003 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16619 3.6 3:6708c1ee:::rbd_data.116d3c8aaf0c.000000000000002e:b [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.695234438, 2024-09-11T06:18:06.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012975781, 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16619 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7199999999999998e-07 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176789+0000", 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-06 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176797+0000", 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6310000000000003e-06 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176803+0000", 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6710000000000004e-06 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189440+0000", 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012637438000000001 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189511+0000", 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1421000000000006e-05 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189761+0000", 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024988799999999998 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:17472 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.641147199000002, 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013625929, 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 17472 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230874+0000", 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2999999999999999e-07 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230878+0000", 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4209999999999997e-06 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230888+0000", 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0356e-05 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230895+0000", 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9530000000000002e-06 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230940+0000", 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4589000000000003e-05 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230995+0000", 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5390000000000003e-05 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231196+0000", 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020024499999999999 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:06.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231787+0000", 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059133700000000005 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244412+0000", 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012624803 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244460+0000", 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7802000000000001e-05 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244499+0000", 2024-09-11T06:18:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9202999999999997e-05 2024-09-11T06:18:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.951 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18219 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:06.951 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:06.951 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.617120522999997, 2024-09-11T06:18:06.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011081077, 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18219 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254900+0000", 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-07 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254905+0000", 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254916+0000", 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0949e-05 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254925+0000", 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254972+0000", 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6826999999999997e-05 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255031+0000", 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9364000000000003e-05 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255240+0000", 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020845600000000001 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255893+0000", 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00065294500000000004 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265665+0000", 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097724279999999997 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265932+0000", 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267197 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265981+0000", 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8083e-05 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:31265 3.6 3:6434a7af:::rbd_data.116d6ab4d031.0000000000000065:head [write 0~16384 [fadvise_sequential+fadvise_nocache],write 32768~49152 [fadvise_sequential+fadvise_nocache],write 98304~49152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.24404401, 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094624770000000004, 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 31265 2024-09-11T06:18:06.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627977+0000", 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:18:06.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628146+0000", 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000169629 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628156+0000", 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628163+0000", 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.058e-06 2024-09-11T06:18:06.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628226+0000", 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3001000000000002e-05 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628379+0000", 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000153215 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628572+0000", 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019296999999999999 2024-09-11T06:18:06.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.630117+0000", 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015450259999999999 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637285+0000", 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071677729999999997 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637393+0000", 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108248 2024-09-11T06:18:06.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637438+0000", 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5555e-05 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:46340 3.8 3:11013e39:::rbd_data.116da678facf.000000000000002c:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.068465615, 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010883662000000001, 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:06.962 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 46340 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:06.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803555+0000", 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803560+0000", 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3370000000000001e-06 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:06.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803570+0000", 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0002e-05 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803575+0000", 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803636+0000", 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1109000000000001e-05 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803728+0000", 2024-09-11T06:18:06.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2261000000000003e-05 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.805637+0000", 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001908971 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814322+0000", 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086852560000000006 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:06.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814360+0000", 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7508000000000001e-05 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814402+0000", 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2051000000000001e-05 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814438+0000", 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6056999999999997e-05 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:06.968 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:06.968 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:06.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:06.969 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:06.968+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:07.070 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:07.069+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:07.072 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:07.072 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:07.072 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:07.072 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:07.080 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:07.090 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:07.171 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:07.170+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:07.182 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:07.182 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:07.182 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:07.191 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:07.215 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:07.216 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:07.216 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:18:07.232 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:07.247 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:07.248 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:07.265 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:07.265 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:07.274 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:07.274+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:07.284 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:07.284 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:07.317 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:07.317 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:07.348 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:07.349 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:07.353 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:07.353 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:07.373 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:07.372+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:07.375 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:07.375 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:07.390 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:07.474 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:07.473+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:07.539 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:07.539 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:07.547 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:07.575 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:07.574+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:07.650 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:07.650 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:07.658 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:07.676 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:07.676+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:07.761 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:07.761 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:07.770 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:07.777 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:07.776+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:07.874 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:07.874 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:07.877 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:07.876+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:07.882 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:07.978 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:07.977+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:08.026 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:08.026 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:08.034 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:08.079 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:08.078+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:08.136 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:08.136 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:08.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:08.186 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:08.186+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:08.255 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:08.255 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:08.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:08.280 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:08.279+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:08.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:18:08.375 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:08.376 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:08.380 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:08.379+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:08.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:08.429 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-11T06:18:08.481 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:08.480+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:08.565 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:08.565 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:08.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:08.620 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:08.619+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:08.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:08.682+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:08.683 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:08.683 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:08.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:08.711 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:08.712 INFO:teuthology.orchestra.run.smithi070.stdout:2288 punch from 0xcab0e50 to 0xcab2255, (0x1405 bytes) 2024-09-11T06:18:08.716 INFO:teuthology.orchestra.run.smithi070.stdout:2290 punch from 0x33c6033 to 0x33d33c4, (0xd391 bytes) 2024-09-11T06:18:08.716 INFO:teuthology.orchestra.run.smithi070.stdout:2291 punch from 0x5a78e3b to 0x5a80ca3, (0x7e68 bytes) 2024-09-11T06:18:08.716 INFO:teuthology.orchestra.run.smithi070.stdout:2293 write 0x202f107 thru 0x203889c (0x9796 bytes) 2024-09-11T06:18:08.718 INFO:teuthology.orchestra.run.smithi070.stdout:2294 write 0x2f29f70 thru 0x2f29f99 (0x2a bytes) 2024-09-11T06:18:08.719 INFO:teuthology.orchestra.run.smithi070.stdout:2296 writesame 0x2ecc3be thru 0x2ed6eb3 data_size 0x2(0xaaf6 bytes) 2024-09-11T06:18:08.740 INFO:teuthology.orchestra.run.smithi070.stdout:2298 trunc from 0xdfcc91f to 0x25a2efa 2024-09-11T06:18:08.765 INFO:teuthology.orchestra.run.smithi070.stdout:2299 write 0x4975993 thru 0x498437e (0xe9ec bytes) 2024-09-11T06:18:08.774 INFO:teuthology.orchestra.run.smithi070.stdout:2300 write 0x6f9f4a9 thru 0x6fa2f5a (0x3ab2 bytes) 2024-09-11T06:18:08.777 INFO:teuthology.orchestra.run.smithi070.stdout:2302 trunc from 0x6fa2f5b to 0x8873c9a 2024-09-11T06:18:08.782 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:08.782+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:08.783 INFO:teuthology.orchestra.run.smithi070.stdout:2303 write 0x191cc15 thru 0x1926569 (0x9955 bytes) 2024-09-11T06:18:08.797 INFO:teuthology.orchestra.run.smithi070.stdout:2304 write 0xde72d01 thru 0xde7f8c7 (0xcbc7 bytes) 2024-09-11T06:18:08.800 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:08.800 INFO:teuthology.orchestra.run.smithi070.stdout:2306 write 0x5f73d93 thru 0x5f770ed (0x335b bytes) 2024-09-11T06:18:08.802 INFO:teuthology.orchestra.run.smithi070.stdout:2308 read 0x5909127 thru 0x5913e8e (0xad68 bytes) 2024-09-11T06:18:08.802 INFO:teuthology.orchestra.run.smithi070.stdout:2309 write 0x24dea2c thru 0x24e96a4 (0xac79 bytes) 2024-09-11T06:18:08.804 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:08.807 INFO:teuthology.orchestra.run.smithi070.stdout:2311 trunc from 0xde7f8c8 to 0xaec71d5 2024-09-11T06:18:08.826 INFO:teuthology.orchestra.run.smithi070.stdout:2312 trunc from 0xaec71d5 to 0x603ba05 2024-09-11T06:18:08.831 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:08.831 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:08.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:08.847 INFO:teuthology.orchestra.run.smithi070.stdout:2314 write 0x9e4b5e6 thru 0x9e53f9e (0x89b9 bytes) 2024-09-11T06:18:08.849 INFO:teuthology.orchestra.run.smithi070.stdout:2316 write 0xa78b86 thru 0xa8225c (0x96d7 bytes) 2024-09-11T06:18:08.858 INFO:teuthology.orchestra.run.smithi070.stdout:2317 trunc from 0x9e53f9f to 0x3af6529 2024-09-11T06:18:08.880 INFO:teuthology.orchestra.run.smithi070.stdout:2318 writesame 0x97b5273 thru 0x97b7e4c data_size 0x3(0x2bda bytes) 2024-09-11T06:18:08.883 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:08.883+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:08.893 INFO:teuthology.orchestra.run.smithi070.stdout:2320 write 0xe952868 thru 0xe95c991 (0xa12a bytes) 2024-09-11T06:18:08.897 INFO:teuthology.orchestra.run.smithi070.stdout:2321 read 0x2f90d71 thru 0x2f944cd (0x375d bytes) 2024-09-11T06:18:08.897 INFO:teuthology.orchestra.run.smithi070.stdout:2322 read 0x986234b thru 0x9864726 (0x23dc bytes) 2024-09-11T06:18:08.910 INFO:teuthology.orchestra.run.smithi070.stdout:2324 trunc from 0xe95c992 to 0x3b2493b 2024-09-11T06:18:08.924 INFO:teuthology.orchestra.run.smithi070.stdout:2325 punch from 0x194f6c to 0x1a0a18, (0xbaac bytes) 2024-09-11T06:18:08.924 INFO:teuthology.orchestra.run.smithi070.stdout:2326 writesame 0x3675746 thru 0x3684499 data_size 0xf4(0xed54 bytes) 2024-09-11T06:18:08.925 INFO:teuthology.orchestra.run.smithi070.stdout:2327 read 0x2b2106 thru 0x2bbb9b (0x9a96 bytes) 2024-09-11T06:18:08.926 INFO:teuthology.orchestra.run.smithi070.stdout:2328 read 0x36a8720 thru 0x36b6259 (0xdb3a bytes) 2024-09-11T06:18:08.935 INFO:teuthology.orchestra.run.smithi070.stdout:2329 write 0x68b7911 thru 0x68b7e13 (0x503 bytes) 2024-09-11T06:18:08.942 INFO:teuthology.orchestra.run.smithi070.stdout:2330 write 0x6f107b0 thru 0x6f1b151 (0xa9a2 bytes) 2024-09-11T06:18:08.944 INFO:teuthology.orchestra.run.smithi070.stdout:2331 write 0x23f3012 thru 0x23f6cc1 (0x3cb0 bytes) 2024-09-11T06:18:08.952 INFO:teuthology.orchestra.run.smithi070.stdout:2335 write 0x83b3f3a thru 0x83bd60b (0x96d2 bytes) 2024-09-11T06:18:08.962 INFO:teuthology.orchestra.run.smithi070.stdout:2336 write 0xaed6629 thru 0xaedb993 (0x536b bytes) 2024-09-11T06:18:08.963 INFO:teuthology.orchestra.run.smithi070.stdout:2337 punch from 0xa490fb3 to 0xa497ff3, (0x7040 bytes) 2024-09-11T06:18:08.964 INFO:teuthology.orchestra.run.smithi070.stdout:2339 write 0x9686cbf thru 0x9688bd5 (0x1f17 bytes) 2024-09-11T06:18:08.964 INFO:teuthology.orchestra.run.smithi070.stdout:2341 writesame 0x1d35b18 thru 0x1d39512 data_size 0x1(0x39fb bytes) 2024-09-11T06:18:08.967 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:08.967 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:08.972 INFO:teuthology.orchestra.run.smithi070.stdout:2342 punch from 0x361ed25 to 0x362a0c3, (0xb39e bytes) 2024-09-11T06:18:08.972 INFO:teuthology.orchestra.run.smithi070.stdout:2344 clone 16 order 20 su 65536 sc 8 2024-09-11T06:18:08.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:08.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:08.984+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:09.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:09.085+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:09.118 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:09.118 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:09.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:09.186 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:09.185+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:09.229 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:09.229 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:09.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:18:09.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:09.286+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:09.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:09.387 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:09.386+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:09.389 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:09.389 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:09.398 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:09.474 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:09.475 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:09.475 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:18:09.488 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:09.487+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:09.491 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:09.491 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:09.502 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:09.502 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:09.507 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:09.508 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:09.512 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:09.524 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:09.524 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:09.540 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:09.541 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:09.557 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:09.557 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:09.573 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:09.577 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:09.577 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:09.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:09.588+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:09.616 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:09.616 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:09.616 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:09.616 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:09.616 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:09.625 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:09.690 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:09.690+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:09.768 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:09.768 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:09.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:09.768 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:09.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.768 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:09.768 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.450475695000002, 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:09.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:09.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:09.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:09.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:09.774 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.137902476999997, 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:09.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:09.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16521 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 114688~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.591049024999997, 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095026380000000008, 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16521 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.781 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:18:09.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175432+0000", 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175438+0000", 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175445+0000", 2024-09-11T06:18:09.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2219999999999996e-06 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184800+0000", 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009354322 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184848+0000", 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8398e-05 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184932+0000", 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4132e-05 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16522 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 151552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590957822999997, 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096235079999999994, 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.785 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16522 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175522+0000", 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1099999999999995e-07 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175525+0000", 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.619e-06 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175535+0000", 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6590000000000002e-06 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175542+0000", 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2570000000000001e-06 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184976+0000", 2024-09-11T06:18:09.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094335619999999995 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185064+0000", 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8530999999999997e-05 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185144+0000", 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0168999999999998e-05 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.789 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16523 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 188416~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590926361000001, 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099147300000000001, 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.790 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16523 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175553+0000", 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175561+0000", 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5369999999999997e-06 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175571+0000", 2024-09-11T06:18:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7480000000000005e-06 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175577+0000", 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-06 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185174+0000", 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095965570000000004 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185253+0000", 2024-09-11T06:18:09.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8889999999999999e-05 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185467+0000", 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021430099999999999 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16524 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590892363999998, 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010599717999999999, 2024-09-11T06:18:09.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16524 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175587+0000", 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175589+0000", 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175596+0000", 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175601+0000", 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185553+0000", 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099520630000000006 2024-09-11T06:18:09.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185649+0000", 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6086000000000001e-05 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186186+0000", 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053697800000000002 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16553 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590142974000003, 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010060193, 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16553 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.799 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176340+0000", 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.405e-06 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176348+0000", 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8199999999999997e-06 2024-09-11T06:18:09.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176354+0000", 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186219+0000", 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098650109999999999 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186298+0000", 2024-09-11T06:18:09.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9383999999999998e-05 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186396+0000", 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7387999999999997e-05 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16554 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:09.803 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590115857999997, 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010247795000000001, 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16554 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176364+0000", 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5799999999999998e-07 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176366+0000", 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176373+0000", 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4289999999999998e-06 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176377+0000", 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:18:09.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186427+0000", 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010049742 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186511+0000", 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3991000000000003e-05 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186611+0000", 2024-09-11T06:18:09.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9565e-05 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16555 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590093644, 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010729601, 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.808 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16555 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176386+0000", 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176388+0000", 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176395+0000", 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176400+0000", 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186644+0000", 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010244052 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186742+0000", 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8159999999999995e-05 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187115+0000", 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037263900000000002 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.812 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16593 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590043325000003, 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011057091, 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16593 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176436+0000", 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:18:09.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176439+0000", 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4509999999999999e-06 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176443+0000", 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6240000000000001e-06 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176446+0000", 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0649999999999999e-06 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187152+0000", 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010706194 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187231+0000", 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8234999999999999e-05 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187492+0000", 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026178300000000002 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16594 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590024227000001, 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011362636000000001, 2024-09-11T06:18:09.817 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16594 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176455+0000", 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176457+0000", 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:18:09.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176463+0000", 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176469+0000", 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187542+0000", 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011073037000000001 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187615+0000", 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3013e-05 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187817+0000", 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020221099999999999 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.821 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16595 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.590005161999997, 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011570079, 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.822 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16595 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176478+0000", 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176482+0000", 2024-09-11T06:18:09.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176485+0000", 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9050000000000001e-06 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187855+0000", 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011370066999999999 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187951+0000", 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5435999999999999e-05 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188044+0000", 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3010000000000006e-05 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.826 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16596 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.589983091999997, 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011742973, 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16596 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.827 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176498+0000", 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0889999999999998e-06 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176504+0000", 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176509+0000", 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188070+0000", 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01156101 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188138+0000", 2024-09-11T06:18:09.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7527999999999994e-05 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188239+0000", 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100725 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16597 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.589963175000001, 2024-09-11T06:18:09.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011917311999999999, 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16597 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176516+0000", 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176517+0000", 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.658e-06 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176521+0000", 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9269999999999998e-06 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176526+0000", 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1110000000000001e-06 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188263+0000", 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011737632 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188340+0000", 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7113000000000005e-05 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188433+0000", 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2538000000000001e-05 2024-09-11T06:18:09.835 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16598 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.589943818000002, 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012870312, 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.836 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16598 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176538+0000", 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176546+0000", 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176550+0000", 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.797e-06 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188466+0000", 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011915965000000001 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188550+0000", 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3446e-05 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189405+0000", 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085535500000000003 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.840 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16619 3.6 3:6708c1ee:::rbd_data.116d3c8aaf0c.000000000000002e:b [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.589693091999997, 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012975781, 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16619 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7199999999999998e-07 2024-09-11T06:18:09.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176789+0000", 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-06 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176797+0000", 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6310000000000003e-06 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176803+0000", 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6710000000000004e-06 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189440+0000", 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012637438000000001 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189511+0000", 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1421000000000006e-05 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189761+0000", 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024988799999999998 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:17472 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.535605853, 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013625929, 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.845 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 17472 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230874+0000", 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2999999999999999e-07 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230878+0000", 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4209999999999997e-06 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230888+0000", 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0356e-05 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230895+0000", 2024-09-11T06:18:09.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9530000000000002e-06 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230940+0000", 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4589000000000003e-05 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230995+0000", 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5390000000000003e-05 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231196+0000", 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020024499999999999 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231787+0000", 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059133700000000005 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244412+0000", 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012624803 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244460+0000", 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7802000000000001e-05 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244499+0000", 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9202999999999997e-05 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18219 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.511579177000002, 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011081077, 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18219 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254900+0000", 2024-09-11T06:18:09.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-07 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254905+0000", 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254916+0000", 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0949e-05 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254925+0000", 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254972+0000", 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6826999999999997e-05 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255031+0000", 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9364000000000003e-05 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255240+0000", 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020845600000000001 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255893+0000", 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00065294500000000004 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265665+0000", 2024-09-11T06:18:09.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097724279999999997 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265932+0000", 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267197 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265981+0000", 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8083e-05 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.857 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:31265 3.6 3:6434a7af:::rbd_data.116d6ab4d031.0000000000000065:head [write 0~16384 [fadvise_sequential+fadvise_nocache],write 32768~49152 [fadvise_sequential+fadvise_nocache],write 98304~49152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.138502664000001, 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094624770000000004, 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 31265 2024-09-11T06:18:09.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627977+0000", 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628146+0000", 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000169629 2024-09-11T06:18:09.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628156+0000", 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628163+0000", 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.058e-06 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628226+0000", 2024-09-11T06:18:09.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3001000000000002e-05 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628379+0000", 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000153215 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628572+0000", 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019296999999999999 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:09.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.630117+0000", 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015450259999999999 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637285+0000", 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071677729999999997 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637393+0000", 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108248 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637438+0000", 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5555e-05 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:46340 3.8 3:11013e39:::rbd_data.116da678facf.000000000000002c:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 3.9629242690000002, 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010883662000000001, 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:09.864 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 46340 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803555+0000", 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803560+0000", 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3370000000000001e-06 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803570+0000", 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0002e-05 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803575+0000", 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803636+0000", 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1109000000000001e-05 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803728+0000", 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2261000000000003e-05 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.805637+0000", 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001908971 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814322+0000", 2024-09-11T06:18:09.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086852560000000006 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814360+0000", 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7508000000000001e-05 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814402+0000", 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2051000000000001e-05 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:09.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814438+0000", 2024-09-11T06:18:09.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6056999999999997e-05 2024-09-11T06:18:09.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.870 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:09.870 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:09.870 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:09.871 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:09.872 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:09.870+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:09.972 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:09.972+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:10.015 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:10.015 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:10.015 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:10.015 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:10.023 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:10.074 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:10.073+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:10.126 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:10.126 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:10.126 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:10.127 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:10.127 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:10.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:10.174 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:10.173+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:10.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:10.274+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:10.278 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29678 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3145728~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.841056711, 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025653072999999998, 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29678 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:10.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4699999999999998e-07 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436314+0000", 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1349999999999999e-06 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436317+0000", 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9689999999999999e-06 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436319+0000", 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5959999999999998e-06 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461843+0000", 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025523883000000001 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461888+0000", 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5073e-05 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461965+0000", 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7169999999999995e-05 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.283 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29679 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3260416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.841046940999998, 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025777099000000001, 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29679 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:10.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436323+0000", 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0079999999999999e-06 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436326+0000", 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436329+0000", 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461989+0000", 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025660388999999999 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462029+0000", 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9854000000000002e-05 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462099+0000", 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0167999999999996e-05 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29680 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3473408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.841037423, 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025900241000000001, 2024-09-11T06:18:10.288 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29680 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436332+0000", 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1899999999999999e-07 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436333+0000", 2024-09-11T06:18:10.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.049e-06 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436336+0000", 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8830000000000002e-06 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436338+0000", 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4700000000000001e-06 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462122+0000", 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025784081 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462162+0000", 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9774999999999998e-05 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462232+0000", 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9764000000000005e-05 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.292 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29681 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3588096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.841025864999999, 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026043075999999998, 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.293 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29681 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436344+0000", 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436348+0000", 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-06 2024-09-11T06:18:10.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436350+0000", 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462257+0000", 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025906966999999999 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462304+0000", 2024-09-11T06:18:10.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7448999999999999e-05 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462386+0000", 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.174e-05 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29682 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.841015855999999, 2024-09-11T06:18:10.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026216950999999999, 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29682 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:10.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436354+0000", 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436357+0000", 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436360+0000", 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.464e-06 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462412+0000", 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026052230999999999 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462459+0000", 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7207999999999999e-05 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462570+0000", 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110968 2024-09-11T06:18:10.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29683 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.841006419999999, 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026370945, 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.302 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29683 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436363+0000", 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436364+0000", 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436367+0000", 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436369+0000", 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5059999999999998e-06 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462606+0000", 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026237114999999998 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462653+0000", 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:18:10.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462733+0000", 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0605999999999994e-05 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29684 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840996814, 2024-09-11T06:18:10.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026632194000000001, 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29684 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436373+0000", 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6899999999999996e-07 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436376+0000", 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9699999999999999e-06 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436379+0000", 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462758+0000", 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026378990000000001 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462846+0000", 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8641999999999996e-05 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463004+0000", 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015788 2024-09-11T06:18:10.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29685 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840987299999998, 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026764263, 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29685 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436383+0000", 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436386+0000", 2024-09-11T06:18:10.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436388+0000", 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6570000000000001e-06 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463023+0000", 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026634722 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463068+0000", 2024-09-11T06:18:10.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5025999999999999e-05 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463146+0000", 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7729000000000001e-05 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29686 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840977311, 2024-09-11T06:18:10.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026966905999999999, 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29686 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:10.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436393+0000", 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436396+0000", 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.915e-06 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436398+0000", 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463173+0000", 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026774703 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463242+0000", 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9770000000000005e-05 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463358+0000", 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116038 2024-09-11T06:18:10.319 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29687 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840968083, 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027120658999999998, 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.320 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29687 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:10.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436402+0000", 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436405+0000", 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8899999999999999e-06 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436407+0000", 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463391+0000", 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026983285999999999 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463433+0000", 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2481999999999997e-05 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463521+0000", 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8373000000000002e-05 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.324 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29688 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840958682, 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027291494999999999, 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29688 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436411+0000", 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-06 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436414+0000", 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8940000000000002e-06 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436417+0000", 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5069999999999999e-06 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463562+0000", 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027144622 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463621+0000", 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9108999999999999e-05 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463702+0000", 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.328 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29689 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840949155000001, 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027435349000000001, 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.329 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29689 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436423+0000", 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436426+0000", 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0010000000000002e-06 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436429+0000", 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4739999999999999e-06 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463726+0000", 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027297482000000001 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463780+0000", 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3714000000000001e-05 2024-09-11T06:18:10.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463855+0000", 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5278000000000007e-05 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29690 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840937342, 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027575023000000001, 2024-09-11T06:18:10.333 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29690 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436433+0000", 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-11T06:18:10.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436436+0000", 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8959999999999999e-06 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436438+0000", 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.514e-06 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463880+0000", 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027442151000000001 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463924+0000", 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3983000000000002e-05 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464007+0000", 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2274000000000005e-05 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29691 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840927245, 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027733827999999999, 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.338 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29691 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436443+0000", 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.279e-06 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436446+0000", 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436449+0000", 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464034+0000", 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027585492 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464082+0000", 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7444999999999997e-05 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464175+0000", 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3954000000000002e-05 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29692 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5439488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840917415, 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027927924, 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.342 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29692 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:10.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436452+0000", 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436453+0000", 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1179999999999999e-06 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436456+0000", 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436458+0000", 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464214+0000", 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027755618999999999 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464266+0000", 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2354000000000001e-05 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464379+0000", 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011328900000000001 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29693 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5554176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.346 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840908013, 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028112022, 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29693 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:10.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436462+0000", 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.031e-06 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436465+0000", 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3230000000000002e-06 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436468+0000", 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4870000000000001e-06 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464414+0000", 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027946104999999999 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464468+0000", 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3637999999999997e-05 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464573+0000", 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105232 2024-09-11T06:18:10.350 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29694 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5767168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840898072000002, 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028256073999999999, 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29694 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436472+0000", 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436475+0000", 2024-09-11T06:18:10.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8870000000000001e-06 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436478+0000", 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464591+0000", 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028113171999999999 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464643+0000", 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950999999999998e-05 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464727+0000", 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4133000000000002e-05 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29695 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5881856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:10.355 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840888373999999, 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02845924, 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29695 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:10.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436482+0000", 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.111e-06 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436485+0000", 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436487+0000", 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5859999999999999e-06 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464762+0000", 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028274773 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464848+0000", 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6269999999999999e-05 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464940+0000", 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1345e-05 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29696 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6094848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840878644, 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028603799999999999, 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29696 2024-09-11T06:18:10.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436491+0000", 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.879999999999999e-07 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436494+0000", 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8339999999999999e-06 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436497+0000", 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.328e-06 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464970+0000", 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028473196999999999 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465017+0000", 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465094+0000", 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6606999999999993e-05 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29697 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6209536~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.840866029000001, 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028751832000000001, 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.364 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29697 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436504+0000", 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.319e-06 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436508+0000", 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2729999999999998e-06 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436510+0000", 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465125+0000", 2024-09-11T06:18:10.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028614537999999998 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465174+0000", 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8965000000000003e-05 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465255+0000", 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0798999999999997e-05 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.369 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.369 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:10.370 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:10.376 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:10.375+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:10.477 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:10.476+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:10.506 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-11T06:18:10.506 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-09-11T06:18:10.506 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T06:18:10.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T06:18:10.509 INFO:tasks.ceph.osd.1:Started 2024-09-11T06:18:10.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:10.564 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:10.564 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:10.565 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:10.565 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:10.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:10.578 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:10.577+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:no valid command found; 10 closest matches: 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:0 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:1 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:abort 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:assert 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:config diff 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:config diff get 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:config get 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:config help [] 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:config set ... 2024-09-11T06:18:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:admin_socket: invalid command 2024-09-11T06:18:10.621 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T06:18:10.621 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-11T06:18:10.676 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:10.676 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:10.676 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:10.676 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:10.676 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:10.679 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:10.678+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:10.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:10.780 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:10.779+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:10.788 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:10.788 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261228864, 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261210415000001, 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:18:10.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:10.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261179618, 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:18:10.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261160610000001, 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.807 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261141941999998, 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:18:10.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261119882999999, 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.812 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:18:10.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:10.816 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261101019000002, 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:10.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:18:10.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261081237999999, 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.821 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:18:10.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.26106231, 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.261021830000001, 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.829 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:18:10.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.260991721, 2024-09-11T06:18:10.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:18:10.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258900525000001, 2024-09-11T06:18:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258823604, 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.841 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:18:10.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258799304, 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:18:10.845 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:18:10.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:18:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:18:10.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258763885, 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.852 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:18:10.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258746681000002, 2024-09-11T06:18:10.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:10.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:18:10.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258730417999999, 2024-09-11T06:18:10.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:18:10.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:18:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258713441000001, 2024-09-11T06:18:10.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:18:10.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.868 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258697456, 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:10.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:18:10.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.872 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.258679486999998, 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:10.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:18:10.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:18:10.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:10.877 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:10.877 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:10.878 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:10.881 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:10.881+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:10.982 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:10.981+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:11.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:11.082 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:11.082+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:11.133 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:11.133 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:11.133 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:11.133 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:11.133 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:11.141 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:11.183 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:11.183+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:11.245 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004368253999999, 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:11.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004355516, 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:18:11.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:18:11.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004344382999999, 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.255 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004333795000001, 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:18:11.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:18:11.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004323299999999, 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:18:11.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004312986999999, 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.269 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:11.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:18:11.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004302445, 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.273 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:18:11.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004292139, 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.278 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:18:11.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004276561000001, 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.282 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:18:11.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.004257555999999, 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.287 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:18:11.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944728182999999, 2024-09-11T06:18:11.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:11.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944709712000002, 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.296 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:18:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944691221999999, 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:18:11.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944674154000001, 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.305 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:18:11.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944656123000001, 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:18:11.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:18:11.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944633938999999, 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944615946999999, 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944598292999999, 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:18:11.323 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:18:11.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944575377, 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.328 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:18:11.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.944556988999999, 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:11.332 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:11.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.336 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:11.337 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:11.337 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:11.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:18:11.339 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:11.337+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:11.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-11T06:18:11.439 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:11.438+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:11.484 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:11.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:11.540 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:11.539+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:11.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:11.612 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:11.612 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:11.612 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:11.612 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:11.612 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:11.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:11.663 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:11.662+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:11.703 INFO:teuthology.orchestra.run.smithi070.stdout:2346 writesame 0x53d5635 thru 0x53d9eb4 data_size 0x50(0x4880 bytes) 2024-09-11T06:18:11.705 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:11.705 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:11.705 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:18:11.711 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:11.718 INFO:teuthology.orchestra.run.smithi070.stdout:2349 writesame 0xbc10893 thru 0xbc18120 data_size 0xd(0x788e bytes) 2024-09-11T06:18:11.718 INFO:teuthology.orchestra.run.smithi070.stdout:2350 read 0xde39e7 thru 0xde5640 (0x1c5a bytes) 2024-09-11T06:18:11.718 INFO:teuthology.orchestra.run.smithi070.stdout:2351 read 0x2b0939d thru 0x2b12e11 (0x9a75 bytes) 2024-09-11T06:18:11.719 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:11.719 INFO:teuthology.orchestra.run.smithi070.stdout:2355 read 0x466f0b6 thru 0x467e9e5 (0xf930 bytes) 2024-09-11T06:18:11.719 INFO:teuthology.orchestra.run.smithi070.stdout:2356 writesame 0xa74d591 thru 0xa75c4bd data_size 0x1(0xef2d bytes) 2024-09-11T06:18:11.727 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:11.727 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:11.742 INFO:teuthology.orchestra.run.smithi070.stdout:2357 write 0x40c04e5 thru 0x40c6179 (0x5c95 bytes) 2024-09-11T06:18:11.742 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:11.741+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:11.744 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:11.744 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:11.745 INFO:teuthology.orchestra.run.smithi070.stdout:2358 punch from 0x544259a to 0x544c83b, (0xa2a1 bytes) 2024-09-11T06:18:11.745 INFO:teuthology.orchestra.run.smithi070.stdout:2359 write 0x49c00d7 thru 0x49c982f (0x9759 bytes) 2024-09-11T06:18:11.748 INFO:teuthology.orchestra.run.smithi070.stdout:2360 read 0xa0f62fd thru 0xa101dc5 (0xbac9 bytes) 2024-09-11T06:18:11.749 INFO:teuthology.orchestra.run.smithi070.stdout:2362 write 0x69a0435 thru 0x69a9357 (0x8f23 bytes) 2024-09-11T06:18:11.752 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:11.752 INFO:teuthology.orchestra.run.smithi070.stdout:2364 punch from 0x17a0ca9 to 0x17b09e4, (0xfd3b bytes) 2024-09-11T06:18:11.753 INFO:teuthology.orchestra.run.smithi070.stdout:2365 trunc from 0xbc18121 to 0xac2df73 2024-09-11T06:18:11.764 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:11.764 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:11.766 INFO:teuthology.orchestra.run.smithi070.stdout:2367 read 0xa14778d thru 0xa1518d0 (0xa144 bytes) 2024-09-11T06:18:11.766 INFO:teuthology.orchestra.run.smithi070.stdout:2369 write 0xa276079 thru 0xa27d4e6 (0x746e bytes) 2024-09-11T06:18:11.772 INFO:teuthology.orchestra.run.smithi070.stdout:2370 trunc from 0xac2df73 to 0xd30b337 2024-09-11T06:18:11.776 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:11.776 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:11.778 INFO:teuthology.orchestra.run.smithi070.stdout:2373 read 0xa7393d5 thru 0xa73d1eb (0x3e17 bytes) 2024-09-11T06:18:11.778 INFO:teuthology.orchestra.run.smithi070.stdout:2374 write 0x6f4c806 thru 0x6f51454 (0x4c4f bytes) 2024-09-11T06:18:11.786 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:11.786 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:11.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:11.796 INFO:teuthology.orchestra.run.smithi070.stdout:2375 trunc from 0xd30b337 to 0x2186f8a 2024-09-11T06:18:11.807 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:11.807 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:11.834 INFO:teuthology.orchestra.run.smithi070.stdout:2376 read 0x8f9543 thru 0x900256 (0x6d14 bytes) 2024-09-11T06:18:11.834 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:11.834 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:11.838 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:11.839 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:11.843 INFO:teuthology.orchestra.run.smithi070.stdout:2377 trunc from 0x2186f8a to 0x9594a28 2024-09-11T06:18:11.843 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:11.843+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:11.848 INFO:teuthology.orchestra.run.smithi070.stdout:2378 read 0x1715ea0 thru 0x1718021 (0x2182 bytes) 2024-09-11T06:18:11.849 INFO:teuthology.orchestra.run.smithi070.stdout:2379 clone 17 order 22 su 524288 sc 12 2024-09-11T06:18:11.913 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:11.913 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:11.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:11.944 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:11.943+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:12.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:12.044+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:12.065 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:12.065 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:12.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:12.146 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:12.145+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:12.178 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:12.178 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:12.188 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:12.201 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:12.199+0000 7f3969efe640 -1 Falling back to public interface 2024-09-11T06:18:12.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:12.246+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:12.299 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:18:12.309 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:12.309 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:12.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:12.361 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:12.359+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:12.449 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:12.448+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:12.464 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:12.464 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:12.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:12.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:12.550+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:12.615 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:12.615 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:12.624 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:12.651 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:12.650+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:12.740 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:12.741 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:12.750 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:12.753 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:12.752+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:12.853 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:12.853 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:12.853 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:12.852+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:12.861 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:12.954 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:12.953+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:13.004 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:13.004 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:13.014 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:13.055 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:13.054+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:13.157 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:13.157 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:13.157 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:13.155+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:13.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:13.258 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:13.256+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:13.267 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:13.267 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:13.276 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:13.359 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:13.357+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:13.411 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:13.411 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:13.420 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:13.463 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:13.463+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:13.523 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:13.523 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:13.532 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:13.574 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:13.573+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:13.662 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:13.660+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:13.675 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:13.676 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:13.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:13.762 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:13.761+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:13.787 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:13.787 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:13.796 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:13.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:13.863 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:13.863+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:13.900 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:13.900 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:13.909 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:13.961 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:13.962 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:13.962 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:18:13.964 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:13.962+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:13.978 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:13.978 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:13.994 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:13.994 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:14.010 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:14.011 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:14.028 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:14.029 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:14.046 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:14.047 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:14.055 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:14.055 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:14.063 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:14.063 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:14.064 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:14.065 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:14.062+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:14.066 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:14.066 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:14.165 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:14.165+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:14.169 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:14.169 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:14.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:14.169 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:14.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:14.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927233351000002, 2024-09-11T06:18:14.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:18:14.170 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.170 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.171 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.171 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:18:14.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.172 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:14.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:14.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:18:14.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:18:14.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:18:14.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:18:14.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:18:14.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:18:14.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:18:14.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:18:14.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:18:14.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:18:14.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:18:14.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:18:14.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.180 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927220612999999, 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:18:14.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:14.185 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927209479999998, 2024-09-11T06:18:14.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:18:14.186 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.186 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.186 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.186 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927198892, 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.191 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:18:14.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:18:14.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:18:14.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:14.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:18:14.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:18:14.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:18:14.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.197 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.197 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:14.197 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927188396999998, 2024-09-11T06:18:14.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:18:14.197 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.197 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.198 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.198 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.198 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:18:14.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.199 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:14.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927178084000001, 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.204 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.204 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:18:14.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:14.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:14.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:18:14.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:14.209 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927167541999999, 2024-09-11T06:18:14.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:18:14.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.210 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.210 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:18:14.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.211 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:14.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:14.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:14.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:14.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:18:14.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:18:14.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:18:14.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927157235999999, 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:14.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:18:14.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927141658, 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:18:14.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.927122653000001, 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:18:14.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867593280000001, 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.231 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:18:14.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867574809000001, 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867556318999998, 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:18:14.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:18:14.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867539251, 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.245 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:18:14.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.86752122, 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.249 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:18:14.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867499036000002, 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:18:14.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:18:14.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.258 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867481044000002, 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:14.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:18:14.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:18:14.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867463390000001, 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.263 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:18:14.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.267 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867440473999999, 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:18:14.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:18:14.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.867422086000001, 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:14.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:14.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:18:14.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:14.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:14.276 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:14.278 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:14.277+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:14.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:14.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:18:14.378 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:14.377+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:14.392 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:14.392 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:14.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:14.420 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-11T06:18:14.480 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:14.478+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:14.545 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:14.546 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:14.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:14.597 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:14.595+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:14.635 INFO:teuthology.orchestra.run.smithi070.stdout:2380 trunc from 0x9594a28 to 0xc0dd129 2024-09-11T06:18:14.644 INFO:teuthology.orchestra.run.smithi070.stdout:2381 read 0xb53beb4 thru 0xb54bb5b (0xfca8 bytes) 2024-09-11T06:18:14.644 INFO:teuthology.orchestra.run.smithi070.stdout:2382 writesame 0x9b2c2db thru 0x9b2cc49 data_size 0x3(0x96f bytes) 2024-09-11T06:18:14.647 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.647 INFO:teuthology.orchestra.run.smithi070.stdout:2385 write 0x6e37128 thru 0x6e41ed5 (0xadae bytes) 2024-09-11T06:18:14.650 INFO:teuthology.orchestra.run.smithi070.stdout:2386 read 0x2d50d45 thru 0x2d5de15 (0xd0d1 bytes) 2024-09-11T06:18:14.650 INFO:teuthology.orchestra.run.smithi070.stdout:2387 read 0x1d5f8a9 thru 0x1d6ebae (0xf306 bytes) 2024-09-11T06:18:14.651 INFO:teuthology.orchestra.run.smithi070.stdout:2388 write 0x2cb3fdc thru 0x2cc12b1 (0xd2d6 bytes) 2024-09-11T06:18:14.653 INFO:teuthology.orchestra.run.smithi070.stdout:2391 read 0xbe2c626 thru 0xbe3b99c (0xf377 bytes) 2024-09-11T06:18:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:2394 trunc from 0xc0dd129 to 0x5a5fa1a 2024-09-11T06:18:14.670 INFO:teuthology.orchestra.run.smithi070.stdout:2396 write 0x77560c thru 0x78186f (0xc264 bytes) 2024-09-11T06:18:14.672 INFO:teuthology.orchestra.run.smithi070.stdout:2397 read 0x344ba26 thru 0x3459ab5 (0xe090 bytes) 2024-09-11T06:18:14.672 INFO:teuthology.orchestra.run.smithi070.stdout:2398 read 0x2ff3650 thru 0x3003494 (0xfe45 bytes) 2024-09-11T06:18:14.672 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.673 INFO:teuthology.orchestra.run.smithi070.stdout:2400 read 0x1990f3e thru 0x19922d0 (0x1393 bytes) 2024-09-11T06:18:14.673 INFO:teuthology.orchestra.run.smithi070.stdout:2401 read 0xfd566e thru 0xfe0a2f (0xb3c2 bytes) 2024-09-11T06:18:14.673 INFO:teuthology.orchestra.run.smithi070.stdout:2403 read 0x2137580 thru 0x21430a6 (0xbb27 bytes) 2024-09-11T06:18:14.674 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.674 INFO:teuthology.orchestra.run.smithi070.stdout:2405 write 0x1f9249f thru 0x1f97df4 (0x5956 bytes) 2024-09-11T06:18:14.681 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:14.679+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:14.690 INFO:teuthology.orchestra.run.smithi070.stdout:2408 writesame 0xceebc8b thru 0xcef976a data_size 0x67(0xdae0 bytes) 2024-09-11T06:18:14.690 INFO:teuthology.orchestra.run.smithi070.stdout:2409 write 0x5fa5ebd thru 0x5faff70 (0xa0b4 bytes) 2024-09-11T06:18:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:2410 writesame 0x28ad178 thru 0x28b213e data_size 0x1(0x4fc7 bytes) 2024-09-11T06:18:14.703 INFO:teuthology.orchestra.run.smithi070.stdout:2411 read 0x803d7c thru 0x81109e (0xd323 bytes) 2024-09-11T06:18:14.704 INFO:teuthology.orchestra.run.smithi070.stdout:2412 read 0x7a042b6 thru 0x7a050ac (0xdf7 bytes) 2024-09-11T06:18:14.704 INFO:teuthology.orchestra.run.smithi070.stdout:2413 read 0x7289df5 thru 0x728d299 (0x34a5 bytes) 2024-09-11T06:18:14.705 INFO:teuthology.orchestra.run.smithi070.stdout:2414 write 0x6762075 thru 0x67685ef (0x657b bytes) 2024-09-11T06:18:14.714 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.029339907000001, 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:14.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:18:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:18:14.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:18:14.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.909343669000002, 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:14.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:14.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:14.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28882 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3637248~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.342498708000001, 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020043653000000002, 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28882 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370259+0000", 2024-09-11T06:18:14.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000002e-07 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370273+0000", 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4075e-05 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370280+0000", 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.007e-06 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370286+0000", 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3380000000000004e-06 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390099+0000", 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019812923999999999 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390172+0000", 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3375999999999997e-05 2024-09-11T06:18:14.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390303+0000", 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130512 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28883 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.342463368000001, 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020291813999999998, 2024-09-11T06:18:14.733 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28883 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370295+0000", 2024-09-11T06:18:14.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370297+0000", 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.21e-06 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370303+0000", 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4479999999999999e-06 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370309+0000", 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3040000000000004e-06 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390350+0000", 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020040842 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390438+0000", 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8446e-05 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390586+0000", 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014808399999999999 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38581 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425404525999999, 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020052018000000001, 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38581 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287354+0000", 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287356+0000", 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4030000000000001e-06 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287362+0000", 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9710000000000001e-06 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287367+0000", 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307187+0000", 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019820397999999999 2024-09-11T06:18:14.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307279+0000", 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1417999999999998e-05 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307405+0000", 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126265 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38582 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3211264~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425383045, 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020273138999999999, 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38582 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:18:14.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287377+0000", 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0990000000000001e-06 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287383+0000", 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287388+0000", 2024-09-11T06:18:14.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8149999999999996e-06 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307438+0000", 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020050081000000001 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307527+0000", 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9476999999999997e-05 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307648+0000", 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120226 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38583 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3997696~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425363809, 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020512203999999999, 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38583 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287401+0000", 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1500000000000002e-06 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287408+0000", 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1750000000000002e-06 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287413+0000", 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0640000000000001e-06 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307690+0000", 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020277067999999999 2024-09-11T06:18:14.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307779+0000", 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9071000000000002e-05 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307906+0000", 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012727600000000001 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38584 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 4784128~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425337974, 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020729899, 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38584 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287422+0000", 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1560000000000002e-06 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287427+0000", 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2299999999999999e-06 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287439+0000", 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1263999999999999e-05 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307939+0000", 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020499962 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308026+0000", 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7787000000000005e-05 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308150+0000", 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123082 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38585 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 5570560~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425174486, 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782914, 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38585 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287584+0000", 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-07 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287587+0000", 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3979999999999999e-06 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287595+0000", 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6899999999999992e-06 2024-09-11T06:18:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287601+0000", 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308194+0000", 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593066 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308290+0000", 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6405999999999998e-05 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308366+0000", 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5727000000000002e-05 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38586 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 6356992~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425147022000001, 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021009344999999999, 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38586 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287613+0000", 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.43e-06 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287620+0000", 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0789999999999997e-06 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287630+0000", 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0328e-05 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308412+0000", 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782281999999999 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308505+0000", 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2492999999999997e-05 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308620+0000", 2024-09-11T06:18:14.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115283 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38587 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7143424~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425120004, 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021158300000000001, 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38587 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287641+0000", 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.836e-06 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287648+0000", 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7710000000000001e-06 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287652+0000", 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6450000000000004e-06 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308654+0000", 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021001899000000001 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308701+0000", 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6551000000000002e-05 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308796+0000", 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5192000000000006e-05 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38588 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7929856~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425098673000001, 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021338811999999999, 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38588 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287662+0000", 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1679999999999998e-06 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287668+0000", 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.302e-06 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287672+0000", 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308828+0000", 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02115616 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308890+0000", 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1845000000000002e-05 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308998+0000", 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010743000000000001 2024-09-11T06:18:14.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38589 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 8716288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425078999, 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021462365000000001, 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38589 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287681+0000", 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2290000000000002e-06 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287687+0000", 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.784e-06 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287691+0000", 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309029+0000", 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021337805000000001 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309076+0000", 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-05 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309141+0000", 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5264000000000004e-05 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38590 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 9502720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425060025000001, 2024-09-11T06:18:14.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021714906999999999, 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38590 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:14.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287700+0000", 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1490000000000001e-06 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287706+0000", 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287711+0000", 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0429999999999998e-06 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309190+0000", 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021479043 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309284+0000", 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3968999999999994e-05 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309413+0000", 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012823700000000001 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38591 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 10289152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.425040208, 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021935667999999998, 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38591 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287718+0000", 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287726+0000", 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6829999999999997e-06 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287734+0000", 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0079999999999996e-06 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287738+0000", 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309447+0000", 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021708284000000001 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309534+0000", 2024-09-11T06:18:14.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7379000000000005e-05 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309653+0000", 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011905600000000001 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38592 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11075584~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.4250124, 2024-09-11T06:18:14.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022188494999999999, 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38592 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287746+0000", 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287748+0000", 2024-09-11T06:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3420000000000002e-06 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287754+0000", 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5259999999999999e-06 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287759+0000", 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4129999999999999e-06 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309724+0000", 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021965179000000001 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309813+0000", 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8825000000000004e-05 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309934+0000", 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120809 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38593 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11862016~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.424992378000001, 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022391579000000002, 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38593 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.793 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287766+0000", 2024-09-11T06:18:14.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287768+0000", 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1459999999999999e-06 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287774+0000", 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.421e-06 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287779+0000", 2024-09-11T06:18:14.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4569999999999998e-06 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309967+0000", 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022187944000000001 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310048+0000", 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1528999999999998e-05 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310157+0000", 2024-09-11T06:18:14.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108729 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38594 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 12648448~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.424972489, 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022597002000000001, 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38594 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287786+0000", 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4000000000000002e-07 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287788+0000", 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1239999999999999e-06 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287794+0000", 2024-09-11T06:18:14.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.725e-06 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287799+0000", 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0139999999999998e-06 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310186+0000", 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022386306000000002 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310270+0000", 2024-09-11T06:18:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4507999999999998e-05 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310382+0000", 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111885 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38595 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [read 13434880~23206 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:14.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.42495248, 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022896125, 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38595 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:14.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287806+0000", 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287813+0000", 2024-09-11T06:18:14.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.199e-06 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287819+0000", 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5950000000000004e-06 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287831+0000", 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1600000000000001e-05 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310413+0000", 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022582015 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310492+0000", 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9291999999999999e-05 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310701+0000", 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000209061 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:39792 3.15 3:ac0e7d03:::rbd_data.116db5c39c9d.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.05771968, 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020275054000000001, 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:14.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39792 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:14.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655040+0000", 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1610000000000001e-06 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655051+0000", 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1126e-05 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655069+0000", 2024-09-11T06:18:14.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8039000000000001e-05 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655080+0000", 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0852999999999999e-05 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655160+0000", 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0135000000000004e-05 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:14.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655320+0000", 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160166 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.658973+0000", 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003652335 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675201+0000", 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016227772000000001 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675214+0000", 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3508e-05 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675255+0000", 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0636999999999997e-05 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675313+0000", 2024-09-11T06:18:14.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8322000000000002e-05 2024-09-11T06:18:14.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:14.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:14.812 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:14.812 INFO:teuthology.orchestra.run.smithi070.stdout:2415 trunc from 0xcef976b to 0x6f2f5ea 2024-09-11T06:18:14.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:2416 write 0xbe842e8 thru 0xbe91f87 (0xdca0 bytes) 2024-09-11T06:18:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:2417 write 0x4afaaa6 thru 0x4b009a5 (0x5f00 bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2418 writesame 0x2167dba thru 0x2174d67 data_size 0x3(0xcfae bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2421 punch from 0x8cd59bf to 0x8cda9dd, (0x501e bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2422 punch from 0x9758384 to 0x975b62b, (0x32a7 bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2428 read 0x33af004 thru 0x33bc31f (0xd31c bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2429 trunc from 0xbe91f88 to 0x709810c 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2430 punch from 0x783414 to 0x78b0b6, (0x7ca2 bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2431 punch from 0x3d71291 to 0x3d7c118, (0xae87 bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2432 punch from 0x2670c54 to 0x2678110, (0x74bc bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2433 write 0xdcb1b23 thru 0xdcb40f1 (0x25cf bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2434 read 0x39ddb7d thru 0x39e975f (0xbbe3 bytes) 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2435 trunc from 0xdcb40f2 to 0x6beaeab 2024-09-11T06:18:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:2436 punch from 0x68f3535 to 0x68f85c2, (0x508d bytes) 2024-09-11T06:18:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:2437 write 0xd204aa8 thru 0xd20de91 (0x93ea bytes) 2024-09-11T06:18:14.817 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:14.815+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:14.826 INFO:teuthology.orchestra.run.smithi070.stdout:2439 write 0xeae9f58 thru 0xeaeaed7 (0xf80 bytes) 2024-09-11T06:18:14.829 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.829 INFO:teuthology.orchestra.run.smithi070.stdout:2441 read 0x4699735 thru 0x469e906 (0x51d2 bytes) 2024-09-11T06:18:14.829 INFO:teuthology.orchestra.run.smithi070.stdout:2442 write 0xab3e19d thru 0xab4345c (0x52c0 bytes) 2024-09-11T06:18:14.832 INFO:teuthology.orchestra.run.smithi070.stdout:2443 punch from 0x51dad75 to 0x51df32c, (0x45b7 bytes) 2024-09-11T06:18:14.832 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.832 INFO:teuthology.orchestra.run.smithi070.stdout:2447 write 0x3b2edbc thru 0x3b2f81e (0xa63 bytes) 2024-09-11T06:18:14.836 INFO:teuthology.orchestra.run.smithi070.stdout:2448 read 0xd495548 thru 0xd49727f (0x1d38 bytes) 2024-09-11T06:18:14.836 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.836 INFO:teuthology.orchestra.run.smithi070.stdout:2454 read 0x44ecf7b thru 0x44f4916 (0x799c bytes) 2024-09-11T06:18:14.836 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.836 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.836 INFO:teuthology.orchestra.run.smithi070.stdout:2458 punch from 0x7148b2d to 0x715012a, (0x75fd bytes) 2024-09-11T06:18:14.836 INFO:teuthology.orchestra.run.smithi070.stdout:2459 read 0x83f3327 thru 0x83fd8ca (0xa5a4 bytes) 2024-09-11T06:18:14.836 INFO:teuthology.orchestra.run.smithi070.stdout:2461 write 0xc6e7344 thru 0xc6f244f (0xb10c bytes) 2024-09-11T06:18:14.837 INFO:teuthology.orchestra.run.smithi070.stdout:2464 write 0x23e55f1 thru 0x23ebf77 (0x6987 bytes) 2024-09-11T06:18:14.839 INFO:teuthology.orchestra.run.smithi070.stdout:2465 punch from 0xe400ddb to 0xe40c505, (0xb72a bytes) 2024-09-11T06:18:14.839 INFO:teuthology.orchestra.run.smithi070.stdout:2466 writesame 0xc0bf71 thru 0xc16824 data_size 0x3d(0xa8b4 bytes) 2024-09-11T06:18:14.841 INFO:teuthology.orchestra.run.smithi070.stdout:2467 read 0x42c9bdb thru 0x42d49a8 (0xadce bytes) 2024-09-11T06:18:14.841 INFO:teuthology.orchestra.run.smithi070.stdout:2468 write 0x7ae93a7 thru 0x7af8105 (0xed5f bytes) 2024-09-11T06:18:14.844 INFO:teuthology.orchestra.run.smithi070.stdout:2471 writesame 0x9117adc thru 0x9119826 data_size 0x1(0x1d4b bytes) 2024-09-11T06:18:14.850 INFO:teuthology.orchestra.run.smithi070.stdout:2472 write 0xc19444c thru 0xc198ee9 (0x4a9e bytes) 2024-09-11T06:18:14.853 INFO:teuthology.orchestra.run.smithi070.stdout:2473 read 0xb5f72b thru 0xb60d8c (0x1662 bytes) 2024-09-11T06:18:14.853 INFO:teuthology.orchestra.run.smithi070.stdout:2474 writesame 0x24d5f7 thru 0x257abd data_size 0x2b(0xa4c7 bytes) 2024-09-11T06:18:14.855 INFO:teuthology.orchestra.run.smithi070.stdout:2476 write 0x3220dff thru 0x3227df2 (0x6ff4 bytes) 2024-09-11T06:18:14.858 INFO:teuthology.orchestra.run.smithi070.stdout:2477 read 0x84dbac1 thru 0x84ea6f0 (0xec30 bytes) 2024-09-11T06:18:14.858 INFO:teuthology.orchestra.run.smithi070.stdout:2478 punch from 0x80d730c to 0x80e2e9c, (0xbb90 bytes) 2024-09-11T06:18:14.858 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.858 INFO:teuthology.orchestra.run.smithi070.stdout:2480 read 0xe274c61 thru 0xe280e39 (0xc1d9 bytes) 2024-09-11T06:18:14.863 INFO:teuthology.orchestra.run.smithi070.stdout:2481 write 0xebd8dd8 thru 0xebdf2e7 (0x6510 bytes) 2024-09-11T06:18:14.864 INFO:teuthology.orchestra.run.smithi070.stdout:2482 read 0x502c4d2 thru 0x50372fc (0xae2b bytes) 2024-09-11T06:18:14.864 INFO:teuthology.orchestra.run.smithi070.stdout:2483 writesame 0xd75a93a thru 0xd768199 data_size 0x30(0xd860 bytes) 2024-09-11T06:18:14.868 INFO:teuthology.orchestra.run.smithi070.stdout:2485 writesame 0x83d6b70 thru 0x83d71af data_size 0x10(0x640 bytes) 2024-09-11T06:18:14.871 INFO:teuthology.orchestra.run.smithi070.stdout:2486 punch from 0xdaa9aad to 0xdab18ad, (0x7e00 bytes) 2024-09-11T06:18:14.871 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.871 INFO:teuthology.orchestra.run.smithi070.stdout:2488 write 0xe5a1104 thru 0xe5a91b4 (0x80b1 bytes) 2024-09-11T06:18:14.872 INFO:teuthology.orchestra.run.smithi070.stdout:2489 read 0x8a2b9b5 thru 0x8a30766 (0x4db2 bytes) 2024-09-11T06:18:14.878 INFO:teuthology.orchestra.run.smithi070.stdout:2490 trunc from 0xebdf2e8 to 0x9d8de6b 2024-09-11T06:18:14.889 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.896 INFO:teuthology.orchestra.run.smithi070.stdout:2493 trunc from 0x9d8de6b to 0x3f42414 2024-09-11T06:18:14.909 INFO:teuthology.orchestra.run.smithi070.stdout:2495 writesame 0x2cc9086 thru 0x2cd2023 data_size 0x1f(0x8f9e bytes) 2024-09-11T06:18:14.912 INFO:teuthology.orchestra.run.smithi070.stdout:2496 writesame 0xbb278a thru 0xbbe068 data_size 0x1(0xb8df bytes) 2024-09-11T06:18:14.916 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:14.915+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:14.932 INFO:teuthology.orchestra.run.smithi070.stdout:2497 write 0x1285ef5 thru 0x1290aca (0xabd6 bytes) 2024-09-11T06:18:14.934 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.934 INFO:teuthology.orchestra.run.smithi070.stdout:2499 read 0x860a4a thru 0x861644 (0xbfb bytes) 2024-09-11T06:18:14.935 INFO:teuthology.orchestra.run.smithi070.stdout:2500 punch from 0x2c3ae7d to 0x2c3b0eb, (0x26e bytes) 2024-09-11T06:18:14.935 INFO:teuthology.orchestra.run.smithi070.stdout:2501 read 0x21f5338 thru 0x21ffea2 (0xab6b bytes) 2024-09-11T06:18:14.935 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:14.935 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:14.936 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:14.936 INFO:teuthology.orchestra.run.smithi070.stdout:2502 writesame 0x13c7296 thru 0x13c75ed data_size 0x1(0x358 bytes) 2024-09-11T06:18:14.937 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:14.945 INFO:teuthology.orchestra.run.smithi070.stdout:2507 write 0x5ea4b3d thru 0x5eaa74b (0x5c0f bytes) 2024-09-11T06:18:14.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:14.951 INFO:teuthology.orchestra.run.smithi070.stdout:2508 trunc from 0x5eaa74c to 0x348bf36 2024-09-11T06:18:14.963 INFO:teuthology.orchestra.run.smithi070.stdout:2509 read 0x1b8262c thru 0x1b8d3dc (0xadb1 bytes) 2024-09-11T06:18:14.964 INFO:teuthology.orchestra.run.smithi070.stdout:2511 punch from 0x237f516 to 0x2387025, (0x7b0f bytes) 2024-09-11T06:18:14.965 INFO:teuthology.orchestra.run.smithi070.stdout:2513 trunc from 0x348bf36 to 0x226043c 2024-09-11T06:18:14.987 INFO:teuthology.orchestra.run.smithi070.stdout:2514 trunc from 0x226043c to 0x8285ba9 2024-09-11T06:18:14.992 INFO:teuthology.orchestra.run.smithi070.stdout:2515 read 0x20e924c thru 0x20f8087 (0xee3c bytes) 2024-09-11T06:18:15.005 INFO:teuthology.orchestra.run.smithi070.stdout:2517 write 0xdf7540f thru 0xdf8129b (0xbe8d bytes) 2024-09-11T06:18:15.010 INFO:teuthology.orchestra.run.smithi070.stdout:2519 writesame 0x35309d2 thru 0x3536330 data_size 0x1(0x595f bytes) 2024-09-11T06:18:15.017 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:15.016+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:15.023 INFO:teuthology.orchestra.run.smithi070.stdout:2520 writesame 0xc3f0c thru 0xc9f25 data_size 0x1(0x601a bytes) 2024-09-11T06:18:15.035 INFO:teuthology.orchestra.run.smithi070.stdout:2522 read 0x36b0092 thru 0x36ba61b (0xa58a bytes) 2024-09-11T06:18:15.041 INFO:teuthology.orchestra.run.smithi070.stdout:2523 trunc from 0xdf8129c to 0x8be6639 2024-09-11T06:18:15.051 INFO:teuthology.orchestra.run.smithi070.stdout:2524 read 0xefb446 thru 0xf06d51 (0xb90c bytes) 2024-09-11T06:18:15.052 INFO:teuthology.orchestra.run.smithi070.stdout:2525 write 0x27fff8e thru 0x28095b8 (0x962b bytes) 2024-09-11T06:18:15.057 INFO:teuthology.orchestra.run.smithi070.stdout:2526 trunc from 0x8be6639 to 0xb930d59 2024-09-11T06:18:15.072 INFO:teuthology.orchestra.run.smithi070.stdout:2528 writesame 0xeb07861 thru 0xeb116bb data_size 0x1(0x9e5b bytes) 2024-09-11T06:18:15.072 INFO:teuthology.orchestra.run.smithi070.stdout:2529 writesame 0x2598a71 thru 0x25a7c9f data_size 0x7(0xf22f bytes) 2024-09-11T06:18:15.073 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:15.073 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:15.073 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:15.073 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:15.073 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:15.077 INFO:teuthology.orchestra.run.smithi070.stdout:2530 punch from 0x731c699 to 0x732312e, (0x6a95 bytes) 2024-09-11T06:18:15.077 INFO:teuthology.orchestra.run.smithi070.stdout:2531 writesame 0x5a4f2b8 thru 0x5a59f92 data_size 0x13(0xacdb bytes) 2024-09-11T06:18:15.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:15.088 INFO:teuthology.orchestra.run.smithi070.stdout:2532 trunc from 0xeb116bc to 0x875173d 2024-09-11T06:18:15.095 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:15.095 INFO:teuthology.orchestra.run.smithi070.stdout:2535 read 0x793f28d thru 0x79410eb (0x1e5f bytes) 2024-09-11T06:18:15.108 INFO:teuthology.orchestra.run.smithi070.stdout:2538 writesame 0xed76317 thru 0xed769f3 data_size 0x1(0x6dd bytes) 2024-09-11T06:18:15.108 INFO:teuthology.orchestra.run.smithi070.stdout:2539 write 0xd9469fc thru 0xd94abee (0x41f3 bytes) 2024-09-11T06:18:15.111 INFO:teuthology.orchestra.run.smithi070.stdout:2541 read 0x87b6c8c thru 0x87c2792 (0xbb07 bytes) 2024-09-11T06:18:15.111 INFO:teuthology.orchestra.run.smithi070.stdout:2542 writesame 0xa2364d8 thru 0xa244f5f data_size 0x9e(0xea88 bytes) 2024-09-11T06:18:15.114 INFO:teuthology.orchestra.run.smithi070.stdout:2543 punch from 0x319bccd to 0x31a518b, (0x94be bytes) 2024-09-11T06:18:15.114 INFO:teuthology.orchestra.run.smithi070.stdout:2544 write 0x5fad591 thru 0x5fbcd1c (0xf78c bytes) 2024-09-11T06:18:15.118 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:15.116+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:15.118 INFO:teuthology.orchestra.run.smithi070.stdout:2545 read 0x8e1ee1 thru 0x8ee606 (0xc726 bytes) 2024-09-11T06:18:15.118 INFO:teuthology.orchestra.run.smithi070.stdout:2546 clone 18 order 21 su 1048576 sc 12 2024-09-11T06:18:15.198 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:15.198 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2271 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.938843073999998, 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012468982999999999, 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258004+0000", 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6419999999999999e-06 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258011+0000", 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4599999999999997e-06 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258025+0000", 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3804e-05 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258033+0000", 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4239999999999993e-06 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258089+0000", 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.588e-05 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258147+0000", 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000002e-05 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.260204+0000", 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020570269999999999 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270393+0000", 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010188657 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270403+0000", 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270437+0000", 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3373e-05 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270471+0000", 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4073999999999999e-05 2024-09-11T06:18:15.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2403 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.755206172999998, 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018324528999999999, 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2403 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441640+0000", 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441646+0000", 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441656+0000", 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0257e-05 2024-09-11T06:18:15.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441661+0000", 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0549999999999999e-06 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441710+0000", 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8446999999999999e-05 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441761+0000", 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1060999999999998e-05 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.444470+0000", 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027092539999999999 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459870+0000", 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015399629 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459881+0000", 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1382e-05 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459926+0000", 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4505000000000002e-05 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459963+0000", 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7759999999999998e-05 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.210 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28475 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2834432~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.852456347, 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011213330000000001, 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28475 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6899999999999997e-07 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344391+0000", 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2050000000000001e-06 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344398+0000", 2024-09-11T06:18:15.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3380000000000001e-06 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344403+0000", 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.882e-06 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355471+0000", 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011068056 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355528+0000", 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6821999999999999e-05 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355602+0000", 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4457999999999998e-05 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28476 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3162112~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.852436344000001, 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464858, 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28476 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3700000000000001e-07 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344411+0000", 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.052e-06 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344417+0000", 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344422+0000", 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7589999999999997e-06 2024-09-11T06:18:15.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355649+0000", 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011227305999999999 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355742+0000", 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2974999999999997e-05 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355874+0000", 2024-09-11T06:18:15.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013158000000000001 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28477 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3489792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.852417005, 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011629143999999999, 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28477 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344429+0000", 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.06e-07 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344445+0000", 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6001000000000001e-05 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344451+0000", 2024-09-11T06:18:15.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9569999999999996e-06 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344456+0000", 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8350000000000003e-06 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355921+0000", 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464919 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355991+0000", 2024-09-11T06:18:15.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9424000000000005e-05 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356057+0000", 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6501999999999994e-05 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28478 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3817472~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.852381048000002, 2024-09-11T06:18:15.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011937405, 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28478 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000003e-07 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344467+0000", 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344473+0000", 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344478+0000", 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8720000000000001e-06 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356268+0000", 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011790629 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356317+0000", 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8594999999999998e-05 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356401+0000", 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4469999999999996e-05 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28479 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4145152~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.852360848, 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012172307, 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28479 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344485+0000", 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344486+0000", 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.894e-06 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344493+0000", 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T06:18:15.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344497+0000", 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.464e-06 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356440+0000", 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011942790999999999 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356532+0000", 2024-09-11T06:18:15.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2093000000000001e-05 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356656+0000", 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012460800000000001 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28824 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3129344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.830685391999999, 2024-09-11T06:18:15.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011315202, 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28824 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366162+0000", 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8360000000000001e-06 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366167+0000", 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366172+0000", 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377208+0000", 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011035872 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377326+0000", 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118474 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377475+0000", 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148675 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28825 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3342336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.830667480999999, 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011577013000000001, 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28825 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366180+0000", 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7880000000000001e-06 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366185+0000", 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7309999999999998e-06 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366190+0000", 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377508+0000", 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011317763 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377595+0000", 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6674000000000004e-05 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377755+0000", 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015964899999999999 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28826 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3457024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.830648720999999, 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011917782, 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28826 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366197+0000", 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-07 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366233+0000", 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6746999999999999e-05 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366283+0000", 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9579000000000001e-05 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366289+0000", 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8799999999999996e-06 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377787+0000", 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011498058 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378003+0000", 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215553 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378114+0000", 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111576 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28827 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3670016~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.830545869000002, 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012035376, 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28827 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366300+0000", 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000004e-07 2024-09-11T06:18:15.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366307+0000", 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5850000000000002e-06 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366315+0000", 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4290000000000004e-06 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366319+0000", 2024-09-11T06:18:15.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6310000000000002e-06 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378147+0000", 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011827725000000001 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378228+0000", 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1207999999999999e-05 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378335+0000", 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010620699999999999 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28828 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3784704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.830518730000001, 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012221928999999999, 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28828 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366327+0000", 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366359+0000", 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2202000000000001e-05 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366415+0000", 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5828000000000001e-05 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366425+0000", 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0176e-05 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378366+0000", 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011941139 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378446+0000", 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0144999999999999e-05 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378548+0000", 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010201599999999999 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.255 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28829 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3997696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.83040965, 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012320490999999999, 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28829 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366436+0000", 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2200000000000003e-07 2024-09-11T06:18:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366439+0000", 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366446+0000", 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9580000000000001e-06 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366451+0000", 2024-09-11T06:18:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378579+0000", 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012127816 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378660+0000", 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1391999999999996e-05 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378756+0000", 2024-09-11T06:18:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5610000000000001e-05 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28830 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4112384~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.830386007000001, 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012505113, 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28830 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366461+0000", 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0159999999999998e-06 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366467+0000", 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7679999999999997e-06 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366472+0000", 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378786+0000", 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012313783 2024-09-11T06:18:15.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378863+0000", 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7307999999999999e-05 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378964+0000", 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101242 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28832 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.828790470000001, 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011082763000000001, 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28832 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368056+0000", 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6500000000000008e-07 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368060+0000", 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3800000000000004e-06 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368069+0000", 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0280000000000006e-06 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368076+0000", 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0690000000000004e-06 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378995+0000", 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010918638 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379071+0000", 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379137+0000", 2024-09-11T06:18:15.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6068000000000005e-05 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28892 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.826364380000001, 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011111242, 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28892 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6699999999999999e-07 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370483+0000", 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7320000000000001e-06 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370609+0000", 2024-09-11T06:18:15.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012621900000000001 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370907+0000", 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029802600000000001 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381393+0000", 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010486430999999999 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381481+0000", 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7565999999999995e-05 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381592+0000", 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110901 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28895 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3686400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:15.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.825804363, 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011282359, 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28895 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:15.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4799999999999999e-07 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371047+0000", 2024-09-11T06:18:15.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371055+0000", 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6149999999999999e-06 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371060+0000", 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.853e-06 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382125+0000", 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011064978 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382209+0000", 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3665000000000006e-05 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382323+0000", 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001145 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28896 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4014080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.825777808000002, 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011490497000000001, 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28896 2024-09-11T06:18:15.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371068+0000", 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371070+0000", 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.091e-06 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371076+0000", 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4389999999999997e-06 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371080+0000", 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2350000000000001e-06 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382360+0000", 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011279811000000001 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382447+0000", 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7306999999999996e-05 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382558+0000", 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110216 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:33858 3.1 e66/24 3:813e6a9a:::rbd_header.116de94696bd:head v 66'309, mlcod=65'307)", 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.97973245, 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.031257166000000003, 2024-09-11T06:18:15.282 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7700000000000001e-07 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217117+0000", 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247505+0000", 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030387882000000001 2024-09-11T06:18:15.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247521+0000", 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5610000000000001e-05 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247591+0000", 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0219e-05 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247617+0000", 2024-09-11T06:18:15.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6393999999999998e-05 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248310+0000", 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000693094 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248370+0000", 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9338e-05 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:37167 3.14 e71/24 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:head v 71'56, mlcod=69'54)", 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.907804349999999, 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020546310000000002, 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0699999999999998e-07 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298061+0000", 2024-09-11T06:18:15.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090201050000000005 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298090+0000", 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8428e-05 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298101+0000", 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1426999999999999e-05 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298180+0000", 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9118999999999999e-05 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298208+0000", 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7798999999999999e-05 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.309523+0000", 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011315488 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.309587+0000", 2024-09-11T06:18:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3637000000000001e-05 2024-09-11T06:18:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.291 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:15.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:15.293 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:15.292+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:18:15.393 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:15.393+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:15.421 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:15.422 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:15.422 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:15.422 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:15.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:15.495 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:15.494+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:15.542 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:15.542 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:15.543 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:15.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:15.596 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:15.595+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:15.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:15.657 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.036403534000002, 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:15.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:15.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:15.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.741967955999996, 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:15.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16929 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.467296892, 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041025210999999999, 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16929 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:15.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188737+0000", 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0380000000000001e-06 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188740+0000", 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188744+0000", 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229575+0000", 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040831329 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229656+0000", 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0924e-05 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229761+0000", 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105171 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16930 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.467283229000003, 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041241585999999997, 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16930 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188752+0000", 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188758+0000", 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188762+0000", 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229808+0000", 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041046760000000002 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229854+0000", 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5365999999999999e-05 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229991+0000", 2024-09-11T06:18:15.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013750200000000001 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:37167 3.14 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:head [write 0~16777216 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.379262561000001, 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041724397000000003, 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 37167 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:15.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276774+0000", 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3060000000000002e-06 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288416+0000", 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011642196 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288457+0000", 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1338999999999998e-05 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288476+0000", 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8698999999999998e-05 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288593+0000", 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116768 2024-09-11T06:18:15.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288719+0000", 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012601800000000001 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288853+0000", 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013385400000000001 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.315769+0000", 2024-09-11T06:18:15.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.026916852000000002 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318371+0000", 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026017319999999998 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318433+0000", 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2248000000000004e-05 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318495+0000", 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1384999999999996e-05 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38415 3.14 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:1b [sparse-read 11534336~65536 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310628881, 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040891906999999998, 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38415 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345405+0000", 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345406+0000", 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:18:15.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345412+0000", 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345417+0000", 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5950000000000001e-06 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386024+0000", 2024-09-11T06:18:15.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040607277999999997 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386117+0000", 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2938999999999999e-05 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386296+0000", 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017890199999999999 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38416 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.31059986, 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040903255999999999, 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38416 2024-09-11T06:18:15.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345434+0000", 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4899999999999995e-07 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345436+0000", 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345442+0000", 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-09-11T06:18:15.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345447+0000", 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386328+0000", 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040880623999999997 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386336+0000", 2024-09-11T06:18:15.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5909999999999996e-06 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38417 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310578924, 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040914271000000002, 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38417 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345456+0000", 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.815e-06 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345462+0000", 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5790000000000003e-06 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345467+0000", 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6770000000000003e-06 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386360+0000", 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040893850000000002 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386368+0000", 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9689999999999994e-06 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38418 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310559432, 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040926387000000002, 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38418 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9900000000000002e-07 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345476+0000", 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8479999999999999e-06 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345481+0000", 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7049999999999996e-06 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345486+0000", 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5260000000000004e-06 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386392+0000", 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040906388000000002 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386400+0000", 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6210000000000004e-06 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38419 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310535934000001, 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040920515999999997, 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38419 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345498+0000", 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6199999999999998e-07 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345500+0000", 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9230000000000001e-06 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345505+0000", 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949999999999997e-06 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345517+0000", 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878e-05 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386413+0000", 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040895542 2024-09-11T06:18:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386418+0000", 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.916e-06 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38420 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310495327, 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040904779000000002, 2024-09-11T06:18:15.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38420 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-07 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345540+0000", 2024-09-11T06:18:15.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0779999999999998e-06 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345546+0000", 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7830000000000004e-06 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345551+0000", 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2650000000000004e-06 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386436+0000", 2024-09-11T06:18:15.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040884283 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386442+0000", 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8059999999999997e-06 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38421 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310465925000001, 2024-09-11T06:18:15.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040905730000000001, 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38421 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345568+0000", 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.82e-07 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345577+0000", 2024-09-11T06:18:15.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1589999999999999e-06 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345584+0000", 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9519999999999997e-06 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345589+0000", 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7589999999999997e-06 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386465+0000", 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040876598 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386473+0000", 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38422 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310436601999999, 2024-09-11T06:18:15.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040898500999999997, 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38422 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:15.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345597+0000", 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9400000000000005e-07 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345603+0000", 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5890000000000002e-06 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345609+0000", 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0460000000000002e-06 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345618+0000", 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7939999999999997e-06 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386491+0000", 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040872261999999999 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386495+0000", 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.216e-06 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38423 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.718 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310407702999999, 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040888315000000001, 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38423 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345626+0000", 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345628+0000", 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2649999999999999e-06 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345634+0000", 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6330000000000001e-06 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345638+0000", 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8789999999999996e-06 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386508+0000", 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040870746999999999 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386514+0000", 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.722 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38424 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310376607, 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040887463999999998, 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38424 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345657+0000", 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7899999999999998e-07 2024-09-11T06:18:15.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345659+0000", 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345665+0000", 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3670000000000002e-06 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345670+0000", 2024-09-11T06:18:15.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6840000000000004e-06 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386537+0000", 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040867045999999997 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386544+0000", 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6850000000000004e-06 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38425 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310350484000001, 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040890702000000001, 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38425 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:18:15.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345685+0000", 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0660000000000002e-06 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345691+0000", 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7429999999999999e-06 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345703+0000", 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2520999999999999e-05 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386564+0000", 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040861055 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386573+0000", 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8980000000000002e-06 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38426 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310322878000001, 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040892365999999999, 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38426 2024-09-11T06:18:15.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345711+0000", 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7000000000000005e-07 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345713+0000", 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.153e-06 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345721+0000", 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7829999999999999e-06 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345726+0000", 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.045e-06 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386597+0000", 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040871636000000003 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386602+0000", 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:18:15.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38427 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310301252, 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040905245999999999, 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38427 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345734+0000", 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9290000000000001e-06 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345741+0000", 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5270000000000004e-06 2024-09-11T06:18:15.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345745+0000", 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0409999999999999e-06 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386629+0000", 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040883905999999998 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386637+0000", 2024-09-11T06:18:15.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4800000000000001e-06 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38428 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310269071, 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040899389000000001, 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38428 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345765+0000", 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1200000000000002e-07 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345767+0000", 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6359999999999998e-06 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345774+0000", 2024-09-11T06:18:15.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4330000000000001e-06 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345779+0000", 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6919999999999999e-06 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386657+0000", 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040877865999999999 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386663+0000", 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38429 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.310232631, 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040891017000000002, 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:15.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38429 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:15.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345801+0000", 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345803+0000", 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345809+0000", 2024-09-11T06:18:15.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.229e-06 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345827+0000", 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7907e-05 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386683+0000", 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040855626999999999 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:15.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386691+0000", 2024-09-11T06:18:15.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.602e-06 2024-09-11T06:18:15.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.747 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:15.747 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:15.747 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:15.748 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:15.749 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:no valid command found; 10 closest matches: 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:0 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:1 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:2 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:abort 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:assert 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:config diff 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:config diff get 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:config get 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:config help [] 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:config set ... 2024-09-11T06:18:15.750 INFO:teuthology.orchestra.run.smithi070.stderr:admin_socket: invalid command 2024-09-11T06:18:15.751 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-11T06:18:15.751 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:15.747+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:15.849 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:15.848+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:15.856 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:15.856 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:15.856 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:15.856 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:15.865 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:15.950 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:15.949+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:15.968 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:15.968 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:15.968 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:15.968 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:15.968 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:15.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:16.061 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:16.060+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:16.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.804141467999997, 2024-09-11T06:18:16.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:16.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:16.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:16.128 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.49156825, 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:16.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:16.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:16.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16521 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 114688~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.944714798, 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095026380000000008, 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16521 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:16.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:18:16.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175432+0000", 2024-09-11T06:18:16.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:18:16.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175438+0000", 2024-09-11T06:18:16.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:16.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175445+0000", 2024-09-11T06:18:16.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2219999999999996e-06 2024-09-11T06:18:16.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184800+0000", 2024-09-11T06:18:16.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009354322 2024-09-11T06:18:16.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184848+0000", 2024-09-11T06:18:16.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8398e-05 2024-09-11T06:18:16.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184932+0000", 2024-09-11T06:18:16.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4132e-05 2024-09-11T06:18:16.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.142 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.143 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16522 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 151552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.143 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:16.143 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.944623596, 2024-09-11T06:18:16.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096235079999999994, 2024-09-11T06:18:16.143 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.144 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.144 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.144 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16522 2024-09-11T06:18:16.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.145 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:16.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:16.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175522+0000", 2024-09-11T06:18:16.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1099999999999995e-07 2024-09-11T06:18:16.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175525+0000", 2024-09-11T06:18:16.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.619e-06 2024-09-11T06:18:16.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175535+0000", 2024-09-11T06:18:16.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6590000000000002e-06 2024-09-11T06:18:16.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175542+0000", 2024-09-11T06:18:16.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2570000000000001e-06 2024-09-11T06:18:16.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184976+0000", 2024-09-11T06:18:16.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094335619999999995 2024-09-11T06:18:16.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185064+0000", 2024-09-11T06:18:16.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8530999999999997e-05 2024-09-11T06:18:16.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185144+0000", 2024-09-11T06:18:16.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0168999999999998e-05 2024-09-11T06:18:16.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.154 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16523 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 188416~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.154 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:16.154 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.944592133999997, 2024-09-11T06:18:16.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099147300000000001, 2024-09-11T06:18:16.154 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.154 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.155 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.155 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16523 2024-09-11T06:18:16.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:16.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:16.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175553+0000", 2024-09-11T06:18:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-11T06:18:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175561+0000", 2024-09-11T06:18:16.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5369999999999997e-06 2024-09-11T06:18:16.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175571+0000", 2024-09-11T06:18:16.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7480000000000005e-06 2024-09-11T06:18:16.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175577+0000", 2024-09-11T06:18:16.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-06 2024-09-11T06:18:16.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185174+0000", 2024-09-11T06:18:16.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095965570000000004 2024-09-11T06:18:16.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185253+0000", 2024-09-11T06:18:16.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8889999999999999e-05 2024-09-11T06:18:16.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185467+0000", 2024-09-11T06:18:16.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021430099999999999 2024-09-11T06:18:16.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.164 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.164 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16524 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.164 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:16.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.944558137000001, 2024-09-11T06:18:16.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010599717999999999, 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16524 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:16.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:16.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175587+0000", 2024-09-11T06:18:16.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:18:16.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175589+0000", 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175596+0000", 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175601+0000", 2024-09-11T06:18:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185553+0000", 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099520630000000006 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185649+0000", 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6086000000000001e-05 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186186+0000", 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053697800000000002 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16553 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943808746999999, 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010060193, 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.171 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16553 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176340+0000", 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.405e-06 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176348+0000", 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8199999999999997e-06 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176354+0000", 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186219+0000", 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098650109999999999 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186298+0000", 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9383999999999998e-05 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186396+0000", 2024-09-11T06:18:16.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7387999999999997e-05 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16554 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943781631, 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010247795000000001, 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16554 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176364+0000", 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5799999999999998e-07 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176366+0000", 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176373+0000", 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4289999999999998e-06 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176377+0000", 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186427+0000", 2024-09-11T06:18:16.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010049742 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186511+0000", 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3991000000000003e-05 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186611+0000", 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9565e-05 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16555 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943759417000003, 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010729601, 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.181 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16555 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:16.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176386+0000", 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176388+0000", 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176395+0000", 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176400+0000", 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186644+0000", 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010244052 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186742+0000", 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8159999999999995e-05 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187115+0000", 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037263900000000002 2024-09-11T06:18:16.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16593 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943709097999999, 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011057091, 2024-09-11T06:18:16.186 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16593 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:16.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176436+0000", 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176439+0000", 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4509999999999999e-06 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176443+0000", 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6240000000000001e-06 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176446+0000", 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0649999999999999e-06 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187152+0000", 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010706194 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187231+0000", 2024-09-11T06:18:16.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8234999999999999e-05 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187492+0000", 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026178300000000002 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16594 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:16.191 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943689999999997, 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011362636000000001, 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16594 2024-09-11T06:18:16.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:16.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176455+0000", 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176457+0000", 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176463+0000", 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176469+0000", 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187542+0000", 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011073037000000001 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187615+0000", 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3013e-05 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187817+0000", 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020221099999999999 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16595 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943670935, 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011570079, 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16595 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.197 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176478+0000", 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176482+0000", 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176485+0000", 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9050000000000001e-06 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187855+0000", 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011370066999999999 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187951+0000", 2024-09-11T06:18:16.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5435999999999999e-05 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188044+0000", 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3010000000000006e-05 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.201 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16596 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943648865, 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011742973, 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16596 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176498+0000", 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0889999999999998e-06 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176504+0000", 2024-09-11T06:18:16.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176509+0000", 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188070+0000", 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01156101 2024-09-11T06:18:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188138+0000", 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7527999999999994e-05 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188239+0000", 2024-09-11T06:18:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100725 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16597 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943628947999997, 2024-09-11T06:18:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011917311999999999, 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16597 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176516+0000", 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176517+0000", 2024-09-11T06:18:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.658e-06 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176521+0000", 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9269999999999998e-06 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176526+0000", 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1110000000000001e-06 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188263+0000", 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011737632 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188340+0000", 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7113000000000005e-05 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188433+0000", 2024-09-11T06:18:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2538000000000001e-05 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16598 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943609590999998, 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012870312, 2024-09-11T06:18:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16598 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176538+0000", 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176546+0000", 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176550+0000", 2024-09-11T06:18:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.797e-06 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188466+0000", 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011915965000000001 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188550+0000", 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3446e-05 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189405+0000", 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085535500000000003 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16619 3.6 3:6708c1ee:::rbd_data.116d3c8aaf0c.000000000000002e:b [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.943358865, 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012975781, 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16619 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7199999999999998e-07 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176789+0000", 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-06 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176797+0000", 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6310000000000003e-06 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176803+0000", 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6710000000000004e-06 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189440+0000", 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012637438000000001 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189511+0000", 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1421000000000006e-05 2024-09-11T06:18:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189761+0000", 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024988799999999998 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:17472 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.889271626000003, 2024-09-11T06:18:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013625929, 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 17472 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230874+0000", 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2999999999999999e-07 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230878+0000", 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4209999999999997e-06 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230888+0000", 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0356e-05 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230895+0000", 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9530000000000002e-06 2024-09-11T06:18:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230940+0000", 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4589000000000003e-05 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230995+0000", 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5390000000000003e-05 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231196+0000", 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020024499999999999 2024-09-11T06:18:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231787+0000", 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059133700000000005 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244412+0000", 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012624803 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244460+0000", 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7802000000000001e-05 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244499+0000", 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9202999999999997e-05 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18219 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.865244949999997, 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011081077, 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18219 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254900+0000", 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-07 2024-09-11T06:18:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254905+0000", 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254916+0000", 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0949e-05 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254925+0000", 2024-09-11T06:18:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254972+0000", 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6826999999999997e-05 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255031+0000", 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9364000000000003e-05 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:18:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255240+0000", 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020845600000000001 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255893+0000", 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00065294500000000004 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265665+0000", 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097724279999999997 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265932+0000", 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267197 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265981+0000", 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8083e-05 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:31265 3.6 3:6434a7af:::rbd_data.116d6ab4d031.0000000000000065:head [write 0~16384 [fadvise_sequential+fadvise_nocache],write 32768~49152 [fadvise_sequential+fadvise_nocache],write 98304~49152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 27.492168437, 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094624770000000004, 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 31265 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627977+0000", 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:18:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628146+0000", 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000169629 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628156+0000", 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:18:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628163+0000", 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.058e-06 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628226+0000", 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3001000000000002e-05 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628379+0000", 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000153215 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628572+0000", 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019296999999999999 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.630117+0000", 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015450259999999999 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637285+0000", 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071677729999999997 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637393+0000", 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108248 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637438+0000", 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5555e-05 2024-09-11T06:18:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:46340 3.8 3:11013e39:::rbd_data.116da678facf.000000000000002c:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.316590042, 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010883662000000001, 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 46340 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803555+0000", 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803560+0000", 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3370000000000001e-06 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803570+0000", 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0002e-05 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803575+0000", 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803636+0000", 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1109000000000001e-05 2024-09-11T06:18:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803728+0000", 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2261000000000003e-05 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.805637+0000", 2024-09-11T06:18:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001908971 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814322+0000", 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086852560000000006 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814360+0000", 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7508000000000001e-05 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814402+0000", 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2051000000000001e-05 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814438+0000", 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6056999999999997e-05 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:16.247 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:16.248 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-11T06:18:16.250 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:16.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:16.251 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:16.251 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:16.251 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:16.251 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:16.252 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:16.252 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:16.248+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:16.263 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:16.263 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:16.279 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:16.279 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:16.295 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:16.295 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:16.298 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:16.299 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:16.350 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:16.349+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:16.418 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:16.418 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:16.427 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:16.470 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:16.470+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:16.487 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:16.487+0000 7f3969efe640 -1 osd.1 54 log_to_monitors true 2024-09-11T06:18:16.530 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:16.531 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:16.539 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:16.580 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:16.579+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:16.652 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:16.651+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:16.682 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:16.682 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:16.690 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:16.752 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:16.751+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:16.833 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:16.834 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:16.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:16.853 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:16.853+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:16.945 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:16.945 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:16.953 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:16.954 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:16.954+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:17.057 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:17.055+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:17.057 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:17.057 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:17.065 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:17.157 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:17.156+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:17.168 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:17.168 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:17.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:17.260 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:17.260+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:17.319 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:17.320 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:17.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:18:17.331 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:17.346 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:17.345+0000 7f395dcad640 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:18:17.359 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:17.358+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:17.460 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:17.459+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:17.474 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:17.475 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:17.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:17.496 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-11T06:18:17.560 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:17.560+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:17.605 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:17.605 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:17.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:17.662 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:17.661+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:17.680 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:17.681 INFO:teuthology.orchestra.run.smithi070.stdout:2548 write 0x4cb3955 thru 0x4cc19b7 (0xe063 bytes) 2024-09-11T06:18:17.701 INFO:teuthology.orchestra.run.smithi070.stdout:2549 trunc from 0xed769f4 to 0x325a8e9 2024-09-11T06:18:17.722 INFO:teuthology.orchestra.run.smithi070.stdout:2550 punch from 0x31c20f6 to 0x31c7634, (0x553e bytes) 2024-09-11T06:18:17.731 INFO:teuthology.orchestra.run.smithi070.stdout:2551 trunc from 0x325a8e9 to 0xb501156 2024-09-11T06:18:17.738 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:17.738 INFO:teuthology.orchestra.run.smithi070.stdout:2553 writesame 0xb2d9283 thru 0xb2e09de data_size 0x2(0x775c bytes) 2024-09-11T06:18:17.745 INFO:teuthology.orchestra.run.smithi070.stdout:2554 write 0xacb6c97 thru 0xacbd1f8 (0x6562 bytes) 2024-09-11T06:18:17.749 INFO:teuthology.orchestra.run.smithi070.stdout:2555 writesame 0x9279e6b thru 0x92878e8 data_size 0x1(0xda7e bytes) 2024-09-11T06:18:17.762 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:17.761+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:17.766 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:17.766 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:17.769 INFO:teuthology.orchestra.run.smithi070.stdout:2556 read 0x93a8506 thru 0x93a9147 (0xc42 bytes) 2024-09-11T06:18:17.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:17.780 INFO:teuthology.orchestra.run.smithi070.stdout:2557 trunc from 0xb501156 to 0x2a03791 2024-09-11T06:18:17.794 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:17.812 INFO:teuthology.orchestra.run.smithi070.stdout:2560 write 0xce81d8b thru 0xce91553 (0xf7c9 bytes) 2024-09-11T06:18:17.822 INFO:teuthology.orchestra.run.smithi070.stdout:2561 writesame 0xe2d227e thru 0xe2d7331 data_size 0x5(0x50b4 bytes) 2024-09-11T06:18:17.822 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:17.822 INFO:teuthology.orchestra.run.smithi070.stdout:2564 punch from 0xd61ccf2 to 0xd627cf5, (0xb003 bytes) 2024-09-11T06:18:17.822 INFO:teuthology.orchestra.run.smithi070.stdout:2565 write 0xd26f671 thru 0xd27a7e6 (0xb176 bytes) 2024-09-11T06:18:17.825 INFO:teuthology.orchestra.run.smithi070.stdout:2566 punch from 0x582bae1 to 0x5830079, (0x4598 bytes) 2024-09-11T06:18:17.825 INFO:teuthology.orchestra.run.smithi070.stdout:2568 writesame 0x3d81c1 thru 0x3d8947 data_size 0x1(0x787 bytes) 2024-09-11T06:18:17.827 INFO:teuthology.orchestra.run.smithi070.stdout:2569 writesame 0x55c18b5 thru 0x55ca725 data_size 0xa5(0x8e71 bytes) 2024-09-11T06:18:17.830 INFO:teuthology.orchestra.run.smithi070.stdout:2571 punch from 0x7c4ee36 to 0x7c5606d, (0x7237 bytes) 2024-09-11T06:18:17.830 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:17.831 INFO:teuthology.orchestra.run.smithi070.stdout:2575 read 0x890ebd9 thru 0x891a4c5 (0xb8ed bytes) 2024-09-11T06:18:17.831 INFO:teuthology.orchestra.run.smithi070.stdout:2576 punch from 0xa910f60 to 0xa9124da, (0x157a bytes) 2024-09-11T06:18:17.831 INFO:teuthology.orchestra.run.smithi070.stdout:2577 read 0xafd20ca thru 0xafd3420 (0x1357 bytes) 2024-09-11T06:18:17.831 INFO:teuthology.orchestra.run.smithi070.stdout:2578 read 0x4549b1b thru 0x454c6ed (0x2bd3 bytes) 2024-09-11T06:18:17.831 INFO:teuthology.orchestra.run.smithi070.stdout:2580 read 0x2bc007e thru 0x2bc3940 (0x38c3 bytes) 2024-09-11T06:18:17.842 INFO:teuthology.orchestra.run.smithi070.stdout:2581 trunc from 0xe2d7332 to 0x48223bf 2024-09-11T06:18:17.856 INFO:teuthology.orchestra.run.smithi070.stdout:2584 read 0x3db4c4b thru 0x3dbdeae (0x9264 bytes) 2024-09-11T06:18:17.858 INFO:teuthology.orchestra.run.smithi070.stdout:2585 trunc from 0x48223bf to 0x2cfe1ea 2024-09-11T06:18:17.862 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:17.862+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:17.865 INFO:teuthology.orchestra.run.smithi070.stdout:2586 writesame 0xa2c4f3 thru 0xa3919b data_size 0xb(0xcca9 bytes) 2024-09-11T06:18:17.887 INFO:teuthology.orchestra.run.smithi070.stdout:2589 writesame 0xd751aa9 thru 0xd760aaa data_size 0x1f(0xf002 bytes) 2024-09-11T06:18:17.887 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:17.894 INFO:teuthology.orchestra.run.smithi070.stdout:2593 trunc from 0xd760aab to 0x72e1af7 2024-09-11T06:18:17.900 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:17.900 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:17.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:17.913 INFO:teuthology.orchestra.run.smithi070.stdout:2594 write 0xbc162cf thru 0xbc254bd (0xf1ef bytes) 2024-09-11T06:18:17.915 INFO:teuthology.orchestra.run.smithi070.stdout:2595 writesame 0x76bcab0 thru 0x76be06c data_size 0x23(0x15bd bytes) 2024-09-11T06:18:17.918 INFO:teuthology.orchestra.run.smithi070.stdout:2597 read 0x2bc8385 thru 0x2bcb9eb (0x3667 bytes) 2024-09-11T06:18:17.932 INFO:teuthology.orchestra.run.smithi070.stdout:2599 trunc from 0xbc254be to 0xbd261 2024-09-11T06:18:17.963 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:17.963+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:17.981 INFO:teuthology.orchestra.run.smithi070.stdout:2600 writesame 0xaafe85f thru 0xab082db data_size 0x1(0x9a7d bytes) 2024-09-11T06:18:17.992 INFO:teuthology.orchestra.run.smithi070.stdout:2601 write 0xe90a528 thru 0xe90dcc2 (0x379b bytes) 2024-09-11T06:18:17.995 INFO:teuthology.orchestra.run.smithi070.stdout:2603 writesame 0x2605233 thru 0x2611583 data_size 0x7(0xc351 bytes) 2024-09-11T06:18:18.000 INFO:teuthology.orchestra.run.smithi070.stdout:2604 write 0x4f65500 thru 0x4f6d674 (0x8175 bytes) 2024-09-11T06:18:18.003 INFO:teuthology.orchestra.run.smithi070.stdout:2605 read 0x966628c thru 0x966e1b2 (0x7f27 bytes) 2024-09-11T06:18:18.004 INFO:teuthology.orchestra.run.smithi070.stdout:2606 punch from 0x694ddec to 0x6959a22, (0xbc36 bytes) 2024-09-11T06:18:18.004 INFO:teuthology.orchestra.run.smithi070.stdout:2608 write 0x53c67bc thru 0x53d24ee (0xbd33 bytes) 2024-09-11T06:18:18.008 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.008 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.017 INFO:teuthology.orchestra.run.smithi070.stdout:2613 trunc from 0xe90dcc3 to 0x5d39eac 2024-09-11T06:18:18.029 INFO:teuthology.orchestra.run.smithi070.stdout:2614 read 0x3c4ec50 thru 0x3c57874 (0x8c25 bytes) 2024-09-11T06:18:18.029 INFO:teuthology.orchestra.run.smithi070.stdout:2616 writesame 0xecdb2b thru 0xed8a5c data_size 0x27(0xaf32 bytes) 2024-09-11T06:18:18.034 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:18.035 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:18.041 INFO:teuthology.orchestra.run.smithi070.stdout:2617 writesame 0x845ebfe thru 0x84651f6 data_size 0x17(0x65f9 bytes) 2024-09-11T06:18:18.041 INFO:teuthology.orchestra.run.smithi070.stdout:2619 read 0x1ea1b0d thru 0x1ea5a9f (0x3f93 bytes) 2024-09-11T06:18:18.041 INFO:teuthology.orchestra.run.smithi070.stdout:2620 write 0x5185e1c thru 0x518f4ca (0x96af bytes) 2024-09-11T06:18:18.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:18.050 INFO:teuthology.orchestra.run.smithi070.stdout:2622 write 0x883d562 thru 0x88448d0 (0x736f bytes) 2024-09-11T06:18:18.053 INFO:teuthology.orchestra.run.smithi070.stdout:2623 read 0x6737e8e thru 0x67429c6 (0xab39 bytes) 2024-09-11T06:18:18.060 INFO:teuthology.orchestra.run.smithi070.stdout:2624 write 0x97683cc thru 0x9773b5a (0xb78f bytes) 2024-09-11T06:18:18.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:18.064+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:18.072 INFO:teuthology.orchestra.run.smithi070.stdout:2625 write 0xb959036 thru 0xb9623e9 (0x93b4 bytes) 2024-09-11T06:18:18.075 INFO:teuthology.orchestra.run.smithi070.stdout:2626 write 0x1e40a8e thru 0x1e49f2e (0x94a1 bytes) 2024-09-11T06:18:18.085 INFO:teuthology.orchestra.run.smithi070.stdout:2627 writesame 0xc2701ec thru 0xc27459b data_size 0x26(0x43b0 bytes) 2024-09-11T06:18:18.085 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.085 INFO:teuthology.orchestra.run.smithi070.stdout:2631 read 0x23438e5 thru 0x2350f07 (0xd623 bytes) 2024-09-11T06:18:18.085 INFO:teuthology.orchestra.run.smithi070.stdout:2632 read 0x3d9cb17 thru 0x3da3e3a (0x7324 bytes) 2024-09-11T06:18:18.099 INFO:teuthology.orchestra.run.smithi070.stdout:2633 trunc from 0xc27459c to 0x486a16 2024-09-11T06:18:18.111 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.117 INFO:teuthology.orchestra.run.smithi070.stdout:2635 writesame 0x87b051 thru 0x87b127 data_size 0x1(0xd7 bytes) 2024-09-11T06:18:18.117 INFO:teuthology.orchestra.run.smithi070.stdout:2636 punch from 0x86a322 to 0x87878e, (0xe46c bytes) 2024-09-11T06:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout:2638 writesame 0xc1613a thru 0xc19832 data_size 0x1(0x36f9 bytes) 2024-09-11T06:18:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:2640 read 0x95f1da thru 0x964817 (0x563e bytes) 2024-09-11T06:18:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:2641 read 0x6f919e thru 0x705dc9 (0xcc2c bytes) 2024-09-11T06:18:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:2642 read 0x4e0588 thru 0x4ebe27 (0xb8a0 bytes) 2024-09-11T06:18:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:2644 read 0x539572 thru 0x54156c (0x7ffb bytes) 2024-09-11T06:18:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:2645 punch from 0x7bb288 to 0x7bf017, (0x3d8f bytes) 2024-09-11T06:18:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:2646 read 0x867329 thru 0x870fec (0x9cc4 bytes) 2024-09-11T06:18:18.133 INFO:teuthology.orchestra.run.smithi070.stdout:2650 writesame 0x3131cfe thru 0x313d2f2 data_size 0x1(0xb5f5 bytes) 2024-09-11T06:18:18.134 INFO:teuthology.orchestra.run.smithi070.stdout:2651 read 0xd601ed thru 0xd65a80 (0x5894 bytes) 2024-09-11T06:18:18.134 INFO:teuthology.orchestra.run.smithi070.stdout:2652 write 0x2c38d4b thru 0x2c3c74d (0x3a03 bytes) 2024-09-11T06:18:18.154 INFO:teuthology.orchestra.run.smithi070.stdout:2653 write 0xc7b6b9b thru 0xc7bd41c (0x6882 bytes) 2024-09-11T06:18:18.157 INFO:teuthology.orchestra.run.smithi070.stdout:2655 punch from 0x4175209 to 0x418236a, (0xd161 bytes) 2024-09-11T06:18:18.158 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.158 INFO:teuthology.orchestra.run.smithi070.stdout:2658 read 0x86d1c80 thru 0x86dc0b3 (0xa434 bytes) 2024-09-11T06:18:18.158 INFO:teuthology.orchestra.run.smithi070.stdout:2660 punch from 0x7469bbe to 0x746d791, (0x3bd3 bytes) 2024-09-11T06:18:18.158 INFO:teuthology.orchestra.run.smithi070.stdout:2661 read 0x74a2a6 thru 0x74a8ac (0x607 bytes) 2024-09-11T06:18:18.158 INFO:teuthology.orchestra.run.smithi070.stdout:2662 punch from 0xbc70cd8 to 0xbc767c3, (0x5aeb bytes) 2024-09-11T06:18:18.158 INFO:teuthology.orchestra.run.smithi070.stdout:2663 read 0x26aa399 thru 0x26b8864 (0xe4cc bytes) 2024-09-11T06:18:18.158 INFO:teuthology.orchestra.run.smithi070.stdout:2664 write 0x109c1d1 thru 0x109f081 (0x2eb1 bytes) 2024-09-11T06:18:18.160 INFO:teuthology.orchestra.run.smithi070.stdout:2665 write 0x43c5b40 thru 0x43ca47c (0x493d bytes) 2024-09-11T06:18:18.163 INFO:teuthology.orchestra.run.smithi070.stdout:2666 read 0xb5eb7e6 thru 0xb5f9c5c (0xe477 bytes) 2024-09-11T06:18:18.163 INFO:teuthology.orchestra.run.smithi070.stdout:2667 punch from 0xa42a48f to 0xa437162, (0xccd3 bytes) 2024-09-11T06:18:18.163 INFO:teuthology.orchestra.run.smithi070.stdout:2668 write 0x86f4984 thru 0x86fc5cd (0x7c4a bytes) 2024-09-11T06:18:18.165 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:18.164+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:18.166 INFO:teuthology.orchestra.run.smithi070.stdout:2669 read 0x38a9c5a thru 0x38b9241 (0xf5e8 bytes) 2024-09-11T06:18:18.166 INFO:teuthology.orchestra.run.smithi070.stdout:2670 read 0x313ee3d thru 0x3147d4b (0x8f0f bytes) 2024-09-11T06:18:18.168 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:18.168 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:18.171 INFO:teuthology.orchestra.run.smithi070.stdout:2672 write 0xcd6afef thru 0xcd6db31 (0x2b43 bytes) 2024-09-11T06:18:18.175 INFO:teuthology.orchestra.run.smithi070.stdout:2673 writesame 0x34d8251 thru 0x34da81b data_size 0x1(0x25cb bytes) 2024-09-11T06:18:18.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.180 INFO:teuthology.orchestra.run.smithi070.stdout:2675 punch from 0x59be03 to 0x5a20dc, (0x62d9 bytes) 2024-09-11T06:18:18.181 INFO:teuthology.orchestra.run.smithi070.stdout:2678 trunc from 0xcd6db32 to 0xd3d6ae7 2024-09-11T06:18:18.194 INFO:teuthology.orchestra.run.smithi070.stdout:2679 write 0xe3d1298 thru 0xe3d6b1d (0x5886 bytes) 2024-09-11T06:18:18.198 INFO:teuthology.orchestra.run.smithi070.stdout:2680 writesame 0xb8630ef thru 0xb865ece data_size 0x10(0x2de0 bytes) 2024-09-11T06:18:18.202 INFO:teuthology.orchestra.run.smithi070.stdout:2681 read 0xa83beb7 thru 0xa842187 (0x62d1 bytes) 2024-09-11T06:18:18.202 INFO:teuthology.orchestra.run.smithi070.stdout:2682 punch from 0x98a67e to 0x98e545, (0x3ec7 bytes) 2024-09-11T06:18:18.202 INFO:teuthology.orchestra.run.smithi070.stdout:2685 read 0x9204589 thru 0x9211e4b (0xd8c3 bytes) 2024-09-11T06:18:18.202 INFO:teuthology.orchestra.run.smithi070.stdout:2687 read 0x5f49104 thru 0x5f5527f (0xc17c bytes) 2024-09-11T06:18:18.202 INFO:teuthology.orchestra.run.smithi070.stdout:2688 write 0x770865 thru 0x776b6e (0x630a bytes) 2024-09-11T06:18:18.205 INFO:teuthology.orchestra.run.smithi070.stdout:2690 write 0x728cc7c thru 0x7297a9d (0xae22 bytes) 2024-09-11T06:18:18.213 INFO:teuthology.orchestra.run.smithi070.stdout:2691 trunc from 0xe3d6b1e to 0xb1bae45 2024-09-11T06:18:18.224 INFO:teuthology.orchestra.run.smithi070.stdout:2693 read 0x5effb2 thru 0x5ff4e2 (0xf531 bytes) 2024-09-11T06:18:18.224 INFO:teuthology.orchestra.run.smithi070.stdout:2694 punch from 0x2e392b0 to 0x2e42f1f, (0x9c6f bytes) 2024-09-11T06:18:18.227 INFO:teuthology.orchestra.run.smithi070.stdout:2695 trunc from 0xb1bae45 to 0xdb7bf3d 2024-09-11T06:18:18.233 INFO:teuthology.orchestra.run.smithi070.stdout:2696 read 0x2a264d thru 0x2ae9ee (0xc3a2 bytes) 2024-09-11T06:18:18.233 INFO:teuthology.orchestra.run.smithi070.stdout:2697 write 0x7ff37ad thru 0x7ff7ef4 (0x4748 bytes) 2024-09-11T06:18:18.237 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.237 INFO:teuthology.orchestra.run.smithi070.stdout:2701 read 0x76b901f thru 0x76bae70 (0x1e52 bytes) 2024-09-11T06:18:18.237 INFO:teuthology.orchestra.run.smithi070.stdout:2702 punch from 0x44beb7b to 0x44c030a, (0x178f bytes) 2024-09-11T06:18:18.237 INFO:teuthology.orchestra.run.smithi070.stdout:2703 writesame 0x2db72ff thru 0x2dc1844 data_size 0x5(0xa546 bytes) 2024-09-11T06:18:18.241 INFO:teuthology.orchestra.run.smithi070.stdout:2707 punch from 0x817e96b to 0x818cf5b, (0xe5f0 bytes) 2024-09-11T06:18:18.242 INFO:teuthology.orchestra.run.smithi070.stdout:2711 punch from 0x8907d1f to 0x8912f76, (0xb257 bytes) 2024-09-11T06:18:18.248 INFO:teuthology.orchestra.run.smithi070.stdout:2713 write 0xe386502 thru 0xe38c4c8 (0x5fc7 bytes) 2024-09-11T06:18:18.252 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.252 INFO:teuthology.orchestra.run.smithi070.stdout:2715 write 0x7cc13bd thru 0x7cc7380 (0x5fc4 bytes) 2024-09-11T06:18:18.254 INFO:teuthology.orchestra.run.smithi070.stdout:2717 writesame 0x40ddf98 thru 0x40eddc2 data_size 0x45(0xfe2b bytes) 2024-09-11T06:18:18.256 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:18.256 INFO:teuthology.orchestra.run.smithi070.stdout:2720 clone 19 order 19 su 16384 sc 13 2024-09-11T06:18:18.266 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:18.266+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:18.292 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:18.292 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:18.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:18.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:18.331 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:18:18.367 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:18.366+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:18.441 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:18.441 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:18.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:18.457 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:18.468 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:18.467+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:18.476 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:18.476 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-11T06:18:18.493 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:18.493 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:18.509 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:18.509 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:18.526 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:18.527 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:18.558 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:18.558 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:18.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:18.568+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:18.576 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:18.576 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:18.576 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:18.576 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:18.576 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:18.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:18.589 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:18.589 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:18.606 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:18.607 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:18.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:18.668+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:18.694 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.073181707000003, 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.778746128999998, 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16929 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.504075065000002, 2024-09-11T06:18:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041025210999999999, 2024-09-11T06:18:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16929 2024-09-11T06:18:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188736+0000", 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188737+0000", 2024-09-11T06:18:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0380000000000001e-06 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188740+0000", 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188744+0000", 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4989999999999999e-06 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229575+0000", 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040831329 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229656+0000", 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0924e-05 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229761+0000", 2024-09-11T06:18:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105171 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:16930 3.11 3:8b3146e1:::rbd_data.116d3c8aaf0c.0000000000000088:b [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.504061401999998, 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041241585999999997, 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 16930 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188750+0000", 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188752+0000", 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.779e-06 2024-09-11T06:18:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188758+0000", 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6370000000000004e-06 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.188762+0000", 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229808+0000", 2024-09-11T06:18:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041046760000000002 2024-09-11T06:18:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229854+0000", 2024-09-11T06:18:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5365999999999999e-05 2024-09-11T06:18:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:34.229991+0000", 2024-09-11T06:18:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013750200000000001 2024-09-11T06:18:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:37167 3.14 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:head [write 0~16777216 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.416040733999999, 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041724397000000003, 2024-09-11T06:18:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 37167 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276770+0000", 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.276774+0000", 2024-09-11T06:18:18.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3060000000000002e-06 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288416+0000", 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011642196 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288457+0000", 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1338999999999998e-05 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288476+0000", 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8698999999999998e-05 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288593+0000", 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116768 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288719+0000", 2024-09-11T06:18:18.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012601800000000001 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.288853+0000", 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013385400000000001 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.315769+0000", 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.026916852000000002 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318371+0000", 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026017319999999998 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318433+0000", 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2248000000000004e-05 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.318495+0000", 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1384999999999996e-05 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38415 3.14 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:1b [sparse-read 11534336~65536 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347407054000001, 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040891906999999998, 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38415 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345404+0000", 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345405+0000", 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345406+0000", 2024-09-11T06:18:18.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345412+0000", 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8830000000000003e-06 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345417+0000", 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5950000000000001e-06 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386024+0000", 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040607277999999997 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386117+0000", 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2938999999999999e-05 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386296+0000", 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017890199999999999 2024-09-11T06:18:18.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38416 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347378032999998, 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040903255999999999, 2024-09-11T06:18:18.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38416 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345433+0000", 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345434+0000", 2024-09-11T06:18:18.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4899999999999995e-07 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345436+0000", 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345442+0000", 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4690000000000002e-06 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345447+0000", 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386328+0000", 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040880623999999997 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386336+0000", 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5909999999999996e-06 2024-09-11T06:18:18.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38417 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347357097, 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040914271000000002, 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38417 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345454+0000", 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345456+0000", 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.815e-06 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345462+0000", 2024-09-11T06:18:18.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5790000000000003e-06 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345467+0000", 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6770000000000003e-06 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386360+0000", 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040893850000000002 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386368+0000", 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9689999999999994e-06 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38418 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347337605, 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040926387000000002, 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38418 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345474+0000", 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9900000000000002e-07 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345476+0000", 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8479999999999999e-06 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345481+0000", 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7049999999999996e-06 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345486+0000", 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5260000000000004e-06 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386392+0000", 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040906388000000002 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386400+0000", 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6210000000000004e-06 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38419 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347314106999999, 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040920515999999997, 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38419 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345497+0000", 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345498+0000", 2024-09-11T06:18:18.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6199999999999998e-07 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345500+0000", 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9230000000000001e-06 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345505+0000", 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949999999999997e-06 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345517+0000", 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878e-05 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386413+0000", 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040895542 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386418+0000", 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.916e-06 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38420 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.3472735, 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040904779000000002, 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38420 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345538+0000", 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-07 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345540+0000", 2024-09-11T06:18:18.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0779999999999998e-06 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345546+0000", 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7830000000000004e-06 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345551+0000", 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2650000000000004e-06 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386436+0000", 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040884283 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386442+0000", 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8059999999999997e-06 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38421 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347244098000001, 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040905730000000001, 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38421 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345567+0000", 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345568+0000", 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.82e-07 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345577+0000", 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1589999999999999e-06 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345584+0000", 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9519999999999997e-06 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345589+0000", 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7589999999999997e-06 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386465+0000", 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040876598 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386473+0000", 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38422 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347214775000001, 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040898500999999997, 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38422 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345596+0000", 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345597+0000", 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9400000000000005e-07 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345603+0000", 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5890000000000002e-06 2024-09-11T06:18:18.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345609+0000", 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0460000000000002e-06 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345618+0000", 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7939999999999997e-06 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386491+0000", 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040872261999999999 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386495+0000", 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.216e-06 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38423 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:18.767 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347185876000001, 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040888315000000001, 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38423 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345625+0000", 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345626+0000", 2024-09-11T06:18:18.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:18:18.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345628+0000", 2024-09-11T06:18:18.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2649999999999999e-06 2024-09-11T06:18:18.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345634+0000", 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6330000000000001e-06 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345638+0000", 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8789999999999996e-06 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386508+0000", 2024-09-11T06:18:18.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040870746999999999 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386514+0000", 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3730000000000001e-06 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38424 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:18.772 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.34715478, 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040887463999999998, 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38424 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345656+0000", 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345657+0000", 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7899999999999998e-07 2024-09-11T06:18:18.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345659+0000", 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345665+0000", 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3670000000000002e-06 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345670+0000", 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6840000000000004e-06 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386537+0000", 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040867045999999997 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386544+0000", 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6850000000000004e-06 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38425 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347128656999999, 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040890702000000001, 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38425 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:18.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345683+0000", 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345685+0000", 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0660000000000002e-06 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345691+0000", 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7429999999999999e-06 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345703+0000", 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2520999999999999e-05 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386564+0000", 2024-09-11T06:18:18.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040861055 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386573+0000", 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8980000000000002e-06 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38426 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347101050999999, 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040892365999999999, 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38426 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345710+0000", 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345711+0000", 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7000000000000005e-07 2024-09-11T06:18:18.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345713+0000", 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.153e-06 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345721+0000", 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7829999999999999e-06 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345726+0000", 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.045e-06 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386597+0000", 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040871636000000003 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386602+0000", 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.786 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38427 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.786 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:18.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347079425, 2024-09-11T06:18:18.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040905245999999999, 2024-09-11T06:18:18.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38427 2024-09-11T06:18:18.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:18.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:18.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345732+0000", 2024-09-11T06:18:18.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:18.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345734+0000", 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9290000000000001e-06 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345741+0000", 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5270000000000004e-06 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345745+0000", 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0409999999999999e-06 2024-09-11T06:18:18.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386629+0000", 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040883905999999998 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386637+0000", 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4800000000000001e-06 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38428 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347047243999999, 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040899389000000001, 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38428 2024-09-11T06:18:18.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345764+0000", 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345765+0000", 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1200000000000002e-07 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345767+0000", 2024-09-11T06:18:18.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6359999999999998e-06 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345774+0000", 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4330000000000001e-06 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345779+0000", 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6919999999999999e-06 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386657+0000", 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040877865999999999 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386663+0000", 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38429 3.14 3.c2d568b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.347010804, 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040891017000000002, 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:18.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38429 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345800+0000", 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345801+0000", 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:18:18.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345803+0000", 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345809+0000", 2024-09-11T06:18:18.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.229e-06 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.345827+0000", 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7907e-05 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386683+0000", 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040855626999999999 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:18.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.386691+0000", 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.602e-06 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:18.803 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:18.805 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:18.805 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:18.804+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:18.906 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:18.905+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:18.910 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:18.910 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:18.910 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:18.910 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:18.918 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:19.006 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:19.006+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:19.021 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:19.021 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:19.021 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:19.021 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:19.021 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:19.029 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:19.114 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:19.113+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.857249084999999, 2024-09-11T06:18:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 53.544675867000002, 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16521 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 114688~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.997822415000002, 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095026380000000008, 2024-09-11T06:18:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16521 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175430+0000", 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175432+0000", 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:18:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175438+0000", 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175445+0000", 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2219999999999996e-06 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184800+0000", 2024-09-11T06:18:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.009354322 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184848+0000", 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8398e-05 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184932+0000", 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4132e-05 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16522 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 151552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.997731213000002, 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0096235079999999994, 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16522 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175521+0000", 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175522+0000", 2024-09-11T06:18:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1099999999999995e-07 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175525+0000", 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.619e-06 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175535+0000", 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6590000000000002e-06 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175542+0000", 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2570000000000001e-06 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.184976+0000", 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094335619999999995 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185064+0000", 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8530999999999997e-05 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185144+0000", 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0168999999999998e-05 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16523 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 188416~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.997699750999999, 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099147300000000001, 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16523 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175552+0000", 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175553+0000", 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9699999999999996e-07 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175561+0000", 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5369999999999997e-06 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175571+0000", 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7480000000000005e-06 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175577+0000", 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1999999999999999e-06 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185174+0000", 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0095965570000000004 2024-09-11T06:18:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185253+0000", 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8889999999999999e-05 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185467+0000", 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021430099999999999 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16524 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.997665754000003, 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010599717999999999, 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16524 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175586+0000", 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175587+0000", 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175589+0000", 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175596+0000", 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4359999999999999e-06 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.175601+0000", 2024-09-11T06:18:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0200000000000002e-06 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185553+0000", 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0099520630000000006 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.185649+0000", 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6086000000000001e-05 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186186+0000", 2024-09-11T06:18:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00053697800000000002 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16553 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 16384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996916364, 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010060193, 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16553 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176336+0000", 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176340+0000", 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.405e-06 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176348+0000", 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8199999999999997e-06 2024-09-11T06:18:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176354+0000", 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.46e-06 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186219+0000", 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0098650109999999999 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186298+0000", 2024-09-11T06:18:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9383999999999998e-05 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186396+0000", 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7387999999999997e-05 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16554 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 53248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996889248000002, 2024-09-11T06:18:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010247795000000001, 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16554 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176363+0000", 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176364+0000", 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5799999999999998e-07 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176366+0000", 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176373+0000", 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4289999999999998e-06 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176377+0000", 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186427+0000", 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010049742 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186511+0000", 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3991000000000003e-05 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186611+0000", 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9565e-05 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16555 3.6 3:655498db:::rbd_data.116d3c8aaf0c.0000000000000002:b [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996867033999997, 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010729601, 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16555 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176385+0000", 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176386+0000", 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176388+0000", 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.604e-06 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176395+0000", 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176400+0000", 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7759999999999997e-06 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186644+0000", 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010244052 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.186742+0000", 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8159999999999995e-05 2024-09-11T06:18:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187115+0000", 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00037263900000000002 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16593 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 8192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996816715000001, 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011057091, 2024-09-11T06:18:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16593 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176435+0000", 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176436+0000", 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3900000000000004e-07 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176439+0000", 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4509999999999999e-06 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176443+0000", 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6240000000000001e-06 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176446+0000", 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0649999999999999e-06 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187152+0000", 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010706194 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187231+0000", 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8234999999999999e-05 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187492+0000", 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00026178300000000002 2024-09-11T06:18:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16594 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 45056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996797616999999, 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011362636000000001, 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16594 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176454+0000", 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176455+0000", 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7e-07 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176457+0000", 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.046e-06 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176463+0000", 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176469+0000", 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187542+0000", 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011073037000000001 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187615+0000", 2024-09-11T06:18:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3013e-05 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187817+0000", 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020221099999999999 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16595 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996778552000002, 2024-09-11T06:18:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011570079, 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16595 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176474+0000", 2024-09-11T06:18:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:18:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176478+0000", 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176482+0000", 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176485+0000", 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9050000000000001e-06 2024-09-11T06:18:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187855+0000", 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011370066999999999 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.187951+0000", 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5435999999999999e-05 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188044+0000", 2024-09-11T06:18:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3010000000000006e-05 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16596 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996756482000002, 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011742973, 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16596 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176496+0000", 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176498+0000", 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0889999999999998e-06 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176504+0000", 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176509+0000", 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188070+0000", 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01156101 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188138+0000", 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7527999999999994e-05 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188239+0000", 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100725 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16597 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996736564999999, 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011917311999999999, 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16597 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176515+0000", 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176516+0000", 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176517+0000", 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.658e-06 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176521+0000", 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9269999999999998e-06 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176526+0000", 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1110000000000001e-06 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188263+0000", 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011737632 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188340+0000", 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7113000000000005e-05 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188433+0000", 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2538000000000001e-05 2024-09-11T06:18:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16598 3.6 3:665dbb95:::rbd_data.116d3c8aaf0c.0000000000000019:b [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996717208, 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012870312, 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16598 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176535+0000", 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6100000000000001e-07 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176538+0000", 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3250000000000002e-06 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176546+0000", 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9629999999999998e-06 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176550+0000", 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.797e-06 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188466+0000", 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011915965000000001 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.188550+0000", 2024-09-11T06:18:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3446e-05 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189405+0000", 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085535500000000003 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:16619 3.6 3:6708c1ee:::rbd_data.116d3c8aaf0c.000000000000002e:b [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.996466482000002, 2024-09-11T06:18:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012975781, 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 16619 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176786+0000", 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7199999999999998e-07 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176789+0000", 2024-09-11T06:18:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.96e-06 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176797+0000", 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6310000000000003e-06 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.176803+0000", 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6710000000000004e-06 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189440+0000", 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012637438000000001 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189511+0000", 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1421000000000006e-05 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.189761+0000", 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024988799999999998 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:17472 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.942379242999998, 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.013625929, 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 17472 2024-09-11T06:18:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230873+0000", 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230874+0000", 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2999999999999999e-07 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230878+0000", 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4209999999999997e-06 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230888+0000", 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0356e-05 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230895+0000", 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9530000000000002e-06 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230940+0000", 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4589000000000003e-05 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.230995+0000", 2024-09-11T06:18:19.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5390000000000003e-05 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231196+0000", 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020024499999999999 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.231787+0000", 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00059133700000000005 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:19.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244412+0000", 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012624803 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244460+0000", 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7802000000000001e-05 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.244499+0000", 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9202999999999997e-05 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:18219 3.19 3:9c111694:::rbd_object_map.116d55772b3c.000000000000000c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 44.918352566999999, 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011081077, 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 18219 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.258 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254899+0000", 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254900+0000", 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-07 2024-09-11T06:18:19.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254905+0000", 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254916+0000", 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0949e-05 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254925+0000", 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.254972+0000", 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6826999999999997e-05 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255031+0000", 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9364000000000003e-05 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 1", 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255240+0000", 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00020845600000000001 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.255893+0000", 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00065294500000000004 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265665+0000", 2024-09-11T06:18:19.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0097724279999999997 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265932+0000", 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000267197 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:34.265981+0000", 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8083e-05 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:31265 3.6 3:6434a7af:::rbd_data.116d6ab4d031.0000000000000065:head [write 0~16384 [fadvise_sequential+fadvise_nocache],write 32768~49152 [fadvise_sequential+fadvise_nocache],write 98304~49152 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.545276053999999, 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0094624770000000004, 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 31265 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627976+0000", 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.627977+0000", 2024-09-11T06:18:19.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628146+0000", 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000169629 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628156+0000", 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628163+0000", 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.058e-06 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628226+0000", 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3001000000000002e-05 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628379+0000", 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000153215 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.628572+0000", 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00019296999999999999 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.630117+0000", 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0015450259999999999 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637285+0000", 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0071677729999999997 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637393+0000", 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000108248 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.637438+0000", 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5555e-05 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.269 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:46340 3.8 3:11013e39:::rbd_data.116da678facf.000000000000002c:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.369697659, 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.010883662000000001, 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 46340 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803554+0000", 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803555+0000", 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803560+0000", 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3370000000000001e-06 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803570+0000", 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0002e-05 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803575+0000", 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:18:19.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803636+0000", 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1109000000000001e-05 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.803728+0000", 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2261000000000003e-05 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.805637+0000", 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001908971 2024-09-11T06:18:19.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814322+0000", 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0086852560000000006 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814360+0000", 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7508000000000001e-05 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:19.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814402+0000", 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2051000000000001e-05 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:05.814438+0000", 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6056999999999997e-05 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.275 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:19.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:19.277 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:19.276+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:19.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:19.377+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3.ac0e573a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.086244229000000006, 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.086266247000000004, 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-11T06:18:19.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:19.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-11T06:18:19.434 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-09-11T06:18:19.435 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:19.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:19.481 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:19.480+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:19.579 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:19.579+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:19.583 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:19.583 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:19.592 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:19.680 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:19.680+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:19.737 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29678 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3145728~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299669424000001, 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025653072999999998, 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.738 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29678 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436312+0000", 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4699999999999998e-07 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436314+0000", 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1349999999999999e-06 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436317+0000", 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9689999999999999e-06 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436319+0000", 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5959999999999998e-06 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461843+0000", 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025523883000000001 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461888+0000", 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5073e-05 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461965+0000", 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7169999999999995e-05 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.742 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29679 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3260416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299659653999999, 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025777099000000001, 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.743 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29679 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:19.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436323+0000", 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0079999999999999e-06 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436326+0000", 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436329+0000", 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461989+0000", 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025660388999999999 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462029+0000", 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9854000000000002e-05 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462099+0000", 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0167999999999996e-05 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29680 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3473408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.747 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299650136, 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025900241000000001, 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29680 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.748 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436332+0000", 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1899999999999999e-07 2024-09-11T06:18:19.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436333+0000", 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.049e-06 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436336+0000", 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8830000000000002e-06 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436338+0000", 2024-09-11T06:18:19.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4700000000000001e-06 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462122+0000", 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025784081 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462162+0000", 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9774999999999998e-05 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462232+0000", 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9764000000000005e-05 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29681 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3588096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299638578, 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026043075999999998, 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29681 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:19.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436344+0000", 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436348+0000", 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-06 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436350+0000", 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462257+0000", 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025906966999999999 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462304+0000", 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7448999999999999e-05 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462386+0000", 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.174e-05 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29682 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.756 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299628568999999, 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026216950999999999, 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29682 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:18:19.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436354+0000", 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436357+0000", 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436360+0000", 2024-09-11T06:18:19.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.464e-06 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462412+0000", 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026052230999999999 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462459+0000", 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7207999999999999e-05 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462570+0000", 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110968 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29683 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299619133, 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026370945, 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.761 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29683 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:19.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436363+0000", 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436364+0000", 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436367+0000", 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436369+0000", 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5059999999999998e-06 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462606+0000", 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026237114999999998 2024-09-11T06:18:19.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462653+0000", 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462733+0000", 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0605999999999994e-05 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29684 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299609527000001, 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026632194000000001, 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.766 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29684 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.767 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436373+0000", 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6899999999999996e-07 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436376+0000", 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9699999999999999e-06 2024-09-11T06:18:19.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436379+0000", 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462758+0000", 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026378990000000001 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462846+0000", 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8641999999999996e-05 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463004+0000", 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015788 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.770 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29685 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299600012999999, 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026764263, 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29685 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:19.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436383+0000", 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436386+0000", 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436388+0000", 2024-09-11T06:18:19.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6570000000000001e-06 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463023+0000", 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026634722 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463068+0000", 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5025999999999999e-05 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463146+0000", 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7729000000000001e-05 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29686 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299590024, 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026966905999999999, 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29686 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:19.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436393+0000", 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436396+0000", 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.915e-06 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436398+0000", 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463173+0000", 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026774703 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463242+0000", 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9770000000000005e-05 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463358+0000", 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116038 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29687 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.779 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299580796000001, 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027120658999999998, 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29687 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436402+0000", 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436405+0000", 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8899999999999999e-06 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436407+0000", 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:19.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463391+0000", 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026983285999999999 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463433+0000", 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2481999999999997e-05 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463521+0000", 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8373000000000002e-05 2024-09-11T06:18:19.783 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29688 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299571395000001, 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027291494999999999, 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29688 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436411+0000", 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-06 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436414+0000", 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8940000000000002e-06 2024-09-11T06:18:19.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436417+0000", 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5069999999999999e-06 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463562+0000", 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027144622 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463621+0000", 2024-09-11T06:18:19.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9108999999999999e-05 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463702+0000", 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29689 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299561868000001, 2024-09-11T06:18:19.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027435349000000001, 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29689 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436423+0000", 2024-09-11T06:18:19.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436426+0000", 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0010000000000002e-06 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436429+0000", 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4739999999999999e-06 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463726+0000", 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027297482000000001 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463780+0000", 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3714000000000001e-05 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463855+0000", 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5278000000000007e-05 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29690 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299550055000001, 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027575023000000001, 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29690 2024-09-11T06:18:19.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436433+0000", 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436436+0000", 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8959999999999999e-06 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436438+0000", 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.514e-06 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463880+0000", 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027442151000000001 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463924+0000", 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3983000000000002e-05 2024-09-11T06:18:19.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464007+0000", 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2274000000000005e-05 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29691 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299539958, 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027733827999999999, 2024-09-11T06:18:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29691 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436443+0000", 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.279e-06 2024-09-11T06:18:19.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436446+0000", 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436449+0000", 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464034+0000", 2024-09-11T06:18:19.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027585492 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464082+0000", 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7444999999999997e-05 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464175+0000", 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3954000000000002e-05 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29692 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5439488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299530128000001, 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027927924, 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29692 2024-09-11T06:18:19.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436452+0000", 2024-09-11T06:18:19.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436453+0000", 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1179999999999999e-06 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436456+0000", 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436458+0000", 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464214+0000", 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027755618999999999 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464266+0000", 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2354000000000001e-05 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464379+0000", 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011328900000000001 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29693 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5554176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299520726000001, 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028112022, 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.806 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29693 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436462+0000", 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.031e-06 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436465+0000", 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3230000000000002e-06 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436468+0000", 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4870000000000001e-06 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464414+0000", 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027946104999999999 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464468+0000", 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3637999999999997e-05 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464573+0000", 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105232 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.810 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29694 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5767168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299510784999999, 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028256073999999999, 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.811 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29694 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436472+0000", 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436475+0000", 2024-09-11T06:18:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8870000000000001e-06 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436478+0000", 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464591+0000", 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028113171999999999 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464643+0000", 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950999999999998e-05 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464727+0000", 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4133000000000002e-05 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29695 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5881856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:19.815 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299501086999999, 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02845924, 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29695 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:19.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436482+0000", 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.111e-06 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436485+0000", 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436487+0000", 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5859999999999999e-06 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464762+0000", 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028274773 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464848+0000", 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6269999999999999e-05 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464940+0000", 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1345e-05 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.819 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29696 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6094848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299491357000001, 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028603799999999999, 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.820 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29696 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436491+0000", 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.879999999999999e-07 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436494+0000", 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8339999999999999e-06 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436497+0000", 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.328e-06 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464970+0000", 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028473196999999999 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465017+0000", 2024-09-11T06:18:19.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465094+0000", 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6606999999999993e-05 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29697 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6209536~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:19.824 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.299478742000002, 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028751832000000001, 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29697 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:19.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436504+0000", 2024-09-11T06:18:19.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.319e-06 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436508+0000", 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2729999999999998e-06 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436510+0000", 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:19.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465125+0000", 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028614537999999998 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465174+0000", 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8965000000000003e-05 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465255+0000", 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0798999999999997e-05 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:19.829 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:19.829 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:19.830 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:19.831 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:19.829+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:19.931 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:19.931+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:19.975 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:19.975 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:19.975 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:19.975 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:19.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:20.032 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:20.031+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:20.126 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:20.127 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:20.133 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:20.132+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:20.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:20.234 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:20.233+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:20.279 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:20.279 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751533036000001, 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:20.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:18:20.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751514586999999, 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:18:20.284 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:18:20.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751483790000002, 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:20.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:18:20.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751464781999999, 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:18:20.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.298 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751446114, 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:18:20.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:18:20.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751424055000001, 2024-09-11T06:18:20.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:20.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751405191, 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.311 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751385410000001, 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.312 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:18:20.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:18:20.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:20.316 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751366482000002, 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.320 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751326001999999, 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:20.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:18:20.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.324 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.751295892999998, 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.325 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.329 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.749204697, 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:20.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.333 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.749127776000002, 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.749103475999998, 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.338 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:18:20.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:18:20.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:20.342 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.749068056999999, 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:20.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:18:20.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.749050853, 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:18:20.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:20.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:18:20.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.749034590000001, 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.351 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:18:20.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:20.355 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.749017612999999, 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:18:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.749001627999998, 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.363 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 31.748983659, 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.364 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:18:20.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:18:20.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:18:20.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.368 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.368 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.368 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:20.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:18:20.370 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:20.370 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:20.368+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:20.470 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:20.469+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:20.516 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:20.516 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:20.516 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:20.516 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:20.524 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:20.608 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:20.608+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:20.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:20.667 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:20.667 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:20.667 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:20.667 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:20.668 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:20.671 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:20.670+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:20.676 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:20.738 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:20.739 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:20.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:20.755 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:20.755 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:20.772 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:20.771+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:20.773 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:20.774 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:20.790 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:20.807 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:20.808 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:20.820 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:20.820 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578983051000002, 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.821 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:18:20.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578970312999999, 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:18:20.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:20.830 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578959179999998, 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:20.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:18:20.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578948592000003, 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.835 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:18:20.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:18:20.839 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578938096999998, 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.840 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:20.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578927784000001, 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.845 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578917242000003, 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.849 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:18:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.853 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578906936000003, 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:18:20.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.858 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578891358, 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:18:20.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:18:20.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.578872353000001, 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:20.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.867 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519342979999998, 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:18:20.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:18:20.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519324509, 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.872 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:18:20.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519306018999998, 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.877 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:18:20.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.881 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519288951, 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:18:20.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519270919999997, 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.886 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:18:20.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:20.890 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519248736000002, 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:18:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:18:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:18:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:18:20.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:20.895 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519230743999998, 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:18:20.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519213090000001, 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.900 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:18:20.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519190174000002, 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:18:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:18:20.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.909 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.519171786000001, 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:20.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:18:20.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:20.914 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:20.915 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:20.916 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:20.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:20.917 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:20.918 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:20.918 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:20.919 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:20.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T06:18:20.920 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:20.915+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:21.016 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:21.015+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:21.066 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:21.066 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:21.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:21.117 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:21.117+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:21.218 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:21.218+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:21.221 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:21.221 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:21.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:21.319 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:21.318+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:21.333 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:21.333 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:21.341 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:21.348 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:18:21.348 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T06:18:21.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T06:18:21.453 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:21.452+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:21.511 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:21.511 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:21.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:21.520+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:21.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:21.621 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:21.621+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:21.719 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:21.720 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:21.722 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:21.721+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:21.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:21.823 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:21.822+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:21.886 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:21.886 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:21.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:21.924 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:21.924+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:22.025 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:22.024+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:22.038 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:22.038 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:22.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:22.131 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:22.130+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:22.190 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:22.190 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:22.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:22.240 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:22.239+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:22.328 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:22.327+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:22.342 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:22.342 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:22.348 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T06:18:22.352 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:22.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T06:18:22.448 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:22.447+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:22.461 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:22.461 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:22.470 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:22.530 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:22.529+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:22.573 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:22.573 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:22.582 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:22.665 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:22.665+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:22.724 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:22.725 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:22.732 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:22.731+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:22.733 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:22.833 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:22.832+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:22.877 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:22.877 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:22.886 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:22.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:22.965 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:22.964+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:22.988 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:22.988 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:22.997 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:23.034 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:23.033+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:23.040 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:23.040 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:23.057 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:23.057 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:23.073 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:23.073 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:23.088 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:23.088 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:23.101 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:23.101 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:23.105 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:23.110 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:23.122 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:23.138 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:23.138 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:23.153 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:23.153+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:23.155 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:23.155 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:23.214 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:23.214 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:23.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:23.236 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:23.235+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:23.338 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:23.337+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:23.356 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T06:18:23.368 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:23.368 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:23.368 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:23.368 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:23.368 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:23.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:18:23.372 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T06:18:23.377 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:23.462 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:23.462+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:23.508 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995251535000001, 2024-09-11T06:18:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:18:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:18:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995233085999999, 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:18:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:18:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:18:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995202288999998, 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995183281000003, 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:18:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:18:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995164613, 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:18:23.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995142553999997, 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:18:23.550 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.99512369, 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:18:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995103909000001, 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.559 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995084980999998, 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.563 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:18:23.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.567 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995044501000002, 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.995014392000002, 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.572 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.575 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992923196, 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.576 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:18:23.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992846274999998, 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.580 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:18:23.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992821974999998, 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:18:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992786555999999, 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:18:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:18:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992769352000003, 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992753088999997, 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:18:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992736112000003, 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:18:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992720126999998, 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:18:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.992702158, 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:18:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:23.614 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:23.616 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:23.616 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:23.615+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:23.716 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:23.716+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:23.759 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:23.759 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:23.759 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:23.759 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:23.767 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:23.789 INFO:teuthology.orchestra.run.smithi070.stdout:2721 write 0xce19420 thru 0xce24d21 (0xb902 bytes) 2024-09-11T06:18:23.802 INFO:teuthology.orchestra.run.smithi070.stdout:2723 writesame 0x639970e thru 0x6399f7b data_size 0x2(0x86e bytes) 2024-09-11T06:18:23.804 INFO:teuthology.orchestra.run.smithi070.stdout:2724 write 0x29ee62a thru 0x29f5c0c (0x75e3 bytes) 2024-09-11T06:18:23.806 INFO:teuthology.orchestra.run.smithi070.stdout:2725 write 0xd142dfa thru 0xd14ff00 (0xd107 bytes) 2024-09-11T06:18:23.815 INFO:teuthology.orchestra.run.smithi070.stdout:2727 writesame 0xe2a3d88 thru 0xe2afdb0 data_size 0x1(0xc029 bytes) 2024-09-11T06:18:23.827 INFO:teuthology.orchestra.run.smithi070.stdout:2730 write 0xe13dbfe thru 0xe14aada (0xcedd bytes) 2024-09-11T06:18:23.829 INFO:teuthology.orchestra.run.smithi070.stdout:2733 read 0x30e3416 thru 0x30e4696 (0x1281 bytes) 2024-09-11T06:18:23.830 INFO:teuthology.orchestra.run.smithi070.stdout:2735 clone 20 order 20 su 4096 sc 11 2024-09-11T06:18:23.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:23.852+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:23.911 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:23.911 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:23.911 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:23.918 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:23.918+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:23.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:24.019 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:24.019+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822790105999999, 2024-09-11T06:18:24.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:18:24.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:18:24.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:18:24.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822777367999997, 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:24.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822766235000003, 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:18:24.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822755647000001, 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:18:24.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:18:24.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.083 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822745152000003, 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:24.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:18:24.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:18:24.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822734838999999, 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:24.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.092 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822724297000001, 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.096 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822713991000001, 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.097 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:18:24.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822698412999998, 2024-09-11T06:18:24.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.105 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.822679407999999, 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.763150035000002, 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.110 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:18:24.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:18:24.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.763131563999998, 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:18:24.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:18:24.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.763113074000003, 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.119 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:18:24.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:18:24.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.763096005999998, 2024-09-11T06:18:24.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:18:24.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:18:24.127 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.763077975000002, 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:18:24.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:18:24.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:24.132 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.763055790999999, 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:18:24.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.763037799000003, 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.137 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:18:24.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:18:24.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:18:24.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.763020144999999, 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:18:24.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:18:24.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.762997229, 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:18:24.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 35.762978840999999, 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:24.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:18:24.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:24.155 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:24.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:24.157 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:24.156+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:24.257 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:24.256+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:24.267 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:24.268 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:24.268 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:24.276 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:24.354 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:18:24.357 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T06:18:24.358 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:24.357+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:24.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T06:18:24.389 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:24.389 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:24.389 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:24.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:24.485 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:24.484+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:24.551 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1f 93/92 [PushOp(3:facac228:::rbd_data.116de94696bd.0000000000000003:head, version: 66'135, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:facac228:::rbd_data.116de94696bd.0000000000000003:head@66'135, size: 3997696, copy_subset: [(0, 3997696)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.343244+0000", 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.2039684819999996, 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021785699999999999, 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.343244+0000", 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.343244+0000", 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.343245+0000", 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.23e-07 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.344320+0000", 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010753410000000001 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.344342+0000", 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2263e-05 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.344359+0000", 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6314999999999999e-05 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.344458+0000", 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9236999999999999e-05 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.344467+0000", 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.884e-06 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.345423+0000", 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00095580700000000003 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.10 93/92 [PushOp(3:0cb2799b:::rbd_data.116d6ab4d031.000000000000000b:head, version: 63'136, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:0cb2799b:::rbd_data.116d6ab4d031.000000000000000b:head@63'136, size: 1835008, copy_subset: [(0, 1835008)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.344390+0000", 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.2028225570000002, 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001868104, 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.344390+0000", 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.344390+0000", 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.344390+0000", 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7700000000000005e-07 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.345308+0000", 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091730200000000005 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.345326+0000", 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8159e-05 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.345342+0000", 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6592999999999999e-05 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.345423+0000", 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0148999999999994e-05 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.345435+0000", 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1936999999999999e-05 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.346258+0000", 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082348700000000003 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.560 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1f 93/92 [PushOp(3:facac228:::rbd_data.116de94696bd.0000000000000003:head, version: 66'135, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:facac228:::rbd_data.116de94696bd.0000000000000003:head@66'135, size: 3997696, copy_subset: [(0, 3997696)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.346066+0000", 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.2011462159999997, 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019871020000000001, 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.346066+0000", 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.346066+0000", 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.346067+0000", 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2799999999999996e-07 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.347108+0000", 2024-09-11T06:18:24.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001041396 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.347123+0000", 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5102e-05 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.347134+0000", 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0352e-05 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.347215+0000", 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1489000000000005e-05 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.347229+0000", 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3797e-05 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.348053+0000", 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082433799999999998 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.10 93/92 [PushOp(3:08d3ef6c:::rbd_data.116de94696bd.0000000000000005:head, version: 66'138, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:08d3ef6c:::rbd_data.116de94696bd.0000000000000005:head@66'138, size: 3981312, copy_subset: [(0, 3981312)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.349777+0000", 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1974356860000004, 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022458320000000001, 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.349777+0000", 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.349777+0000", 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.349777+0000", 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:18:24.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.351046+0000", 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001268459 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.351060+0000", 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4158999999999999e-05 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.351069+0000", 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0890000000000006e-06 2024-09-11T06:18:24.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.351128+0000", 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9577999999999998e-05 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.351138+0000", 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8039999999999996e-06 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.352023+0000", 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088436199999999997 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.10 93/92 [PushOp(3:08d3ef6c:::rbd_data.116de94696bd.0000000000000005:head, version: 66'138, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:08d3ef6c:::rbd_data.116de94696bd.0000000000000005:head@66'138, size: 3981312, copy_subset: [(0, 3981312)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.353908+0000", 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1933043840000002, 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019557390000000002, 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.353908+0000", 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.353908+0000", 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.353908+0000", 2024-09-11T06:18:24.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.355052+0000", 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011436059999999999 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.355065+0000", 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3439e-05 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.355075+0000", 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0057e-05 2024-09-11T06:18:24.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.355141+0000", 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5398e-05 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.355151+0000", 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0407999999999999e-05 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.355864+0000", 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000712574 2024-09-11T06:18:24.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.10 93/92 [PushOp(3:0fdd888c:::rbd_data.116d5f814563.0000000000000006:head, version: 68'139, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:0fdd888c:::rbd_data.116d5f814563.0000000000000006:head@68'139, size: 2097152, copy_subset: [(0, 2097152)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.360777+0000", 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1864353999999997, 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022315630000000002, 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.360777+0000", 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.360777+0000", 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.360778+0000", 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7e-07 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.361784+0000", 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010063959999999999 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.361800+0000", 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5962000000000001e-05 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.361811+0000", 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0912e-05 2024-09-11T06:18:24.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.361896+0000", 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4843000000000001e-05 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.361918+0000", 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1824e-05 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.363009+0000", 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001091156 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.10 93/92 [PushOp(3:0fdd888c:::rbd_data.116d5f814563.0000000000000006:head, version: 68'139, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:0fdd888c:::rbd_data.116d5f814563.0000000000000006:head@68'139, size: 2097152, copy_subset: [(0, 2097152)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.363552+0000", 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1836605230000004, 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022471430000000001, 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.363552+0000", 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.363552+0000", 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.363552+0000", 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7899999999999999e-07 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.364576+0000", 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001023209 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.364590+0000", 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4695000000000001e-05 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.364617+0000", 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6571999999999999e-05 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.364701+0000", 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4417000000000002e-05 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.364719+0000", 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7583000000000001e-05 2024-09-11T06:18:24.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.365799+0000", 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010801879999999999 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.10 93/92 [PushOp(3:0eef5a57:::rbd_data.116d51ead02d.0000000000000002:head, version: 82'162, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:0eef5a57:::rbd_data.116d51ead02d.0000000000000002:head@82'162, size: 12094422, copy_subset: [(0, 12094422)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.371088+0000", 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1761243280000002, 2024-09-11T06:18:24.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021872860000000001, 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.371088+0000", 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.371088+0000", 2024-09-11T06:18:24.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.371089+0000", 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8299999999999998e-07 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.372109+0000", 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010204039999999999 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.372124+0000", 2024-09-11T06:18:24.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5079000000000001e-05 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.372135+0000", 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1001e-05 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.372209+0000", 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3572000000000006e-05 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.372224+0000", 2024-09-11T06:18:24.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5611e-05 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.373275+0000", 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010512360000000001 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.10 93/92 [PushOp(3:0eef5a57:::rbd_data.116d51ead02d.0000000000000002:head, version: 82'162, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:0eef5a57:::rbd_data.116d51ead02d.0000000000000002:head@82'162, size: 12094422, copy_subset: [(0, 12094422)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.373776+0000", 2024-09-11T06:18:24.585 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1734369960000004, 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023188290000000001, 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.373776+0000", 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.373776+0000", 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.373776+0000", 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7999999999999995e-07 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.375284+0000", 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015075449999999999 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.375300+0000", 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6512e-05 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.375311+0000", 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0447e-05 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.375377+0000", 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5924000000000001e-05 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.375385+0000", 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8449999999999992e-06 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.376094+0000", 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070897600000000005 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.10 93/92 [PushOp(3:08c72a59:::rbd_data.116d2cbdd9a2.0000000000000000:head, version: 84'163, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:08c72a59:::rbd_data.116d2cbdd9a2.0000000000000000:head@84'163, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.378340+0000", 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1688722120000001, 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023234890000000002, 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.378340+0000", 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.378340+0000", 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.378341+0000", 2024-09-11T06:18:24.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.379371+0000", 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010305030000000001 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.379388+0000", 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6781000000000001e-05 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.379399+0000", 2024-09-11T06:18:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0827e-05 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.379477+0000", 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7956999999999999e-05 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.379486+0000", 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9099999999999994e-06 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.380664+0000", 2024-09-11T06:18:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011780149999999999 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1c 93/92 [PushOp(3:3d874dc4:::rbd_data.116d2cbdd9a2.0000000000000001:head, version: 84'98, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d874dc4:::rbd_data.116d2cbdd9a2.0000000000000001:head@84'98, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.393302+0000", 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1539109080000003, 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002445671, 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.393302+0000", 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.393302+0000", 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.393302+0000", 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.394571+0000", 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001268592 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.394586+0000", 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5061e-05 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.394599+0000", 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3535e-05 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.394675+0000", 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5092000000000005e-05 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.394685+0000", 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0400999999999999e-05 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.395747+0000", 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010623550000000001 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.a 93/92 [PushOp(3:576fb12e:::rbd_data.116d2cbdd9a2.0000000000000003:head, version: 84'108, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:576fb12e:::rbd_data.116d2cbdd9a2.0000000000000003:head@84'108, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:19.402146+0000", 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1450662469999999, 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018656549999999999, 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.402146+0000", 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.402146+0000", 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.402147+0000", 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7199999999999999e-07 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.402735+0000", 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058864900000000001 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.402753+0000", 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7808999999999998e-05 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.402768+0000", 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.49e-05 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.402849+0000", 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0489999999999997e-05 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.402865+0000", 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5942000000000001e-05 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:19.404012+0000", 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001147293 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1a 94/93 [PushOp(3:5c5f8cb1:::rbd_data.116d6ab4d031.0000000000000005:head, version: 63'113, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5c5f8cb1:::rbd_data.116d6ab4d031.0000000000000005:head@63'113, size: 1835008, copy_subset: [(0, 1835008)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:20.347062+0000", 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2001501619999999, 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022367110000000002, 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.347062+0000", 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.347062+0000", 2024-09-11T06:18:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.347063+0000", 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999997e-07 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.348184+0000", 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001121007 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.348203+0000", 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9366999999999999e-05 2024-09-11T06:18:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.348214+0000", 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1234e-05 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.348312+0000", 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7787000000000004e-05 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.348327+0000", 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4956e-05 2024-09-11T06:18:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.349299+0000", 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00097184599999999995 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1a 94/93 [PushOp(3:5eb93234:::rbd_data.116d6ab4d031.000000000000000d:head, version: 63'115, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5eb93234:::rbd_data.116d6ab4d031.000000000000000d:head@63'115, size: 1851392, copy_subset: [(0, 1851392)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:20.352289+0000", 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1949230889999995, 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022940299999999999, 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.352289+0000", 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.352289+0000", 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.352290+0000", 2024-09-11T06:18:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5499999999999997e-07 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.353342+0000", 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010516379999999999 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.353361+0000", 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8949000000000001e-05 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.353372+0000", 2024-09-11T06:18:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1243000000000001e-05 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.353448+0000", 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5723999999999995e-05 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.353461+0000", 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2879e-05 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.354583+0000", 2024-09-11T06:18:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001122842 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1a 94/93 [PushOp(3:5f39d133:::rbd_data.116d5f814563.0000000000000002:head, version: 68'117, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5f39d133:::rbd_data.116d5f814563.0000000000000002:head@68'117, size: 2097152, copy_subset: [(0, 2097152)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:20.359809+0000", 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1874030849999997, 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022036069999999998, 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.359809+0000", 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.359809+0000", 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.359810+0000", 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1800000000000004e-07 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.360981+0000", 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001170574 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.361008+0000", 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6622e-05 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.361025+0000", 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7880000000000002e-05 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.361116+0000", 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0914000000000004e-05 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.361126+0000", 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3070000000000008e-06 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.362013+0000", 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088739199999999998 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1a 94/93 [PushOp(3:5a4ad8a5:::rbd_data.116da678facf.0000000000000007:head, version: 79'205, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5a4ad8a5:::rbd_data.116da678facf.0000000000000007:head@79'205, size: 2031616, copy_subset: [(0, 2031616)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:20.382830+0000", 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1643824159999996, 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022835500000000001, 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.382830+0000", 2024-09-11T06:18:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.382830+0000", 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.382831+0000", 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3900000000000004e-07 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.383948+0000", 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011172720000000001 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.383972+0000", 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4029999999999999e-05 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.383990+0000", 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8082999999999999e-05 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.384084+0000", 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3287000000000003e-05 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.384099+0000", 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5071e-05 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.385114+0000", 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001014968 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1a 94/93 [PushOp(3:5935e311:::rbd_data.116d2cbdd9a2.0000000000000012:head, version: 84'208, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5935e311:::rbd_data.116d2cbdd9a2.0000000000000012:head@84'208, size: 1048576, copy_subset: [(0, 1048576)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:20.389507+0000", 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1577051220000003, 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019111060000000001, 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.389507+0000", 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.389507+0000", 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.389508+0000", 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6300000000000005e-07 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.390571+0000", 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010633540000000001 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.390588+0000", 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6980999999999999e-05 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.390599+0000", 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1208e-05 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.390656+0000", 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6181999999999998e-05 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.390664+0000", 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9249999999999995e-06 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.391418+0000", 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075489299999999997 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1a 94/93 [PushOp(3:5e3ba92d:::rbd_data.116d4d1f1cd7.0000000000000005:head, version: 88'218, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5e3ba92d:::rbd_data.116d4d1f1cd7.0000000000000005:head@88'218, size: 3145728, copy_subset: [(0, 3145728)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:20.394639+0000", 2024-09-11T06:18:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1525737119999997, 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001896813, 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.394639+0000", 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.394639+0000", 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.394639+0000", 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5499999999999998e-07 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.395629+0000", 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098963499999999999 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.395647+0000", 2024-09-11T06:18:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7985000000000001e-05 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.395658+0000", 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1114000000000001e-05 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.395751+0000", 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3305000000000002e-05 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.395765+0000", 2024-09-11T06:18:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3849000000000001e-05 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.396536+0000", 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077037000000000004 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(3.1a 94/93 [PushOp(3:5af10b75:::rbd_data.116d4d1f1cd7.0000000000000007:head, version: 88'220, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5af10b75:::rbd_data.116d4d1f1cd7.0000000000000007:head@88'220, size: 3670016, copy_subset: [(0, 3670016)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:20.403921+0000", 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1432915149999996, 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001913524, 2024-09-11T06:18:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.403921+0000", 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.403921+0000", 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.403922+0000", 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4700000000000001e-07 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.405009+0000", 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00108785 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.405026+0000", 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6835999999999999e-05 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.405042+0000", 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5777000000000002e-05 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.405117+0000", 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4795000000000005e-05 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.405126+0000", 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8429999999999999e-06 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:20.405835+0000", 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00070877600000000005 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:62034 3.1c 3:385ba62e:::rbd_id.image_client.0-clone17:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97)", 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:23.499816+0000", 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.0473963319999999, 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022221390000000001, 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 62034 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.499816+0000", 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.499816+0000", 2024-09-11T06:18:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.499818+0000", 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.761e-06 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.499825+0000", 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8770000000000004e-06 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.499837+0000", 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.238e-05 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.499844+0000", 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0330000000000003e-06 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.499914+0000", 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0094999999999999e-05 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.499925+0000", 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.024e-05 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.501809+0000", 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00188397 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.501920+0000", 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111554 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:23.502038+0000", 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118229 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:24.632 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:24.634 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:24.632+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:24.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:24.735 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:24.734+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:24.776 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:24.777 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:24.777 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:24.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:24.835 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:24.835+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:24.927 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:24.927 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:24.927 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:24.927 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:24.928 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:24.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:24.936 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:24.935+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:25.037 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:25.037+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:25.080 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.395369286999994, 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:18:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.275373048999995, 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:25.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:25.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:25.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:25.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28883 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.708492747999998, 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020291813999999998, 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28883 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370295+0000", 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370297+0000", 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.21e-06 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370303+0000", 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4479999999999999e-06 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370309+0000", 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3040000000000004e-06 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390350+0000", 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020040842 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390438+0000", 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8446e-05 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390586+0000", 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014808399999999999 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38581 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791433906000002, 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020052018000000001, 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38581 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287354+0000", 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287356+0000", 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4030000000000001e-06 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287362+0000", 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9710000000000001e-06 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287367+0000", 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307187+0000", 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019820397999999999 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307279+0000", 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1417999999999998e-05 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307405+0000", 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126265 2024-09-11T06:18:25.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38582 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3211264~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791412425000001, 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020273138999999999, 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38582 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287377+0000", 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0990000000000001e-06 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287383+0000", 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287388+0000", 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8149999999999996e-06 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307438+0000", 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020050081000000001 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307527+0000", 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9476999999999997e-05 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307648+0000", 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120226 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38583 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3997696~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791393189000001, 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020512203999999999, 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38583 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287401+0000", 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1500000000000002e-06 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287408+0000", 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1750000000000002e-06 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287413+0000", 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0640000000000001e-06 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307690+0000", 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020277067999999999 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307779+0000", 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9071000000000002e-05 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307906+0000", 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012727600000000001 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38584 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 4784128~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791367353999998, 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020729899, 2024-09-11T06:18:25.111 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38584 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:25.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287422+0000", 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1560000000000002e-06 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287427+0000", 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2299999999999999e-06 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287439+0000", 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1263999999999999e-05 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307939+0000", 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020499962 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308026+0000", 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7787000000000005e-05 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308150+0000", 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123082 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38585 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 5570560~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791203866, 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782914, 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38585 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287584+0000", 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-07 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287587+0000", 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3979999999999999e-06 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287595+0000", 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6899999999999992e-06 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287601+0000", 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308194+0000", 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593066 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308290+0000", 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6405999999999998e-05 2024-09-11T06:18:25.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308366+0000", 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5727000000000002e-05 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38586 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 6356992~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791176402000001, 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021009344999999999, 2024-09-11T06:18:25.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38586 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287613+0000", 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.43e-06 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287620+0000", 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0789999999999997e-06 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287630+0000", 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0328e-05 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308412+0000", 2024-09-11T06:18:25.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782281999999999 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308505+0000", 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2492999999999997e-05 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308620+0000", 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115283 2024-09-11T06:18:25.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38587 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7143424~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791149384000001, 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021158300000000001, 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38587 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287641+0000", 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.836e-06 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287648+0000", 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7710000000000001e-06 2024-09-11T06:18:25.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287652+0000", 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6450000000000004e-06 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308654+0000", 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021001899000000001 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308701+0000", 2024-09-11T06:18:25.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6551000000000002e-05 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308796+0000", 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5192000000000006e-05 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38588 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7929856~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791128053000001, 2024-09-11T06:18:25.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021338811999999999, 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38588 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287662+0000", 2024-09-11T06:18:25.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1679999999999998e-06 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287668+0000", 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.302e-06 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287672+0000", 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308828+0000", 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02115616 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308890+0000", 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1845000000000002e-05 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308998+0000", 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010743000000000001 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.133 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38589 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 8716288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791108379000001, 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021462365000000001, 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38589 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:25.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287681+0000", 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2290000000000002e-06 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287687+0000", 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.784e-06 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287691+0000", 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309029+0000", 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021337805000000001 2024-09-11T06:18:25.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309076+0000", 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-05 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309141+0000", 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5264000000000004e-05 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38590 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 9502720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791089405000001, 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021714906999999999, 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38590 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287700+0000", 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1490000000000001e-06 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287706+0000", 2024-09-11T06:18:25.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287711+0000", 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0429999999999998e-06 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309190+0000", 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021479043 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309284+0000", 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3968999999999994e-05 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309413+0000", 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012823700000000001 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38591 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 10289152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791069587999999, 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021935667999999998, 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38591 2024-09-11T06:18:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287718+0000", 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287726+0000", 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6829999999999997e-06 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287734+0000", 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0079999999999996e-06 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287738+0000", 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309447+0000", 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021708284000000001 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309534+0000", 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7379000000000005e-05 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309653+0000", 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011905600000000001 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38592 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11075584~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.79104178, 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022188494999999999, 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38592 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287746+0000", 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287748+0000", 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3420000000000002e-06 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287754+0000", 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5259999999999999e-06 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287759+0000", 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4129999999999999e-06 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309724+0000", 2024-09-11T06:18:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021965179000000001 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309813+0000", 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8825000000000004e-05 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309934+0000", 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120809 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38593 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11862016~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791021757999999, 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022391579000000002, 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38593 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287766+0000", 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:18:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287768+0000", 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1459999999999999e-06 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287774+0000", 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.421e-06 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287779+0000", 2024-09-11T06:18:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4569999999999998e-06 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309967+0000", 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022187944000000001 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310048+0000", 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1528999999999998e-05 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310157+0000", 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108729 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38594 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 12648448~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.791001868999999, 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022597002000000001, 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38594 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287786+0000", 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4000000000000002e-07 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287788+0000", 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1239999999999999e-06 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287794+0000", 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.725e-06 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287799+0000", 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0139999999999998e-06 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310186+0000", 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022386306000000002 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310270+0000", 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4507999999999998e-05 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310382+0000", 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111885 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38595 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [read 13434880~23206 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.790981859999999, 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022896125, 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38595 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287806+0000", 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287813+0000", 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.199e-06 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287819+0000", 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5950000000000004e-06 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287831+0000", 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1600000000000001e-05 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310413+0000", 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022582015 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310492+0000", 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9291999999999999e-05 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310701+0000", 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000209061 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:39792 3.15 3:ac0e7d03:::rbd_data.116db5c39c9d.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.423749059999999, 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020275054000000001, 2024-09-11T06:18:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39792 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655040+0000", 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1610000000000001e-06 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655051+0000", 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1126e-05 2024-09-11T06:18:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655069+0000", 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8039000000000001e-05 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655080+0000", 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0852999999999999e-05 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655160+0000", 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0135000000000004e-05 2024-09-11T06:18:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655320+0000", 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160166 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.658973+0000", 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003652335 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675201+0000", 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016227772000000001 2024-09-11T06:18:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675214+0000", 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3508e-05 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675255+0000", 2024-09-11T06:18:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0636999999999997e-05 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675313+0000", 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8322000000000002e-05 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:57289 3.15 3:a8a1be9d:::rbd_data.116d4d1f1cd7.000000000000000b:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:14.911298+0000", 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.167489022, 2024-09-11T06:18:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021344994999999999, 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 57289 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911298+0000", 2024-09-11T06:18:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911298+0000", 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911299+0000", 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2999999999999999e-07 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911304+0000", 2024-09-11T06:18:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911315+0000", 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1106e-05 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911321+0000", 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8370000000000002e-06 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911364+0000", 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3222000000000001e-05 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911424+0000", 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0068000000000002e-05 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.914807+0000", 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033826020000000002 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.932508+0000", 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017701854999999999 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.932555+0000", 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6950000000000003e-05 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.932599+0000", 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3477999999999999e-05 2024-09-11T06:18:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.932643+0000", 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066999999999997e-05 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.178 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:25.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:25.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T06:18:25.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T06:18:25.182 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:25.179+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:25.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:25.279+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:25.381 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:25.380+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:25.392 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:66757 3.f 3:f12eb680:::rbd_data.116dccfba5d9.000000000000003b:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.392246+0000", 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000124669, 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015288899999999999, 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:25.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 66757 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.392246+0000", 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.392246+0000", 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:25.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.392247+0000", 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7199999999999999e-07 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.392251+0000", 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.597e-06 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.392260+0000", 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9740000000000008e-06 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.392266+0000", 2024-09-11T06:18:25.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3269999999999997e-06 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.392317+0000", 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1561999999999999e-05 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.392403+0000", 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5714e-05 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:25.397 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:25.397 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 1 2024-09-11T06:18:25.397 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:25.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:25.432 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:25.433 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:25.466 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:25.466 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:25.482 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:25.481+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:25.509 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:25.509 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:25.542 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:25.543 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:25.586 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:25.583+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:25.587 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:25.587 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:25.630 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:25.630 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:25.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:25.632 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:25.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:25.671 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:25.672 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:25.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:25.684+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:25.714 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:25.714 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:25.786 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:25.785+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:25.859 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:25.859 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:25.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:25.887 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:25.886+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:25.988 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:25.987+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:26.077 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:26.077 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:26.088 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:26.088+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:26.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:26.190 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:26.189+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:26.259 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:26.259 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:26.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:26.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:26.290+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:26.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:18:26.376 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T06:18:26.391 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:26.391+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:26.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T06:18:26.482 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:26.482 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:26.491 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:26.532 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:26.531+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:26.596 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:26.592+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:26.597 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:26.597 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:26.605 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:26.694 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:26.693+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:26.708 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:26.709 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:26.717 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:26.795 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:26.794+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:26.820 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:26.821 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:26.829 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:26.896 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:26.895+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:26.932 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:26.932 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:26.941 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:26.997 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:26.996+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:27.043 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:27.043 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:27.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:27.097 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:27.097+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:27.153 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:27.154 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:27.162 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:27.205 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:27.205+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:27.264 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:27.265 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:27.273 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:27.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:27.313+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:27.382 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:18:27.387 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T06:18:27.400 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:27.399+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:27.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T06:18:27.419 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:27.419 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:27.428 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:27.501 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:27.500+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:27.550 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-11T06:18:27.573 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:27.573 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:27.582 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:27.601 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:27.600+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:27.687 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:27.687 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:27.696 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:27.702 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:27.701+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:27.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:27.799 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:27.799 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:27.804 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:27.803+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:27.805 INFO:teuthology.orchestra.run.smithi070.stdout:2736 trunc from 0xe38c4c9 to 0xb766258 2024-09-11T06:18:27.808 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:27.827 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:27.838 INFO:teuthology.orchestra.run.smithi070.stdout:2738 trunc from 0xb766258 to 0x225082f 2024-09-11T06:18:27.874 INFO:teuthology.orchestra.run.smithi070.stdout:2740 read 0x9bede8 thru 0x9c1576 (0x278f bytes) 2024-09-11T06:18:27.879 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:27.879 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:27.886 INFO:teuthology.orchestra.run.smithi070.stdout:2741 writesame 0x65d2780 thru 0x65e0963 data_size 0x9e(0xe1e4 bytes) 2024-09-11T06:18:27.886 INFO:teuthology.orchestra.run.smithi070.stdout:2742 punch from 0x43487d4 to 0x43496a6, (0xed2 bytes) 2024-09-11T06:18:27.886 INFO:teuthology.orchestra.run.smithi070.stdout:2743 punch from 0x12611b2 to 0x12651a3, (0x3ff1 bytes) 2024-09-11T06:18:27.886 INFO:teuthology.orchestra.run.smithi070.stdout:2744 read 0x319dcc7 thru 0x31a0c84 (0x2fbe bytes) 2024-09-11T06:18:27.886 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:27.886 INFO:teuthology.orchestra.run.smithi070.stdout:2746 punch from 0x15c2018 to 0x15c53b9, (0x33a1 bytes) 2024-09-11T06:18:27.897 INFO:teuthology.orchestra.run.smithi070.stdout:2747 write 0xb3372bb thru 0xb338c81 (0x19c7 bytes) 2024-09-11T06:18:27.899 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:27.899 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:27.904 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:27.904+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:27.912 INFO:teuthology.orchestra.run.smithi070.stdout:2749 writesame 0xeb902ed thru 0xeb99411 data_size 0x1(0x9125 bytes) 2024-09-11T06:18:27.912 INFO:teuthology.orchestra.run.smithi070.stdout:2752 read 0x5dad1b8 thru 0x5db4f92 (0x7ddb bytes) 2024-09-11T06:18:27.912 INFO:teuthology.orchestra.run.smithi070.stdout:2753 read 0xd01e77d thru 0xd02d9fd (0xf281 bytes) 2024-09-11T06:18:27.912 INFO:teuthology.orchestra.run.smithi070.stdout:2754 write 0xb9f4527 thru 0xba03d26 (0xf800 bytes) 2024-09-11T06:18:27.919 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:27.919 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:27.925 INFO:teuthology.orchestra.run.smithi070.stdout:2755 write 0xd403f73 thru 0xd40f596 (0xb624 bytes) 2024-09-11T06:18:27.928 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:27.928 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:27.938 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:27.939 INFO:teuthology.orchestra.run.smithi070.stdout:2756 read 0x16b517e thru 0x16b5a7e (0x901 bytes) 2024-09-11T06:18:27.939 INFO:teuthology.orchestra.run.smithi070.stdout:2757 punch from 0x6dbc4cf to 0x6dbea23, (0x2554 bytes) 2024-09-11T06:18:27.939 INFO:teuthology.orchestra.run.smithi070.stdout:2759 punch from 0x7ceb786 to 0x7cf280f, (0x7089 bytes) 2024-09-11T06:18:27.939 INFO:teuthology.orchestra.run.smithi070.stdout:2760 writesame 0x55ae9be thru 0x55bc9b5 data_size 0xc(0xdff8 bytes) 2024-09-11T06:18:27.945 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:27.945 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:27.955 INFO:teuthology.orchestra.run.smithi070.stdout:2762 punch from 0x7d0abc5 to 0x7d0e048, (0x3483 bytes) 2024-09-11T06:18:27.955 INFO:teuthology.orchestra.run.smithi070.stdout:2763 write 0x2c19429 thru 0x2c1d1d1 (0x3da9 bytes) 2024-09-11T06:18:27.962 INFO:teuthology.orchestra.run.smithi070.stdout:2764 read 0x70ba58f thru 0x70c52de (0xad50 bytes) 2024-09-11T06:18:27.962 INFO:teuthology.orchestra.run.smithi070.stdout:2765 write 0x8f0b6f thru 0x8f8627 (0x7ab9 bytes) 2024-09-11T06:18:27.965 INFO:teuthology.orchestra.run.smithi070.stdout:2766 punch from 0x60d5561 to 0x60e04a0, (0xaf3f bytes) 2024-09-11T06:18:27.965 INFO:teuthology.orchestra.run.smithi070.stdout:2767 write 0xe789a41 thru 0xe7961a1 (0xc761 bytes) 2024-09-11T06:18:27.970 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:27.970 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:27.982 INFO:teuthology.orchestra.run.smithi070.stdout:2768 writesame 0x9cfc311 thru 0x9d06f6a data_size 0xd(0xac5a bytes) 2024-09-11T06:18:27.997 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:27.997 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:27.999 INFO:teuthology.orchestra.run.smithi070.stdout:2770 trunc from 0xeb99412 to 0xddf4265 2024-09-11T06:18:28.005 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:28.005+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:28.021 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:28.022 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:28.022 INFO:teuthology.orchestra.run.smithi070.stdout:2773 trunc from 0xddf4265 to 0x67e8bc8 2024-09-11T06:18:28.046 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:28.046 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:28.053 INFO:teuthology.orchestra.run.smithi070.stdout:2774 writesame 0xb306ced thru 0xb30f4f5 data_size 0x23(0x8809 bytes) 2024-09-11T06:18:28.053 INFO:teuthology.orchestra.run.smithi070.stdout:2775 write 0xa7eb228 thru 0xa7f97d0 (0xe5a9 bytes) 2024-09-11T06:18:28.068 INFO:teuthology.orchestra.run.smithi070.stdout:2776 write 0x25627e8 thru 0x256da03 (0xb21c bytes) 2024-09-11T06:18:28.072 INFO:teuthology.orchestra.run.smithi070.stdout:2777 read 0x52b9709 thru 0x52bd1ff (0x3af7 bytes) 2024-09-11T06:18:28.072 INFO:teuthology.orchestra.run.smithi070.stdout:2778 write 0x16a1f85 thru 0x16b1431 (0xf4ad bytes) 2024-09-11T06:18:28.075 INFO:teuthology.orchestra.run.smithi070.stdout:2779 write 0x6f6235b thru 0x6f68d0b (0x69b1 bytes) 2024-09-11T06:18:28.081 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:88371 3.1a e101/95)", 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:28.081093+0000", 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.6842999999999998e-05, 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7168000000000004e-05, 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:28.081093+0000", 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:28.081093+0000", 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:28.081094+0000", 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:28.081104+0000", 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9720000000000004e-06 2024-09-11T06:18:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:28.081117+0000", 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3171e-05 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:28.081124+0000", 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0219999999999999e-06 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 1 2024-09-11T06:18:28.085 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:28.093 INFO:teuthology.orchestra.run.smithi070.stdout:2781 writesame 0xbf10f7e thru 0xbf1d13a data_size 0x1(0xc1bd bytes) 2024-09-11T06:18:28.093 INFO:teuthology.orchestra.run.smithi070.stdout:2784 punch from 0x8af5912 to 0x8b00e9d, (0xb58b bytes) 2024-09-11T06:18:28.093 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:28.093 INFO:teuthology.orchestra.run.smithi070.stdout:2786 read 0x4482e52 thru 0x4486510 (0x36bf bytes) 2024-09-11T06:18:28.093 INFO:teuthology.orchestra.run.smithi070.stdout:2787 read 0x81288cf thru 0x813316d (0xa89f bytes) 2024-09-11T06:18:28.093 INFO:teuthology.orchestra.run.smithi070.stdout:2788 write 0x9562f68 thru 0x956b3e7 (0x8480 bytes) 2024-09-11T06:18:28.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:28.106 INFO:teuthology.orchestra.run.smithi070.stdout:2790 writesame 0xb48e704 thru 0xb49b72a data_size 0x1(0xd027 bytes) 2024-09-11T06:18:28.106 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:28.105+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:28.123 INFO:teuthology.orchestra.run.smithi070.stdout:2793 write 0x5f02cc0 thru 0x5f0cdbc (0xa0fd bytes) 2024-09-11T06:18:28.136 INFO:teuthology.orchestra.run.smithi070.stdout:2794 write 0x4dcc86d thru 0x4dd80c1 (0xb855 bytes) 2024-09-11T06:18:28.145 INFO:teuthology.orchestra.run.smithi070.stdout:2796 write 0xc0495e4 thru 0xc0521c8 (0x8be5 bytes) 2024-09-11T06:18:28.159 INFO:teuthology.orchestra.run.smithi070.stdout:2797 punch from 0x72cca31 to 0x72d2257, (0x5826 bytes) 2024-09-11T06:18:28.159 INFO:teuthology.orchestra.run.smithi070.stdout:2798 write 0x299a925 thru 0x29a55b6 (0xac92 bytes) 2024-09-11T06:18:28.162 INFO:teuthology.orchestra.run.smithi070.stdout:2799 write 0x7fa23cb thru 0x7fad238 (0xae6e bytes) 2024-09-11T06:18:28.177 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:28.177 INFO:teuthology.orchestra.run.smithi070.stdout:2801 read 0x3d86851 thru 0x3d87207 (0x9b7 bytes) 2024-09-11T06:18:28.177 INFO:teuthology.orchestra.run.smithi070.stdout:2802 writesame 0x646125b thru 0x6467f2b data_size 0x1(0x6cd1 bytes) 2024-09-11T06:18:28.188 INFO:teuthology.orchestra.run.smithi070.stdout:2803 write 0x45c6d6d thru 0x45d4ea7 (0xe13b bytes) 2024-09-11T06:18:28.203 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:28.203 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:28.203 INFO:teuthology.orchestra.run.smithi070.stdout:2806 read 0x88843bc thru 0x888d82f (0x9474 bytes) 2024-09-11T06:18:28.203 INFO:teuthology.orchestra.run.smithi070.stdout:2807 punch from 0x4c52a57 to 0x4c615db, (0xeb84 bytes) 2024-09-11T06:18:28.203 INFO:teuthology.orchestra.run.smithi070.stdout:2808 read 0x6ff5a74 thru 0x700521c (0xf7a9 bytes) 2024-09-11T06:18:28.204 INFO:teuthology.orchestra.run.smithi070.stdout:2809 trunc from 0xc0521c9 to 0xbfdf328 2024-09-11T06:18:28.207 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:28.206+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:28.218 INFO:teuthology.orchestra.run.smithi070.stdout:2810 write 0xc244332 thru 0xc244eab (0xb7a bytes) 2024-09-11T06:18:28.219 INFO:teuthology.orchestra.run.smithi070.stdout:2811 punch from 0xa0d7f68 to 0xa0e0df2, (0x8e8a bytes) 2024-09-11T06:18:28.219 INFO:teuthology.orchestra.run.smithi070.stdout:2812 read 0x29c5ffc thru 0x29d5351 (0xf356 bytes) 2024-09-11T06:18:28.220 INFO:teuthology.orchestra.run.smithi070.stdout:2813 write 0x8fb0dd1 thru 0x8fba202 (0x9432 bytes) 2024-09-11T06:18:28.225 INFO:teuthology.orchestra.run.smithi070.stdout:2815 punch from 0xef5de3 to 0xefc928, (0x6b45 bytes) 2024-09-11T06:18:28.225 INFO:teuthology.orchestra.run.smithi070.stdout:2818 read 0xb8015d3 thru 0xb80e252 (0xcc80 bytes) 2024-09-11T06:18:28.226 INFO:teuthology.orchestra.run.smithi070.stdout:2820 write 0x36acc43 thru 0x36b8e9b (0xc259 bytes) 2024-09-11T06:18:28.235 INFO:teuthology.orchestra.run.smithi070.stdout:2821 punch from 0x61285d0 to 0x612f695, (0x70c5 bytes) 2024-09-11T06:18:28.236 INFO:teuthology.orchestra.run.smithi070.stdout:2822 trunc from 0xc244eac to 0xbb4df84 2024-09-11T06:18:28.244 INFO:teuthology.orchestra.run.smithi070.stdout:2824 read 0x664e3ae thru 0x6653667 (0x52ba bytes) 2024-09-11T06:18:28.245 INFO:teuthology.orchestra.run.smithi070.stdout:2826 punch from 0x76b5aad to 0x76b7add, (0x2030 bytes) 2024-09-11T06:18:28.245 INFO:teuthology.orchestra.run.smithi070.stdout:2827 read 0xa920807 thru 0xa921f45 (0x173f bytes) 2024-09-11T06:18:28.245 INFO:teuthology.orchestra.run.smithi070.stdout:2828 write 0x701b7f1 thru 0x7021190 (0x59a0 bytes) 2024-09-11T06:18:28.248 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:28.248 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:28.250 INFO:teuthology.orchestra.run.smithi070.stdout:2829 read 0x46d3833 thru 0x46d77ab (0x3f79 bytes) 2024-09-11T06:18:28.250 INFO:teuthology.orchestra.run.smithi070.stdout:2830 write 0x9ba3a03 thru 0x9ba580f (0x1e0d bytes) 2024-09-11T06:18:28.258 INFO:teuthology.orchestra.run.smithi070.stdout:2831 trunc from 0xbb4df84 to 0xd331672 2024-09-11T06:18:28.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:28.263 INFO:teuthology.orchestra.run.smithi070.stdout:2837 read 0x465bc7e thru 0x465df12 (0x2295 bytes) 2024-09-11T06:18:28.264 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:28.264 INFO:teuthology.orchestra.run.smithi070.stdout:2840 write 0x3a592ad thru 0x3a67862 (0xe5b6 bytes) 2024-09-11T06:18:28.277 INFO:teuthology.orchestra.run.smithi070.stdout:2842 punch from 0x2635366 to 0x26392d7, (0x3f71 bytes) 2024-09-11T06:18:28.277 INFO:teuthology.orchestra.run.smithi070.stdout:2843 write 0xb7e8db2 thru 0xb7ecc06 (0x3e55 bytes) 2024-09-11T06:18:28.279 INFO:teuthology.orchestra.run.smithi070.stdout:2844 write 0x21e72ab thru 0x21f5511 (0xe267 bytes) 2024-09-11T06:18:28.282 INFO:teuthology.orchestra.run.smithi070.stdout:2846 read 0x10ca48d thru 0x10d055f (0x60d3 bytes) 2024-09-11T06:18:28.283 INFO:teuthology.orchestra.run.smithi070.stdout:2847 read 0x7aa8150 thru 0x7aad6c2 (0x5573 bytes) 2024-09-11T06:18:28.283 INFO:teuthology.orchestra.run.smithi070.stdout:2848 read 0x2a0973c thru 0x2a147a5 (0xb06a bytes) 2024-09-11T06:18:28.284 INFO:teuthology.orchestra.run.smithi070.stdout:2849 writesame 0xef4105 thru 0xf025db data_size 0x1(0xe4d7 bytes) 2024-09-11T06:18:28.292 INFO:teuthology.orchestra.run.smithi070.stdout:2851 write 0x1df9c8a thru 0x1e06dca (0xd141 bytes) 2024-09-11T06:18:28.295 INFO:teuthology.orchestra.run.smithi070.stdout:2852 write 0xafc0b10 thru 0xafc1e87 (0x1378 bytes) 2024-09-11T06:18:28.297 INFO:teuthology.orchestra.run.smithi070.stdout:2853 read 0x582ed3a thru 0x583a173 (0xb43a bytes) 2024-09-11T06:18:28.300 INFO:teuthology.orchestra.run.smithi070.stdout:2854 trunc from 0xd331672 to 0xb75c1b4 2024-09-11T06:18:28.308 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:28.307+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:28.324 INFO:teuthology.orchestra.run.smithi070.stdout:2855 writesame 0xe20d20d thru 0xe20d22f data_size 0x1(0x23 bytes) 2024-09-11T06:18:28.324 INFO:teuthology.orchestra.run.smithi070.stdout:2856 punch from 0x68ebb02 to 0x68f6b5e, (0xb05c bytes) 2024-09-11T06:18:28.324 INFO:teuthology.orchestra.run.smithi070.stdout:2858 read 0x14cfd8a thru 0x14d679c (0x6a13 bytes) 2024-09-11T06:18:28.324 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:28.325 INFO:teuthology.orchestra.run.smithi070.stdout:2860 read 0xb6751c7 thru 0xb67e199 (0x8fd3 bytes) 2024-09-11T06:18:28.325 INFO:teuthology.orchestra.run.smithi070.stdout:2861 punch from 0x7140f82 to 0x7143c01, (0x2c7f bytes) 2024-09-11T06:18:28.325 INFO:teuthology.orchestra.run.smithi070.stdout:2862 writesame 0x1e341ce thru 0x1e4040d data_size 0x70(0xc240 bytes) 2024-09-11T06:18:28.330 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:28.330 INFO:teuthology.orchestra.run.smithi070.stdout:2865 punch from 0x503d24a to 0x50402a2, (0x3058 bytes) 2024-09-11T06:18:28.330 INFO:teuthology.orchestra.run.smithi070.stdout:2866 writesame 0x195d494 thru 0x1961c11 data_size 0x1(0x477e bytes) 2024-09-11T06:18:28.335 INFO:teuthology.orchestra.run.smithi070.stdout:2867 writesame 0x3ca40b5 thru 0x3ca477b data_size 0x1(0x6c7 bytes) 2024-09-11T06:18:28.337 INFO:teuthology.orchestra.run.smithi070.stdout:2868 punch from 0x3e90ab5 to 0x3e95174, (0x46bf bytes) 2024-09-11T06:18:28.337 INFO:teuthology.orchestra.run.smithi070.stdout:2870 read 0x66bff1e thru 0x66c229e (0x2381 bytes) 2024-09-11T06:18:28.338 INFO:teuthology.orchestra.run.smithi070.stdout:2873 write 0x40bfb2b thru 0x40ccde4 (0xd2ba bytes) 2024-09-11T06:18:28.341 INFO:teuthology.orchestra.run.smithi070.stdout:2874 write 0x729c51b thru 0x72a1f6b (0x5a51 bytes) 2024-09-11T06:18:28.343 INFO:teuthology.orchestra.run.smithi070.stdout:2875 punch from 0xb88e658 to 0xb88fd07, (0x16af bytes) 2024-09-11T06:18:28.343 INFO:teuthology.orchestra.run.smithi070.stdout:2876 write 0xb26f3fb thru 0xb2763b0 (0x6fb6 bytes) 2024-09-11T06:18:28.346 INFO:teuthology.orchestra.run.smithi070.stdout:2877 read 0xdb6c4fd thru 0xdb7a298 (0xdd9c bytes) 2024-09-11T06:18:28.346 INFO:teuthology.orchestra.run.smithi070.stdout:2878 read 0x9bcf646 thru 0x9bd5e4f (0x680a bytes) 2024-09-11T06:18:28.362 INFO:teuthology.orchestra.run.smithi070.stdout:2879 trunc from 0xe20d230 to 0xe573b6 2024-09-11T06:18:28.388 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T06:18:28.409 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:28.408+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:28.410 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:28.410 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:28.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:28.410 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:28.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.410 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65210 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 262144~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.410 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.307734+0000", 2024-09-11T06:18:28.410 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0990620930000001, 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010140700000000001, 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65210 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307734+0000", 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307734+0000", 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307734+0000", 2024-09-11T06:18:28.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307738+0000", 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7469999999999999e-06 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307746+0000", 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8290000000000008e-06 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307750+0000", 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6970000000000001e-06 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.317189+0000", 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094385679999999996 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.317280+0000", 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1494000000000002e-05 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.317874+0000", 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059400200000000005 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65211 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 290816~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0990388169999998, 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011362828, 2024-09-11T06:18:28.415 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65211 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9299999999999999e-07 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307760+0000", 2024-09-11T06:18:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0779999999999998e-06 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307768+0000", 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307773+0000", 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.87e-06 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.317997+0000", 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010223922 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318245+0000", 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024794699999999999 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.319120+0000", 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087475300000000003 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65357 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318689+0000", 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0881064239999998, 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010686724, 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65357 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318689+0000", 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318689+0000", 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318690+0000", 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318692+0000", 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1890000000000001e-06 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318699+0000", 2024-09-11T06:18:28.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4740000000000002e-06 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318705+0000", 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1469999999999998e-06 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.328613+0000", 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099080539999999995 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.328858+0000", 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024539800000000002 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.329376+0000", 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051802399999999996 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65358 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 196608~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0880813140000001, 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01178332, 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65358 2024-09-11T06:18:28.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318717+0000", 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1739999999999999e-06 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318726+0000", 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2089999999999994e-06 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318731+0000", 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9690000000000002e-06 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.329832+0000", 2024-09-11T06:18:28.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011100376 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330093+0000", 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026168699999999998 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330498+0000", 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040453100000000002 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65359 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0880569759999998, 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012518262, 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65359 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4200000000000001e-07 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318741+0000", 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0439999999999998e-06 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318750+0000", 2024-09-11T06:18:28.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7239999999999998e-06 2024-09-11T06:18:28.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318755+0000", 2024-09-11T06:18:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8080000000000004e-06 2024-09-11T06:18:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330616+0000", 2024-09-11T06:18:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011861349 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330867+0000", 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025063199999999998 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331257+0000", 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039026300000000001 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65360 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 266240~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0880344989999999, 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013368422, 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65360 2024-09-11T06:18:28.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318762+0000", 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318764+0000", 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318772+0000", 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1519999999999992e-06 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318783+0000", 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0956e-05 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331395+0000", 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012611938 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331643+0000", 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000248244 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332130+0000", 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048681400000000002 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65382 3.10 3:0bf53440:::rbd_data.116dccfba5d9.0000000000000049:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0880072190000001, 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013819148, 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65382 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318791+0000", 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9750000000000001e-06 2024-09-11T06:18:28.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318799+0000", 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5989999999999996e-06 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318803+0000", 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5090000000000004e-06 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332201+0000", 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013397714 2024-09-11T06:18:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332295+0000", 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4426999999999996e-05 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332608+0000", 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031258700000000002 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65412 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 0~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.322954+0000", 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0838416629999998, 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099144209999999997, 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65412 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.322954+0000", 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.322954+0000", 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.322955+0000", 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.268e-06 2024-09-11T06:18:28.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.322961+0000", 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6409999999999999e-06 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.322972+0000", 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1331999999999999e-05 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.322983+0000", 2024-09-11T06:18:28.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332643+0000", 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096599440000000002 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332740+0000", 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7504999999999996e-05 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332869+0000", 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012830900000000001 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65413 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 28672~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323128+0000", 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0836674500000001, 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099998069999999994, 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65413 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323128+0000", 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323128+0000", 2024-09-11T06:18:28.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323129+0000", 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1600000000000001e-07 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323140+0000", 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0484e-05 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323165+0000", 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5375e-05 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323173+0000", 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0499999999999992e-06 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332905+0000", 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097318249999999995 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333006+0000", 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101297 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333128+0000", 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012216000000000001 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65414 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323198+0000", 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0835978829999999, 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010175404000000001, 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65414 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323198+0000", 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323198+0000", 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323199+0000", 2024-09-11T06:18:28.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4099999999999999e-07 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323202+0000", 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0630000000000002e-06 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323210+0000", 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4260000000000003e-06 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323216+0000", 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1059999999999996e-06 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333158+0000", 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099419910000000007 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333247+0000", 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8906999999999994e-05 2024-09-11T06:18:28.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333373+0000", 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012637 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65415 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 139264~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323232+0000", 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0835640340000001, 2024-09-11T06:18:28.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010387575, 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65415 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323232+0000", 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323232+0000", 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323232+0000", 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323235+0000", 2024-09-11T06:18:28.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2790000000000001e-06 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323242+0000", 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1230000000000002e-06 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323248+0000", 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9669999999999998e-06 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333402+0000", 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010153924 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333494+0000", 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2359000000000001e-05 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333619+0000", 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000125482 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65416 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323255+0000", 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0835404419999999, 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010600597, 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65416 2024-09-11T06:18:28.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323255+0000", 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323255+0000", 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323256+0000", 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323258+0000", 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.323e-06 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323265+0000", 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4559999999999997e-06 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323272+0000", 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6190000000000002e-06 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333648+0000", 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010375654999999999 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333742+0000", 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3686999999999999e-05 2024-09-11T06:18:28.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333856+0000", 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114466 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65417 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 208896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323279+0000", 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.083516489, 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010813961, 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65417 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323279+0000", 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323279+0000", 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323280+0000", 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1399999999999997e-07 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323282+0000", 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1940000000000001e-06 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323291+0000", 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7490000000000004e-06 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323296+0000", 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2700000000000004e-06 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333883+0000", 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010586666999999999 2024-09-11T06:18:28.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.333995+0000", 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112248 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334093+0000", 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8418999999999994e-05 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65418 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.083476525, 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011186454, 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65418 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323320+0000", 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0900000000000001e-07 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323323+0000", 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.021e-06 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323333+0000", 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0343000000000001e-05 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323339+0000", 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1109999999999996e-06 2024-09-11T06:18:28.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334123+0000", 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010783789 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334216+0000", 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2458000000000001e-05 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334506+0000", 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029012299999999999 2024-09-11T06:18:28.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65452 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 20480~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324664+0000", 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0821317129999999, 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010153527000000001, 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65452 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324664+0000", 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324664+0000", 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324665+0000", 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.037e-06 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324670+0000", 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8350000000000003e-06 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324687+0000", 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6908000000000001e-05 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324695+0000", 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7970000000000001e-06 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334538+0000", 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098430549999999999 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334645+0000", 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010765299999999999 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334818+0000", 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172242 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65453 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324708+0000", 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0820876350000002, 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010382605, 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65453 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324708+0000", 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324708+0000", 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324709+0000", 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.82e-07 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324712+0000", 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324719+0000", 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2520000000000002e-06 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324724+0000", 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334848+0000", 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010123597 2024-09-11T06:18:28.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334945+0000", 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7683000000000006e-05 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335091+0000", 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014542799999999999 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65454 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324733+0000", 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0820633260000001, 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010617099, 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65454 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324733+0000", 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324733+0000", 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324733+0000", 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1399999999999997e-07 2024-09-11T06:18:28.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324735+0000", 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1900000000000002e-06 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324741+0000", 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9150000000000001e-06 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324759+0000", 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7580000000000001e-05 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335120+0000", 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010361417 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335204+0000", 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4054999999999994e-05 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335350+0000", 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014552799999999999 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65455 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 159744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0820293649999999, 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010864807000000001, 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65455 2024-09-11T06:18:28.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324769+0000", 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1160000000000002e-06 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324775+0000", 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7969999999999997e-06 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324779+0000", 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9430000000000002e-06 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335383+0000", 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604001 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335467+0000", 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4214000000000004e-05 2024-09-11T06:18:28.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335631+0000", 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164334 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65456 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0820116930000001, 2024-09-11T06:18:28.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011134408, 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65456 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8599999999999999e-07 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324786+0000", 2024-09-11T06:18:28.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.629e-06 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324791+0000", 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3299999999999998e-06 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324795+0000", 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8e-06 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335661+0000", 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010865718 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335745+0000", 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3776999999999994e-05 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335919+0000", 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017386800000000001 2024-09-11T06:18:28.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65457 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0819951059999999, 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011510302, 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65457 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324803+0000", 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7910000000000001e-06 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324808+0000", 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2979999999999999e-06 2024-09-11T06:18:28.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324812+0000", 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9430000000000002e-06 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335955+0000", 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011142987 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.336053+0000", 2024-09-11T06:18:28.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7985000000000005e-05 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.336311+0000", 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025792799999999999 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.505 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:28.506 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T06:18:28.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:18:28.507 INFO:teuthology.orchestra.run.smithi070.stdout:2880 punch from 0xd362db to 0xd3df21, (0x7c46 bytes) 2024-09-11T06:18:28.508 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2881 writesame 0xbf33a74 thru 0xbf404d0 data_size 0xd(0xca5d bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2882 read 0xbcedd7c thru 0xbcfd9fc (0xfc81 bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2883 trunc from 0xbf404d1 to 0xe04a29c 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2884 read 0x1783881 thru 0x1792732 (0xeeb2 bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2885 read 0x5925027 thru 0x592c54e (0x7528 bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2886 writesame 0x96682e thru 0x968a8e data_size 0x1(0x2261 bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2887 punch from 0x149d2f to 0x159789, (0xfa5a bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2889 write 0xbef62da thru 0xbf03ed0 (0xdbf7 bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2890 write 0xd933779 thru 0xd93a002 (0x688a bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2891 read 0x89da402 thru 0x89e048f (0x608e bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2892 read 0xc3c7b69 thru 0xc3d24e8 (0xa980 bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:2893 read 0xdf835d0 thru 0xdf8713d (0x3b6e bytes) 2024-09-11T06:18:28.510 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:28.511 INFO:teuthology.orchestra.run.smithi070.stdout:2895 write 0x296d1f3 thru 0x2977d3a (0xab48 bytes) 2024-09-11T06:18:28.511 INFO:teuthology.orchestra.run.smithi070.stdout:2896 write 0x7455008 thru 0x745b00a (0x6003 bytes) 2024-09-11T06:18:28.511 INFO:teuthology.orchestra.run.smithi070.stdout:2897 trunc from 0xe04a29c to 0x10e13e1 2024-09-11T06:18:28.511 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:28.509+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:28.531 INFO:teuthology.orchestra.run.smithi070.stdout:2898 punch from 0x1e445 to 0x26bf9, (0x87b4 bytes) 2024-09-11T06:18:28.532 INFO:teuthology.orchestra.run.smithi070.stdout:2899 clone 21 order 18 su 2048 sc 6 2024-09-11T06:18:28.610 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:28.609+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:28.621 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:28.621 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:28.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:28.711 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:28.711+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:28.776 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:28.776 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:28.776 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:28.776 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:28.776 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:28.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:28.805 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:18:28.805 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:18:28.811 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:28.810+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:28.817 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-11T06:18:28.431441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1047687226,"num_objects":894,"num_object_clones":0,"num_object_copies":1788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":894,"num_whiteouts":0,"num_read":87020,"num_read_kb":882587,"num_write":12490,"num_write_kb":596807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":52803112,"num_keys_recovered":80,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7780,"ondisk_log_size":7780,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":384544,"kb_used_data":87712,"kb_used_omap":21,"kb_used_meta":296618,"kb_avail":754590176,"statfs":{"total":773094113280,"available":772700340224,"internally_reserved":0,"allocated":89817088,"data_stored":747825712,"data_compressed":19699030,"data_compressed_allocated":65335296,"data_compressed_original":730805749,"omap_allocated":21513,"internal_metadata":303737847},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":138680198,"num_objects":206,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":206,"num_whiteouts":0,"num_read":24938,"num_read_kb":109754,"num_write":1022,"num_write_kb":78891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000701"},"pg_stats":[{"pgid":"3.1f","version":"100'176","reported_seq":2230,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.373030+0000","last_change":"2024-09-11T06:18:23.496602+0000","last_active":"2024-09-11T06:18:26.373030+0000","last_peered":"2024-09-11T06:18:26.373030+0000","last_clean":"2024-09-11T06:18:26.373030+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:18:26.373030+0000","last_undegraded":"2024-09-11T06:18:26.373030+0000","last_fullsized":"2024-09-11T06:18:26.373030+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:38.326698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885549999999999,"stat_sum":{"num_bytes":44881177,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1942,"num_read_kb":18975,"num_write":338,"num_write_kb":20744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1e","version":"99'252","reported_seq":2106,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372856+0000","last_change":"2024-09-11T06:18:23.495924+0000","last_active":"2024-09-11T06:18:26.372856+0000","last_peered":"2024-09-11T06:18:26.372856+0000","last_clean":"2024-09-11T06:18:26.372856+0000","last_became_active":"2024-09-11T06:17:09.686913+0000","last_became_peered":"2024-09-11T06:17:09.686913+0000","last_unstale":"2024-09-11T06:18:26.372856+0000","last_undegraded":"2024-09-11T06:18:26.372856+0000","last_fullsized":"2024-09-11T06:18:26.372856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:17.806895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000586941,"stat_sum":{"num_bytes":11261782,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2385,"num_read_kb":9514,"num_write":446,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1d","version":"101'322","reported_seq":4151,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.387445+0000","last_change":"2024-09-11T06:18:27.387445+0000","last_active":"2024-09-11T06:18:27.387445+0000","last_peered":"2024-09-11T06:18:27.387445+0000","last_clean":"2024-09-11T06:18:27.387445+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:18:27.387445+0000","last_undegraded":"2024-09-11T06:18:27.387445+0000","last_fullsized":"2024-09-11T06:18:27.387445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:01.236738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999309999999999,"stat_sum":{"num_bytes":83451094,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4668,"num_read_kb":69943,"num_write":592,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.1c","version":"99'126","reported_seq":1940,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.419901+0000","last_change":"2024-09-11T06:18:23.502303+0000","last_active":"2024-09-11T06:18:26.419901+0000","last_peered":"2024-09-11T06:18:26.419901+0000","last_clean":"2024-09-11T06:18:26.419901+0000","last_became_active":"2024-09-11T06:18:19.335163+0000","last_became_peered":"2024-09-11T06:18:19.335163+0000","last_unstale":"2024-09-11T06:18:26.419901+0000","last_undegraded":"2024-09-11T06:18:26.419901+0000","last_fullsized":"2024-09-11T06:18:26.419901+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:51.752308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066701599999999998,"stat_sum":{"num_bytes":29876572,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2070,"num_read_kb":14320,"num_write":225,"num_write_kb":10502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1622976,"num_keys_recovered":38,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1b","version":"99'303","reported_seq":1988,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384854+0000","last_change":"2024-09-11T06:18:27.385064+0000","last_active":"2024-09-11T06:18:27.384854+0000","last_peered":"2024-09-11T06:18:27.384854+0000","last_clean":"2024-09-11T06:18:27.384854+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:18:27.384854+0000","last_undegraded":"2024-09-11T06:18:27.384854+0000","last_fullsized":"2024-09-11T06:18:27.384854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:28.681644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049185500000000003,"stat_sum":{"num_bytes":27264127,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2254,"num_read_kb":28111,"num_write":494,"num_write_kb":19239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.1a","version":"99'234","reported_seq":3374,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.457176+0000","last_change":"2024-09-11T06:18:23.495930+0000","last_active":"2024-09-11T06:18:26.457176+0000","last_peered":"2024-09-11T06:18:26.457176+0000","last_clean":"2024-09-11T06:18:26.457176+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:18:26.457176+0000","last_undegraded":"2024-09-11T06:18:26.457176+0000","last_fullsized":"2024-09-11T06:18:26.457176+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:15.532544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060037600000000001,"stat_sum":{"num_bytes":35087594,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3349,"num_read_kb":42453,"num_write":289,"num_write_kb":22333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.19","version":"100'207","reported_seq":2420,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385432+0000","last_change":"2024-09-11T06:18:27.385639+0000","last_active":"2024-09-11T06:18:27.385432+0000","last_peered":"2024-09-11T06:18:27.385432+0000","last_clean":"2024-09-11T06:18:27.385432+0000","last_became_active":"2024-09-11T06:18:19.336396+0000","last_became_peered":"2024-09-11T06:18:19.336396+0000","last_unstale":"2024-09-11T06:18:27.385432+0000","last_undegraded":"2024-09-11T06:18:27.385432+0000","last_fullsized":"2024-09-11T06:18:27.385432+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:40:27.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092286600000000005,"stat_sum":{"num_bytes":22480997,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2463,"num_read_kb":20562,"num_write":295,"num_write_kb":12336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2873672,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.18","version":"100'721","reported_seq":3205,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.452643+0000","last_change":"2024-09-11T06:18:23.496287+0000","last_active":"2024-09-11T06:18:26.452643+0000","last_peered":"2024-09-11T06:18:26.452643+0000","last_clean":"2024-09-11T06:18:26.452643+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:18:26.452643+0000","last_undegraded":"2024-09-11T06:18:26.452643+0000","last_fullsized":"2024-09-11T06:18:26.452643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:16:40.123111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086039500000000002,"stat_sum":{"num_bytes":25286142,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5301,"num_read_kb":19317,"num_write":1207,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.17","version":"100'129","reported_seq":2768,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.419011+0000","last_change":"2024-09-11T06:18:23.496526+0000","last_active":"2024-09-11T06:18:26.419011+0000","last_peered":"2024-09-11T06:18:26.419011+0000","last_clean":"2024-09-11T06:18:26.419011+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:18:26.419011+0000","last_undegraded":"2024-09-11T06:18:26.419011+0000","last_fullsized":"2024-09-11T06:18:26.419011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:59.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010661889999999999,"stat_sum":{"num_bytes":39314549,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2339,"num_read_kb":23409,"num_write":216,"num_write_kb":11665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.16","version":"99'200","reported_seq":2066,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.393207+0000","last_change":"2024-09-11T06:18:27.393492+0000","last_active":"2024-09-11T06:18:27.393207+0000","last_peered":"2024-09-11T06:18:27.393207+0000","last_clean":"2024-09-11T06:18:27.393207+0000","last_became_active":"2024-09-11T06:17:09.686021+0000","last_became_peered":"2024-09-11T06:17:09.686021+0000","last_unstale":"2024-09-11T06:18:27.393207+0000","last_undegraded":"2024-09-11T06:18:27.393207+0000","last_fullsized":"2024-09-11T06:18:27.393207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:36.992386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070350700000000003,"stat_sum":{"num_bytes":25083082,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2131,"num_read_kb":23019,"num_write":295,"num_write_kb":18371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.15","version":"99'181","reported_seq":2286,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.391192+0000","last_change":"2024-09-11T06:18:27.391621+0000","last_active":"2024-09-11T06:18:27.391192+0000","last_peered":"2024-09-11T06:18:27.391192+0000","last_clean":"2024-09-11T06:18:27.391192+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:18:27.391192+0000","last_undegraded":"2024-09-11T06:18:27.391192+0000","last_fullsized":"2024-09-11T06:18:27.391192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:11.189983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017611529999999999,"stat_sum":{"num_bytes":28672271,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1940,"num_read_kb":29935,"num_write":286,"num_write_kb":29287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.14","version":"99'102","reported_seq":2755,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385685+0000","last_change":"2024-09-11T06:18:27.386340+0000","last_active":"2024-09-11T06:18:27.385685+0000","last_peered":"2024-09-11T06:18:27.385685+0000","last_clean":"2024-09-11T06:18:27.385685+0000","last_became_active":"2024-09-11T06:17:09.682654+0000","last_became_peered":"2024-09-11T06:17:09.682654+0000","last_unstale":"2024-09-11T06:18:27.385685+0000","last_undegraded":"2024-09-11T06:18:27.385685+0000","last_fullsized":"2024-09-11T06:18:27.385685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:18.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013973080000000001,"stat_sum":{"num_bytes":52734446,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2394,"num_read_kb":53471,"num_write":191,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385261+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:18:27.385261+0000","last_peered":"2024-09-11T06:18:27.385261+0000","last_clean":"2024-09-11T06:18:27.385261+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:18:27.385261+0000","last_undegraded":"2024-09-11T06:18:27.385261+0000","last_fullsized":"2024-09-11T06:18:27.385261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"99'136","reported_seq":2994,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385220+0000","last_change":"2024-09-11T06:18:27.385449+0000","last_active":"2024-09-11T06:18:27.385220+0000","last_peered":"2024-09-11T06:18:27.385220+0000","last_clean":"2024-09-11T06:18:27.385220+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:18:27.385220+0000","last_undegraded":"2024-09-11T06:18:27.385220+0000","last_fullsized":"2024-09-11T06:18:27.385220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:29.145094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087526599999999998,"stat_sum":{"num_bytes":37505167,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2551,"num_read_kb":36826,"num_write":254,"num_write_kb":22788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384564+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:18:27.384564+0000","last_peered":"2024-09-11T06:18:27.384564+0000","last_clean":"2024-09-11T06:18:27.384564+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:18:27.384564+0000","last_undegraded":"2024-09-11T06:18:27.384564+0000","last_fullsized":"2024-09-11T06:18:27.384564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"99'128","reported_seq":1775,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385143+0000","last_change":"2024-09-11T06:18:27.385356+0000","last_active":"2024-09-11T06:18:27.385143+0000","last_peered":"2024-09-11T06:18:27.385143+0000","last_clean":"2024-09-11T06:18:27.385143+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:18:27.385143+0000","last_undegraded":"2024-09-11T06:18:27.385143+0000","last_fullsized":"2024-09-11T06:18:27.385143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:10:18.926263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000678124,"stat_sum":{"num_bytes":26498254,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1463,"num_read_kb":23134,"num_write":192,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385860+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:18:27.385860+0000","last_peered":"2024-09-11T06:18:27.385860+0000","last_clean":"2024-09-11T06:18:27.385860+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:18:27.385860+0000","last_undegraded":"2024-09-11T06:18:27.385860+0000","last_fullsized":"2024-09-11T06:18:27.385860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"100'350","reported_seq":3293,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.430183+0000","last_change":"2024-09-11T06:18:23.361137+0000","last_active":"2024-09-11T06:18:26.430183+0000","last_peered":"2024-09-11T06:18:26.430183+0000","last_clean":"2024-09-11T06:18:26.430183+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:18:26.430183+0000","last_undegraded":"2024-09-11T06:18:26.430183+0000","last_fullsized":"2024-09-11T06:18:26.430183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:55:02.843476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058890899999999998,"stat_sum":{"num_bytes":37392643,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":3683,"num_read_kb":47772,"num_write":676,"num_write_kb":25705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372902+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:18:26.372902+0000","last_peered":"2024-09-11T06:18:26.372902+0000","last_clean":"2024-09-11T06:18:26.372902+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:18:26.372902+0000","last_undegraded":"2024-09-11T06:18:26.372902+0000","last_fullsized":"2024-09-11T06:18:26.372902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"100'298","reported_seq":2845,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.392825+0000","last_change":"2024-09-11T06:18:27.393111+0000","last_active":"2024-09-11T06:18:27.392825+0000","last_peered":"2024-09-11T06:18:27.392825+0000","last_clean":"2024-09-11T06:18:27.392825+0000","last_became_active":"2024-09-11T06:17:09.680887+0000","last_became_peered":"2024-09-11T06:17:09.680887+0000","last_unstale":"2024-09-11T06:18:27.392825+0000","last_undegraded":"2024-09-11T06:18:27.392825+0000","last_fullsized":"2024-09-11T06:18:27.392825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:49.505140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052785199999999999,"stat_sum":{"num_bytes":21809112,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3489,"num_read_kb":21655,"num_write":397,"num_write_kb":9118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.3","version":"101'420","reported_seq":3704,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.399433+0000","last_change":"2024-09-11T06:18:27.391505+0000","last_active":"2024-09-11T06:18:27.399433+0000","last_peered":"2024-09-11T06:18:27.399433+0000","last_clean":"2024-09-11T06:18:27.399433+0000","last_became_active":"2024-09-11T06:17:09.676881+0000","last_became_peered":"2024-09-11T06:17:09.676881+0000","last_unstale":"2024-09-11T06:18:27.399433+0000","last_undegraded":"2024-09-11T06:18:27.399433+0000","last_fullsized":"2024-09-11T06:18:27.399433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:47.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001738493,"stat_sum":{"num_bytes":41647280,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5308,"num_read_kb":27788,"num_write":540,"num_write_kb":21253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":179,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385475+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:18:27.385475+0000","last_peered":"2024-09-11T06:18:27.385475+0000","last_clean":"2024-09-11T06:18:27.385475+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:18:27.385475+0000","last_undegraded":"2024-09-11T06:18:27.385475+0000","last_fullsized":"2024-09-11T06:18:27.385475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"99'245","reported_seq":2173,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.418642+0000","last_change":"2024-09-11T06:18:23.496212+0000","last_active":"2024-09-11T06:18:26.418642+0000","last_peered":"2024-09-11T06:18:26.418642+0000","last_clean":"2024-09-11T06:18:26.418642+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:18:26.418642+0000","last_undegraded":"2024-09-11T06:18:26.418642+0000","last_fullsized":"2024-09-11T06:18:26.418642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:44.678122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093509300000000001,"stat_sum":{"num_bytes":22197462,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2303,"num_read_kb":21492,"num_write":457,"num_write_kb":20828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372840+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:18:26.372840+0000","last_peered":"2024-09-11T06:18:26.372840+0000","last_clean":"2024-09-11T06:18:26.372840+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:18:26.372840+0000","last_undegraded":"2024-09-11T06:18:26.372840+0000","last_fullsized":"2024-09-11T06:18:26.372840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'360","reported_seq":1569,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380057+0000","last_change":"2024-09-11T06:18:23.360858+0000","last_active":"2024-09-11T06:18:26.380057+0000","last_peered":"2024-09-11T06:18:26.380057+0000","last_clean":"2024-09-11T06:18:26.380057+0000","last_became_active":"2024-09-11T06:17:09.679986+0000","last_became_peered":"2024-09-11T06:17:09.679986+0000","last_unstale":"2024-09-11T06:18:26.380057+0000","last_undegraded":"2024-09-11T06:18:26.380057+0000","last_fullsized":"2024-09-11T06:18:26.380057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:31.341940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041977699999999998,"stat_sum":{"num_bytes":20209097,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2310,"num_read_kb":16744,"num_write":644,"num_write_kb":16894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384670+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:18:27.384670+0000","last_peered":"2024-09-11T06:18:27.384670+0000","last_clean":"2024-09-11T06:18:27.384670+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:18:27.384670+0000","last_undegraded":"2024-09-11T06:18:27.384670+0000","last_fullsized":"2024-09-11T06:18:27.384670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"99'187","reported_seq":2030,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385510+0000","last_change":"2024-09-11T06:18:27.385753+0000","last_active":"2024-09-11T06:18:27.385510+0000","last_peered":"2024-09-11T06:18:27.385510+0000","last_clean":"2024-09-11T06:18:27.385510+0000","last_became_active":"2024-09-11T06:17:09.675683+0000","last_became_peered":"2024-09-11T06:17:09.675683+0000","last_unstale":"2024-09-11T06:18:27.385510+0000","last_undegraded":"2024-09-11T06:18:27.385510+0000","last_fullsized":"2024-09-11T06:18:27.385510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:09:58.234973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098683899999999999,"stat_sum":{"num_bytes":19072157,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2057,"num_read_kb":14812,"num_write":341,"num_write_kb":14039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":178,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385014+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:18:27.385014+0000","last_peered":"2024-09-11T06:18:27.385014+0000","last_clean":"2024-09-11T06:18:27.385014+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:18:27.385014+0000","last_undegraded":"2024-09-11T06:18:27.385014+0000","last_fullsized":"2024-09-11T06:18:27.385014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.375773+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:18:26.375773+0000","last_peered":"2024-09-11T06:18:26.375773+0000","last_clean":"2024-09-11T06:18:26.375773+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:18:26.375773+0000","last_undegraded":"2024-09-11T06:18:26.375773+0000","last_fullsized":"2024-09-11T06:18:26.375773+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"99'235","reported_seq":3457,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384780+0000","last_change":"2024-09-11T06:18:27.385041+0000","last_active":"2024-09-11T06:18:27.384780+0000","last_peered":"2024-09-11T06:18:27.384780+0000","last_clean":"2024-09-11T06:18:27.384780+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:18:27.384780+0000","last_undegraded":"2024-09-11T06:18:27.384780+0000","last_fullsized":"2024-09-11T06:18:27.384780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:57.242706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049313999999999998,"stat_sum":{"num_bytes":28727681,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4175,"num_read_kb":27586,"num_write":299,"num_write_kb":17443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.9","version":"99'165","reported_seq":3874,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386501+0000","last_change":"2024-09-11T06:18:27.386820+0000","last_active":"2024-09-11T06:18:27.386501+0000","last_peered":"2024-09-11T06:18:27.386501+0000","last_clean":"2024-09-11T06:18:27.386501+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:18:27.386501+0000","last_undegraded":"2024-09-11T06:18:27.386501+0000","last_fullsized":"2024-09-11T06:18:27.386501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:52:55.546850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001531075,"stat_sum":{"num_bytes":56440272,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":3541,"num_read_kb":35693,"num_write":316,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.a","version":"99'130","reported_seq":2395,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385862+0000","last_change":"2024-09-11T06:18:27.386142+0000","last_active":"2024-09-11T06:18:27.385862+0000","last_peered":"2024-09-11T06:18:27.385862+0000","last_clean":"2024-09-11T06:18:27.385862+0000","last_became_active":"2024-09-11T06:18:19.333935+0000","last_became_peered":"2024-09-11T06:18:19.333935+0000","last_unstale":"2024-09-11T06:18:27.385862+0000","last_undegraded":"2024-09-11T06:18:27.385862+0000","last_fullsized":"2024-09-11T06:18:27.385862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:22:54.422206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011792829999999999,"stat_sum":{"num_bytes":36823159,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2070,"num_read_kb":27820,"num_write":183,"num_write_kb":14811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":9995151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.b","version":"99'335","reported_seq":1764,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380090+0000","last_change":"2024-09-11T06:18:23.360901+0000","last_active":"2024-09-11T06:18:26.380090+0000","last_peered":"2024-09-11T06:18:26.380090+0000","last_clean":"2024-09-11T06:18:26.380090+0000","last_became_active":"2024-09-11T06:18:01.255735+0000","last_became_peered":"2024-09-11T06:18:01.255735+0000","last_unstale":"2024-09-11T06:18:26.380090+0000","last_undegraded":"2024-09-11T06:18:26.380090+0000","last_fullsized":"2024-09-11T06:18:26.380090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:34:11.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044582600000000002,"stat_sum":{"num_bytes":21374640,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2268,"num_read_kb":11408,"num_write":642,"num_write_kb":17866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.c","version":"99'238","reported_seq":1968,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.389953+0000","last_change":"2024-09-11T06:18:27.390192+0000","last_active":"2024-09-11T06:18:27.389953+0000","last_peered":"2024-09-11T06:18:27.389953+0000","last_clean":"2024-09-11T06:18:27.389953+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:18:27.389953+0000","last_undegraded":"2024-09-11T06:18:27.389953+0000","last_fullsized":"2024-09-11T06:18:27.389953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:52:59.330035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050497599999999997,"stat_sum":{"num_bytes":16242923,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2067,"num_read_kb":12848,"num_write":333,"num_write_kb":9186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.d","version":"99'335","reported_seq":2117,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386862+0000","last_change":"2024-09-11T06:18:27.387227+0000","last_active":"2024-09-11T06:18:27.386862+0000","last_peered":"2024-09-11T06:18:27.386862+0000","last_clean":"2024-09-11T06:18:27.386862+0000","last_became_active":"2024-09-11T06:18:19.334462+0000","last_became_peered":"2024-09-11T06:18:19.334462+0000","last_unstale":"2024-09-11T06:18:27.386862+0000","last_undegraded":"2024-09-11T06:18:27.386862+0000","last_fullsized":"2024-09-11T06:18:27.386862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:13.705578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001614437,"stat_sum":{"num_bytes":29654434,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2563,"num_read_kb":26732,"num_write":629,"num_write_kb":17828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":7078861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.e","version":"99'165","reported_seq":2028,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.392969+0000","last_change":"2024-09-11T06:18:27.393223+0000","last_active":"2024-09-11T06:18:27.392969+0000","last_peered":"2024-09-11T06:18:27.392969+0000","last_clean":"2024-09-11T06:18:27.392969+0000","last_became_active":"2024-09-11T06:17:09.679886+0000","last_became_peered":"2024-09-11T06:17:09.679886+0000","last_unstale":"2024-09-11T06:18:27.392969+0000","last_undegraded":"2024-09-11T06:18:27.392969+0000","last_fullsized":"2024-09-11T06:18:27.392969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:39:27.216431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048662400000000001,"stat_sum":{"num_bytes":27263312,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1840,"num_read_kb":33338,"num_write":237,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.f","version":"100'227","reported_seq":2818,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.393579+0000","last_change":"2024-09-11T06:18:27.394144+0000","last_active":"2024-09-11T06:18:27.393579+0000","last_peered":"2024-09-11T06:18:27.393579+0000","last_clean":"2024-09-11T06:18:27.393579+0000","last_became_active":"2024-09-11T06:18:01.252680+0000","last_became_peered":"2024-09-11T06:18:01.252680+0000","last_unstale":"2024-09-11T06:18:27.393579+0000","last_undegraded":"2024-09-11T06:18:27.393579+0000","last_fullsized":"2024-09-11T06:18:27.393579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.626649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089326800000000001,"stat_sum":{"num_bytes":31838446,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3541,"num_read_kb":26313,"num_write":271,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":16758,"num_keys_recovered":9,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.10","version":"99'186","reported_seq":1941,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.418229+0000","last_change":"2024-09-11T06:18:23.502133+0000","last_active":"2024-09-11T06:18:26.418229+0000","last_peered":"2024-09-11T06:18:26.418229+0000","last_clean":"2024-09-11T06:18:26.418229+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:18:26.418229+0000","last_undegraded":"2024-09-11T06:18:26.418229+0000","last_fullsized":"2024-09-11T06:18:26.418229+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:42.078082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000533038,"stat_sum":{"num_bytes":44386499,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3069,"num_read_kb":33308,"num_write":204,"num_write_kb":22006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.11","version":"99'242","reported_seq":2510,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386416+0000","last_change":"2024-09-11T06:18:27.386708+0000","last_active":"2024-09-11T06:18:27.386416+0000","last_peered":"2024-09-11T06:18:27.386416+0000","last_clean":"2024-09-11T06:18:27.386416+0000","last_became_active":"2024-09-11T06:17:09.683890+0000","last_became_peered":"2024-09-11T06:17:09.683890+0000","last_unstale":"2024-09-11T06:18:27.386416+0000","last_undegraded":"2024-09-11T06:18:27.386416+0000","last_fullsized":"2024-09-11T06:18:27.386416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:25:41.492747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015193590000000001,"stat_sum":{"num_bytes":37225963,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2623,"num_read_kb":36590,"num_write":297,"num_write_kb":20772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.12","version":"100'112","reported_seq":1498,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380142+0000","last_change":"2024-09-11T06:18:23.361110+0000","last_active":"2024-09-11T06:18:26.380142+0000","last_peered":"2024-09-11T06:18:26.380142+0000","last_clean":"2024-09-11T06:18:26.380142+0000","last_became_active":"2024-09-11T06:17:37.166037+0000","last_became_peered":"2024-09-11T06:17:37.166037+0000","last_unstale":"2024-09-11T06:18:26.380142+0000","last_undegraded":"2024-09-11T06:18:26.380142+0000","last_fullsized":"2024-09-11T06:18:26.380142+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:47:56.795805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038180000000000001,"stat_sum":{"num_bytes":21414457,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1047,"num_read_kb":18934,"num_write":210,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":771314,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.13","version":"100'213","reported_seq":1990,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385443+0000","last_change":"2024-09-11T06:18:27.385729+0000","last_active":"2024-09-11T06:18:27.385443+0000","last_peered":"2024-09-11T06:18:27.385443+0000","last_clean":"2024-09-11T06:18:27.385443+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:18:27.385443+0000","last_undegraded":"2024-09-11T06:18:27.385443+0000","last_fullsized":"2024-09-11T06:18:27.385443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:00.847669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082069100000000002,"stat_sum":{"num_bytes":43980048,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1700,"num_read_kb":28665,"num_write":333,"num_write_kb":21073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1047096839,"num_objects":890,"num_object_clones":0,"num_object_copies":1780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":890,"num_whiteouts":0,"num_read":86904,"num_read_kb":882487,"num_write":12329,"num_write_kb":594389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":52803112,"num_keys_recovered":80,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81367040,"data_stored":750323464,"data_compressed":19757640,"data_compressed_allocated":65990656,"data_compressed_original":737486325,"omap_allocated":8763,"internal_metadata":0},"log_size":7660,"ondisk_log_size":7660,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50704,"kb_used_data":11196,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321136,"statfs":{"total":96636764160,"available":96584843264,"internally_reserved":0,"allocated":11464704,"data_stored":92911083,"data_compressed":2645399,"data_compressed_allocated":8454144,"data_compressed_original":90818948,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45408,"kb_used_data":10056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326432,"statfs":{"total":96636764160,"available":96590266368,"internally_reserved":0,"allocated":10297344,"data_stored":87430376,"data_compressed":2002696,"data_compressed_allocated":7389184,"data_compressed_original":85429560,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":15768,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":16146432,"data_stored":138293085,"data_compressed":3819832,"data_compressed_allocated":12181504,"data_compressed_original":135390867,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53100,"kb_used_data":13584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318740,"statfs":{"total":96636764160,"available":96582389760,"internally_reserved":0,"allocated":13910016,"data_stored":118647104,"data_compressed":3281321,"data_compressed_allocated":10502144,"data_compressed_original":116242059,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991235,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38184,"kb_used_data":9620,"kb_used_omap":10,"kb_used_meta":28533,"kb_avail":94333656,"statfs":{"total":96636764160,"available":96597663744,"internally_reserved":0,"allocated":9850880,"data_stored":84442728,"data_compressed":2097654,"data_compressed_allocated":7241728,"data_compressed_original":82680105,"omap_allocated":10357,"internal_metadata":29218699},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":12048,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":12337152,"data_stored":105684662,"data_compressed":2579940,"data_compressed_allocated":8982528,"data_compressed_original":103333354,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48756,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323084,"statfs":{"total":96636764160,"available":96586838016,"internally_reserved":0,"allocated":9474048,"data_stored":77242448,"data_compressed":2000363,"data_compressed_allocated":6692864,"data_compressed_original":75334161,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41548,"kb_used_data":6188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330292,"statfs":{"total":96636764160,"available":96594219008,"internally_reserved":0,"allocated":6336512,"data_stored":43174226,"data_compressed":1271825,"data_compressed_allocated":3891200,"data_compressed_original":41576695,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11157504,"data_stored":105122311,"data_compressed":2579940,"data_compressed_allocated":8982528,"data_compressed_original":103333354,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8613888,"data_stored":83290009,"data_compressed":2088985,"data_compressed_allocated":7204864,"data_compressed_original":82106665,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12730368,"data_stored":118084753,"data_compressed":3281321,"data_compressed_allocated":10502144,"data_compressed_original":116242059,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14962688,"data_stored":137730715,"data_compressed":3819832,"data_compressed_allocated":12181504,"data_compressed_original":135390867,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":86861540,"data_compressed":2002696,"data_compressed_allocated":7389184,"data_compressed_original":85429560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10227712,"data_stored":91758364,"data_compressed":2636730,"data_compressed_allocated":8417280,"data_compressed_original":90245508,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9306112,"data_stored":84773143,"data_compressed":2076212,"data_compressed_allocated":7417856,"data_compressed_original":83145233,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5263360,"data_stored":42702629,"data_compressed":1271924,"data_compressed_allocated":3895296,"data_compressed_original":41593079,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:18:28.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2562 3.3 3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.207691288000007, 2024-09-11T06:18:28.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022911187999999999, 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2562 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683418+0000", 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683419+0000", 2024-09-11T06:18:28.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.423e-06 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683428+0000", 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2839999999999995e-06 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683442+0000", 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3841e-05 2024-09-11T06:18:28.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683452+0000", 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9620000000000005e-06 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683508+0000", 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.571e-05 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.683567+0000", 2024-09-11T06:18:28.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9478999999999998e-05 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.686817+0000", 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032494239999999999 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:28.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706215+0000", 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019398651999999999 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706251+0000", 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5345999999999997e-05 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706293+0000", 2024-09-11T06:18:28.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2432999999999998e-05 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.706329+0000", 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5633999999999998e-05 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.087695049999994, 2024-09-11T06:18:28.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:28.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:28.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:28.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28883 3.1c 3:3b5a559a:::rbd_data.116d770b822.0000000000000006:13 [read 3964928~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:28.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:28.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.520814749000003, 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020291813999999998, 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28883 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:28.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370294+0000", 2024-09-11T06:18:28.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370295+0000", 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370297+0000", 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.21e-06 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370303+0000", 2024-09-11T06:18:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4479999999999999e-06 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370309+0000", 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3040000000000004e-06 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390350+0000", 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020040842 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390438+0000", 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8446e-05 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.390586+0000", 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014808399999999999 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38581 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.913 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603755907, 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020052018000000001, 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38581 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287353+0000", 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287354+0000", 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287356+0000", 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4030000000000001e-06 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287362+0000", 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9710000000000001e-06 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287367+0000", 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307187+0000", 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019820397999999999 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307279+0000", 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1417999999999998e-05 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307405+0000", 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126265 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38582 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3211264~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603734425999999, 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020273138999999999, 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38582 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287375+0000", 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287377+0000", 2024-09-11T06:18:28.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0990000000000001e-06 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287383+0000", 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0499999999999997e-06 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287388+0000", 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8149999999999996e-06 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307438+0000", 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020050081000000001 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307527+0000", 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9476999999999997e-05 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307648+0000", 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120226 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.922 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38583 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 3997696~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603715189999999, 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020512203999999999, 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38583 2024-09-11T06:18:28.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287394+0000", 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287401+0000", 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1500000000000002e-06 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287408+0000", 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1750000000000002e-06 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287413+0000", 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0640000000000001e-06 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307690+0000", 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020277067999999999 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307779+0000", 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9071000000000002e-05 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307906+0000", 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012727600000000001 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38584 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 4784128~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603689355, 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020729899, 2024-09-11T06:18:28.927 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38584 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287420+0000", 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1800000000000001e-07 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287422+0000", 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1560000000000002e-06 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287427+0000", 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2299999999999999e-06 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287439+0000", 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1263999999999999e-05 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.307939+0000", 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020499962 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308026+0000", 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7787000000000005e-05 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308150+0000", 2024-09-11T06:18:28.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123082 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38585 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 5570560~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603525866999998, 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782914, 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38585 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287583+0000", 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287584+0000", 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-07 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287587+0000", 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3979999999999999e-06 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287595+0000", 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6899999999999992e-06 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287601+0000", 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308194+0000", 2024-09-11T06:18:28.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020593066 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308290+0000", 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6405999999999998e-05 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308366+0000", 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5727000000000002e-05 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38586 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 6356992~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603498403, 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021009344999999999, 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38586 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287611+0000", 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287613+0000", 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.43e-06 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287620+0000", 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0789999999999997e-06 2024-09-11T06:18:28.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287630+0000", 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0328e-05 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308412+0000", 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020782281999999999 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308505+0000", 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2492999999999997e-05 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308620+0000", 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115283 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38587 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7143424~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.941 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603471384999999, 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021158300000000001, 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38587 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287638+0000", 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287641+0000", 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.836e-06 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287648+0000", 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7710000000000001e-06 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287652+0000", 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6450000000000004e-06 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308654+0000", 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021001899000000001 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308701+0000", 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6551000000000002e-05 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308796+0000", 2024-09-11T06:18:28.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5192000000000006e-05 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38588 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 7929856~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603450054, 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021338811999999999, 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38588 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287659+0000", 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7800000000000002e-07 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287662+0000", 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1679999999999998e-06 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287668+0000", 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.302e-06 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287672+0000", 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4290000000000003e-06 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308828+0000", 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.02115616 2024-09-11T06:18:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308890+0000", 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1845000000000002e-05 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.308998+0000", 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010743000000000001 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38589 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 8716288~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603430379999999, 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021462365000000001, 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38589 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287679+0000", 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287681+0000", 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2290000000000002e-06 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287687+0000", 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.784e-06 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287691+0000", 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:18:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309029+0000", 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021337805000000001 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309076+0000", 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-05 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309141+0000", 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5264000000000004e-05 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38590 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 9502720~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603411405999999, 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021714906999999999, 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38590 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287698+0000", 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287700+0000", 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1490000000000001e-06 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287706+0000", 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0889999999999996e-06 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287711+0000", 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0429999999999998e-06 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309190+0000", 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021479043 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309284+0000", 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3968999999999994e-05 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309413+0000", 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012823700000000001 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38591 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 10289152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603391589000001, 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021935667999999998, 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38591 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287717+0000", 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287718+0000", 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287726+0000", 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6829999999999997e-06 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287734+0000", 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0079999999999996e-06 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287738+0000", 2024-09-11T06:18:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309447+0000", 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021708284000000001 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309534+0000", 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7379000000000005e-05 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309653+0000", 2024-09-11T06:18:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011905600000000001 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38592 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11075584~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603363780999999, 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022188494999999999, 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38592 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287745+0000", 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287746+0000", 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287748+0000", 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3420000000000002e-06 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287754+0000", 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5259999999999999e-06 2024-09-11T06:18:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287759+0000", 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4129999999999999e-06 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309724+0000", 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021965179000000001 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309813+0000", 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8825000000000004e-05 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309934+0000", 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120809 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38593 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 11862016~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603343759000001, 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022391579000000002, 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38593 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287765+0000", 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287766+0000", 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:18:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287768+0000", 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1459999999999999e-06 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287774+0000", 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.421e-06 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287779+0000", 2024-09-11T06:18:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4569999999999998e-06 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.309967+0000", 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022187944000000001 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310048+0000", 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1528999999999998e-05 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310157+0000", 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108729 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38594 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [sparse-read 12648448~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603323870000001, 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022597002000000001, 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38594 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287785+0000", 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287786+0000", 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4000000000000002e-07 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287788+0000", 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1239999999999999e-06 2024-09-11T06:18:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287794+0000", 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.725e-06 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287799+0000", 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0139999999999998e-06 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310186+0000", 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022386306000000002 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310270+0000", 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4507999999999998e-05 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310382+0000", 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111885 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:38595 3.3 3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:1b [read 13434880~23206 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.603303861000001, 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022896125, 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 38595 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287805+0000", 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287806+0000", 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287813+0000", 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.199e-06 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287819+0000", 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5950000000000004e-06 2024-09-11T06:18:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.287831+0000", 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1600000000000001e-05 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310413+0000", 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022582015 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310492+0000", 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9291999999999999e-05 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:01.310701+0000", 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000209061 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:39792 3.15 3:ac0e7d03:::rbd_data.116db5c39c9d.000000000000001a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-11T06:18:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.236071061000001, 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020275054000000001, 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 39792 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655038+0000", 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655040+0000", 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1610000000000001e-06 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655051+0000", 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1126e-05 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655069+0000", 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8039000000000001e-05 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655080+0000", 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0852999999999999e-05 2024-09-11T06:18:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655160+0000", 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0135000000000004e-05 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.655320+0000", 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160166 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.658973+0000", 2024-09-11T06:18:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003652335 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675201+0000", 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016227772000000001 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675214+0000", 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3508e-05 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675255+0000", 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0636999999999997e-05 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:02.675313+0000", 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8322000000000002e-05 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:57289 3.15 3:a8a1be9d:::rbd_data.116d4d1f1cd7.000000000000000b:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:14.911298+0000", 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.979811023, 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021344994999999999, 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 57289 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911298+0000", 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911298+0000", 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911299+0000", 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2999999999999999e-07 2024-09-11T06:18:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911304+0000", 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911315+0000", 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1106e-05 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911321+0000", 2024-09-11T06:18:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8370000000000002e-06 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911364+0000", 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3222000000000001e-05 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.911424+0000", 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0068000000000002e-05 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.914807+0000", 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033826020000000002 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.932508+0000", 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017701854999999999 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.932555+0000", 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6950000000000003e-05 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.932599+0000", 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3477999999999999e-05 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:14.932643+0000", 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066999999999997e-05 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:28.994 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:28.996 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:28.996 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:28.995+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:29.096 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:29.096+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:29.140 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:29.140 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:18:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:18:29.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:29.155 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-11T06:18:28.431441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1047687226,"num_objects":894,"num_object_clones":0,"num_object_copies":1788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":894,"num_whiteouts":0,"num_read":87020,"num_read_kb":882587,"num_write":12490,"num_write_kb":596807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":52803112,"num_keys_recovered":80,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7780,"ondisk_log_size":7780,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":384544,"kb_used_data":87712,"kb_used_omap":21,"kb_used_meta":296618,"kb_avail":754590176,"statfs":{"total":773094113280,"available":772700340224,"internally_reserved":0,"allocated":89817088,"data_stored":747825712,"data_compressed":19699030,"data_compressed_allocated":65335296,"data_compressed_original":730805749,"omap_allocated":21513,"internal_metadata":303737847},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":138680198,"num_objects":206,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":206,"num_whiteouts":0,"num_read":24938,"num_read_kb":109754,"num_write":1022,"num_write_kb":78891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000701"},"pg_stats":[{"pgid":"3.1f","version":"100'176","reported_seq":2230,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.373030+0000","last_change":"2024-09-11T06:18:23.496602+0000","last_active":"2024-09-11T06:18:26.373030+0000","last_peered":"2024-09-11T06:18:26.373030+0000","last_clean":"2024-09-11T06:18:26.373030+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:18:26.373030+0000","last_undegraded":"2024-09-11T06:18:26.373030+0000","last_fullsized":"2024-09-11T06:18:26.373030+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:38.326698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885549999999999,"stat_sum":{"num_bytes":44881177,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1942,"num_read_kb":18975,"num_write":338,"num_write_kb":20744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1e","version":"99'252","reported_seq":2106,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372856+0000","last_change":"2024-09-11T06:18:23.495924+0000","last_active":"2024-09-11T06:18:26.372856+0000","last_peered":"2024-09-11T06:18:26.372856+0000","last_clean":"2024-09-11T06:18:26.372856+0000","last_became_active":"2024-09-11T06:17:09.686913+0000","last_became_peered":"2024-09-11T06:17:09.686913+0000","last_unstale":"2024-09-11T06:18:26.372856+0000","last_undegraded":"2024-09-11T06:18:26.372856+0000","last_fullsized":"2024-09-11T06:18:26.372856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:17.806895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000586941,"stat_sum":{"num_bytes":11261782,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2385,"num_read_kb":9514,"num_write":446,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1d","version":"101'322","reported_seq":4151,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.387445+0000","last_change":"2024-09-11T06:18:27.387445+0000","last_active":"2024-09-11T06:18:27.387445+0000","last_peered":"2024-09-11T06:18:27.387445+0000","last_clean":"2024-09-11T06:18:27.387445+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:18:27.387445+0000","last_undegraded":"2024-09-11T06:18:27.387445+0000","last_fullsized":"2024-09-11T06:18:27.387445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:01.236738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999309999999999,"stat_sum":{"num_bytes":83451094,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4668,"num_read_kb":69943,"num_write":592,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.1c","version":"99'126","reported_seq":1940,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.419901+0000","last_change":"2024-09-11T06:18:23.502303+0000","last_active":"2024-09-11T06:18:26.419901+0000","last_peered":"2024-09-11T06:18:26.419901+0000","last_clean":"2024-09-11T06:18:26.419901+0000","last_became_active":"2024-09-11T06:18:19.335163+0000","last_became_peered":"2024-09-11T06:18:19.335163+0000","last_unstale":"2024-09-11T06:18:26.419901+0000","last_undegraded":"2024-09-11T06:18:26.419901+0000","last_fullsized":"2024-09-11T06:18:26.419901+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:51.752308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066701599999999998,"stat_sum":{"num_bytes":29876572,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2070,"num_read_kb":14320,"num_write":225,"num_write_kb":10502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1622976,"num_keys_recovered":38,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1b","version":"99'303","reported_seq":1988,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384854+0000","last_change":"2024-09-11T06:18:27.385064+0000","last_active":"2024-09-11T06:18:27.384854+0000","last_peered":"2024-09-11T06:18:27.384854+0000","last_clean":"2024-09-11T06:18:27.384854+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:18:27.384854+0000","last_undegraded":"2024-09-11T06:18:27.384854+0000","last_fullsized":"2024-09-11T06:18:27.384854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:28.681644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049185500000000003,"stat_sum":{"num_bytes":27264127,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2254,"num_read_kb":28111,"num_write":494,"num_write_kb":19239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.1a","version":"99'234","reported_seq":3374,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.457176+0000","last_change":"2024-09-11T06:18:23.495930+0000","last_active":"2024-09-11T06:18:26.457176+0000","last_peered":"2024-09-11T06:18:26.457176+0000","last_clean":"2024-09-11T06:18:26.457176+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:18:26.457176+0000","last_undegraded":"2024-09-11T06:18:26.457176+0000","last_fullsized":"2024-09-11T06:18:26.457176+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:15.532544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060037600000000001,"stat_sum":{"num_bytes":35087594,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3349,"num_read_kb":42453,"num_write":289,"num_write_kb":22333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.19","version":"100'207","reported_seq":2420,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385432+0000","last_change":"2024-09-11T06:18:27.385639+0000","last_active":"2024-09-11T06:18:27.385432+0000","last_peered":"2024-09-11T06:18:27.385432+0000","last_clean":"2024-09-11T06:18:27.385432+0000","last_became_active":"2024-09-11T06:18:19.336396+0000","last_became_peered":"2024-09-11T06:18:19.336396+0000","last_unstale":"2024-09-11T06:18:27.385432+0000","last_undegraded":"2024-09-11T06:18:27.385432+0000","last_fullsized":"2024-09-11T06:18:27.385432+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:40:27.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092286600000000005,"stat_sum":{"num_bytes":22480997,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2463,"num_read_kb":20562,"num_write":295,"num_write_kb":12336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2873672,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.18","version":"100'721","reported_seq":3205,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.452643+0000","last_change":"2024-09-11T06:18:23.496287+0000","last_active":"2024-09-11T06:18:26.452643+0000","last_peered":"2024-09-11T06:18:26.452643+0000","last_clean":"2024-09-11T06:18:26.452643+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:18:26.452643+0000","last_undegraded":"2024-09-11T06:18:26.452643+0000","last_fullsized":"2024-09-11T06:18:26.452643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:16:40.123111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086039500000000002,"stat_sum":{"num_bytes":25286142,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5301,"num_read_kb":19317,"num_write":1207,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.17","version":"100'129","reported_seq":2768,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.419011+0000","last_change":"2024-09-11T06:18:23.496526+0000","last_active":"2024-09-11T06:18:26.419011+0000","last_peered":"2024-09-11T06:18:26.419011+0000","last_clean":"2024-09-11T06:18:26.419011+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:18:26.419011+0000","last_undegraded":"2024-09-11T06:18:26.419011+0000","last_fullsized":"2024-09-11T06:18:26.419011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:59.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010661889999999999,"stat_sum":{"num_bytes":39314549,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2339,"num_read_kb":23409,"num_write":216,"num_write_kb":11665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.16","version":"99'200","reported_seq":2066,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.393207+0000","last_change":"2024-09-11T06:18:27.393492+0000","last_active":"2024-09-11T06:18:27.393207+0000","last_peered":"2024-09-11T06:18:27.393207+0000","last_clean":"2024-09-11T06:18:27.393207+0000","last_became_active":"2024-09-11T06:17:09.686021+0000","last_became_peered":"2024-09-11T06:17:09.686021+0000","last_unstale":"2024-09-11T06:18:27.393207+0000","last_undegraded":"2024-09-11T06:18:27.393207+0000","last_fullsized":"2024-09-11T06:18:27.393207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:36.992386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070350700000000003,"stat_sum":{"num_bytes":25083082,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2131,"num_read_kb":23019,"num_write":295,"num_write_kb":18371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.15","version":"99'181","reported_seq":2286,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.391192+0000","last_change":"2024-09-11T06:18:27.391621+0000","last_active":"2024-09-11T06:18:27.391192+0000","last_peered":"2024-09-11T06:18:27.391192+0000","last_clean":"2024-09-11T06:18:27.391192+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:18:27.391192+0000","last_undegraded":"2024-09-11T06:18:27.391192+0000","last_fullsized":"2024-09-11T06:18:27.391192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:11.189983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017611529999999999,"stat_sum":{"num_bytes":28672271,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1940,"num_read_kb":29935,"num_write":286,"num_write_kb":29287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.14","version":"99'102","reported_seq":2755,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385685+0000","last_change":"2024-09-11T06:18:27.386340+0000","last_active":"2024-09-11T06:18:27.385685+0000","last_peered":"2024-09-11T06:18:27.385685+0000","last_clean":"2024-09-11T06:18:27.385685+0000","last_became_active":"2024-09-11T06:17:09.682654+0000","last_became_peered":"2024-09-11T06:17:09.682654+0000","last_unstale":"2024-09-11T06:18:27.385685+0000","last_undegraded":"2024-09-11T06:18:27.385685+0000","last_fullsized":"2024-09-11T06:18:27.385685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:18.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013973080000000001,"stat_sum":{"num_bytes":52734446,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2394,"num_read_kb":53471,"num_write":191,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385261+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:18:27.385261+0000","last_peered":"2024-09-11T06:18:27.385261+0000","last_clean":"2024-09-11T06:18:27.385261+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:18:27.385261+0000","last_undegraded":"2024-09-11T06:18:27.385261+0000","last_fullsized":"2024-09-11T06:18:27.385261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"99'136","reported_seq":2994,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385220+0000","last_change":"2024-09-11T06:18:27.385449+0000","last_active":"2024-09-11T06:18:27.385220+0000","last_peered":"2024-09-11T06:18:27.385220+0000","last_clean":"2024-09-11T06:18:27.385220+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:18:27.385220+0000","last_undegraded":"2024-09-11T06:18:27.385220+0000","last_fullsized":"2024-09-11T06:18:27.385220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:29.145094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087526599999999998,"stat_sum":{"num_bytes":37505167,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2551,"num_read_kb":36826,"num_write":254,"num_write_kb":22788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384564+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:18:27.384564+0000","last_peered":"2024-09-11T06:18:27.384564+0000","last_clean":"2024-09-11T06:18:27.384564+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:18:27.384564+0000","last_undegraded":"2024-09-11T06:18:27.384564+0000","last_fullsized":"2024-09-11T06:18:27.384564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"99'128","reported_seq":1775,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385143+0000","last_change":"2024-09-11T06:18:27.385356+0000","last_active":"2024-09-11T06:18:27.385143+0000","last_peered":"2024-09-11T06:18:27.385143+0000","last_clean":"2024-09-11T06:18:27.385143+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:18:27.385143+0000","last_undegraded":"2024-09-11T06:18:27.385143+0000","last_fullsized":"2024-09-11T06:18:27.385143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:10:18.926263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000678124,"stat_sum":{"num_bytes":26498254,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1463,"num_read_kb":23134,"num_write":192,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385860+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:18:27.385860+0000","last_peered":"2024-09-11T06:18:27.385860+0000","last_clean":"2024-09-11T06:18:27.385860+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:18:27.385860+0000","last_undegraded":"2024-09-11T06:18:27.385860+0000","last_fullsized":"2024-09-11T06:18:27.385860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"100'350","reported_seq":3293,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.430183+0000","last_change":"2024-09-11T06:18:23.361137+0000","last_active":"2024-09-11T06:18:26.430183+0000","last_peered":"2024-09-11T06:18:26.430183+0000","last_clean":"2024-09-11T06:18:26.430183+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:18:26.430183+0000","last_undegraded":"2024-09-11T06:18:26.430183+0000","last_fullsized":"2024-09-11T06:18:26.430183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:55:02.843476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058890899999999998,"stat_sum":{"num_bytes":37392643,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":3683,"num_read_kb":47772,"num_write":676,"num_write_kb":25705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372902+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:18:26.372902+0000","last_peered":"2024-09-11T06:18:26.372902+0000","last_clean":"2024-09-11T06:18:26.372902+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:18:26.372902+0000","last_undegraded":"2024-09-11T06:18:26.372902+0000","last_fullsized":"2024-09-11T06:18:26.372902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"100'298","reported_seq":2845,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.392825+0000","last_change":"2024-09-11T06:18:27.393111+0000","last_active":"2024-09-11T06:18:27.392825+0000","last_peered":"2024-09-11T06:18:27.392825+0000","last_clean":"2024-09-11T06:18:27.392825+0000","last_became_active":"2024-09-11T06:17:09.680887+0000","last_became_peered":"2024-09-11T06:17:09.680887+0000","last_unstale":"2024-09-11T06:18:27.392825+0000","last_undegraded":"2024-09-11T06:18:27.392825+0000","last_fullsized":"2024-09-11T06:18:27.392825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:49.505140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052785199999999999,"stat_sum":{"num_bytes":21809112,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3489,"num_read_kb":21655,"num_write":397,"num_write_kb":9118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.3","version":"101'420","reported_seq":3704,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.399433+0000","last_change":"2024-09-11T06:18:27.391505+0000","last_active":"2024-09-11T06:18:27.399433+0000","last_peered":"2024-09-11T06:18:27.399433+0000","last_clean":"2024-09-11T06:18:27.399433+0000","last_became_active":"2024-09-11T06:17:09.676881+0000","last_became_peered":"2024-09-11T06:17:09.676881+0000","last_unstale":"2024-09-11T06:18:27.399433+0000","last_undegraded":"2024-09-11T06:18:27.399433+0000","last_fullsized":"2024-09-11T06:18:27.399433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:47.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001738493,"stat_sum":{"num_bytes":41647280,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5308,"num_read_kb":27788,"num_write":540,"num_write_kb":21253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":179,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385475+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:18:27.385475+0000","last_peered":"2024-09-11T06:18:27.385475+0000","last_clean":"2024-09-11T06:18:27.385475+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:18:27.385475+0000","last_undegraded":"2024-09-11T06:18:27.385475+0000","last_fullsized":"2024-09-11T06:18:27.385475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"99'245","reported_seq":2173,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.418642+0000","last_change":"2024-09-11T06:18:23.496212+0000","last_active":"2024-09-11T06:18:26.418642+0000","last_peered":"2024-09-11T06:18:26.418642+0000","last_clean":"2024-09-11T06:18:26.418642+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:18:26.418642+0000","last_undegraded":"2024-09-11T06:18:26.418642+0000","last_fullsized":"2024-09-11T06:18:26.418642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:44.678122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093509300000000001,"stat_sum":{"num_bytes":22197462,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2303,"num_read_kb":21492,"num_write":457,"num_write_kb":20828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372840+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:18:26.372840+0000","last_peered":"2024-09-11T06:18:26.372840+0000","last_clean":"2024-09-11T06:18:26.372840+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:18:26.372840+0000","last_undegraded":"2024-09-11T06:18:26.372840+0000","last_fullsized":"2024-09-11T06:18:26.372840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'360","reported_seq":1569,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380057+0000","last_change":"2024-09-11T06:18:23.360858+0000","last_active":"2024-09-11T06:18:26.380057+0000","last_peered":"2024-09-11T06:18:26.380057+0000","last_clean":"2024-09-11T06:18:26.380057+0000","last_became_active":"2024-09-11T06:17:09.679986+0000","last_became_peered":"2024-09-11T06:17:09.679986+0000","last_unstale":"2024-09-11T06:18:26.380057+0000","last_undegraded":"2024-09-11T06:18:26.380057+0000","last_fullsized":"2024-09-11T06:18:26.380057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:31.341940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041977699999999998,"stat_sum":{"num_bytes":20209097,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2310,"num_read_kb":16744,"num_write":644,"num_write_kb":16894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384670+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:18:27.384670+0000","last_peered":"2024-09-11T06:18:27.384670+0000","last_clean":"2024-09-11T06:18:27.384670+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:18:27.384670+0000","last_undegraded":"2024-09-11T06:18:27.384670+0000","last_fullsized":"2024-09-11T06:18:27.384670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"99'187","reported_seq":2030,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385510+0000","last_change":"2024-09-11T06:18:27.385753+0000","last_active":"2024-09-11T06:18:27.385510+0000","last_peered":"2024-09-11T06:18:27.385510+0000","last_clean":"2024-09-11T06:18:27.385510+0000","last_became_active":"2024-09-11T06:17:09.675683+0000","last_became_peered":"2024-09-11T06:17:09.675683+0000","last_unstale":"2024-09-11T06:18:27.385510+0000","last_undegraded":"2024-09-11T06:18:27.385510+0000","last_fullsized":"2024-09-11T06:18:27.385510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:09:58.234973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098683899999999999,"stat_sum":{"num_bytes":19072157,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2057,"num_read_kb":14812,"num_write":341,"num_write_kb":14039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":178,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385014+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:18:27.385014+0000","last_peered":"2024-09-11T06:18:27.385014+0000","last_clean":"2024-09-11T06:18:27.385014+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:18:27.385014+0000","last_undegraded":"2024-09-11T06:18:27.385014+0000","last_fullsized":"2024-09-11T06:18:27.385014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.375773+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:18:26.375773+0000","last_peered":"2024-09-11T06:18:26.375773+0000","last_clean":"2024-09-11T06:18:26.375773+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:18:26.375773+0000","last_undegraded":"2024-09-11T06:18:26.375773+0000","last_fullsized":"2024-09-11T06:18:26.375773+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"99'235","reported_seq":3457,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384780+0000","last_change":"2024-09-11T06:18:27.385041+0000","last_active":"2024-09-11T06:18:27.384780+0000","last_peered":"2024-09-11T06:18:27.384780+0000","last_clean":"2024-09-11T06:18:27.384780+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:18:27.384780+0000","last_undegraded":"2024-09-11T06:18:27.384780+0000","last_fullsized":"2024-09-11T06:18:27.384780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:57.242706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049313999999999998,"stat_sum":{"num_bytes":28727681,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4175,"num_read_kb":27586,"num_write":299,"num_write_kb":17443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.9","version":"99'165","reported_seq":3874,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386501+0000","last_change":"2024-09-11T06:18:27.386820+0000","last_active":"2024-09-11T06:18:27.386501+0000","last_peered":"2024-09-11T06:18:27.386501+0000","last_clean":"2024-09-11T06:18:27.386501+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:18:27.386501+0000","last_undegraded":"2024-09-11T06:18:27.386501+0000","last_fullsized":"2024-09-11T06:18:27.386501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:52:55.546850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001531075,"stat_sum":{"num_bytes":56440272,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":3541,"num_read_kb":35693,"num_write":316,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.a","version":"99'130","reported_seq":2395,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385862+0000","last_change":"2024-09-11T06:18:27.386142+0000","last_active":"2024-09-11T06:18:27.385862+0000","last_peered":"2024-09-11T06:18:27.385862+0000","last_clean":"2024-09-11T06:18:27.385862+0000","last_became_active":"2024-09-11T06:18:19.333935+0000","last_became_peered":"2024-09-11T06:18:19.333935+0000","last_unstale":"2024-09-11T06:18:27.385862+0000","last_undegraded":"2024-09-11T06:18:27.385862+0000","last_fullsized":"2024-09-11T06:18:27.385862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:22:54.422206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011792829999999999,"stat_sum":{"num_bytes":36823159,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2070,"num_read_kb":27820,"num_write":183,"num_write_kb":14811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":9995151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.b","version":"99'335","reported_seq":1764,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380090+0000","last_change":"2024-09-11T06:18:23.360901+0000","last_active":"2024-09-11T06:18:26.380090+0000","last_peered":"2024-09-11T06:18:26.380090+0000","last_clean":"2024-09-11T06:18:26.380090+0000","last_became_active":"2024-09-11T06:18:01.255735+0000","last_became_peered":"2024-09-11T06:18:01.255735+0000","last_unstale":"2024-09-11T06:18:26.380090+0000","last_undegraded":"2024-09-11T06:18:26.380090+0000","last_fullsized":"2024-09-11T06:18:26.380090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:34:11.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044582600000000002,"stat_sum":{"num_bytes":21374640,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2268,"num_read_kb":11408,"num_write":642,"num_write_kb":17866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.c","version":"99'238","reported_seq":1968,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.389953+0000","last_change":"2024-09-11T06:18:27.390192+0000","last_active":"2024-09-11T06:18:27.389953+0000","last_peered":"2024-09-11T06:18:27.389953+0000","last_clean":"2024-09-11T06:18:27.389953+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:18:27.389953+0000","last_undegraded":"2024-09-11T06:18:27.389953+0000","last_fullsized":"2024-09-11T06:18:27.389953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:52:59.330035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050497599999999997,"stat_sum":{"num_bytes":16242923,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2067,"num_read_kb":12848,"num_write":333,"num_write_kb":9186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.d","version":"99'335","reported_seq":2117,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386862+0000","last_change":"2024-09-11T06:18:27.387227+0000","last_active":"2024-09-11T06:18:27.386862+0000","last_peered":"2024-09-11T06:18:27.386862+0000","last_clean":"2024-09-11T06:18:27.386862+0000","last_became_active":"2024-09-11T06:18:19.334462+0000","last_became_peered":"2024-09-11T06:18:19.334462+0000","last_unstale":"2024-09-11T06:18:27.386862+0000","last_undegraded":"2024-09-11T06:18:27.386862+0000","last_fullsized":"2024-09-11T06:18:27.386862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:13.705578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001614437,"stat_sum":{"num_bytes":29654434,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2563,"num_read_kb":26732,"num_write":629,"num_write_kb":17828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":7078861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.e","version":"99'165","reported_seq":2028,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.392969+0000","last_change":"2024-09-11T06:18:27.393223+0000","last_active":"2024-09-11T06:18:27.392969+0000","last_peered":"2024-09-11T06:18:27.392969+0000","last_clean":"2024-09-11T06:18:27.392969+0000","last_became_active":"2024-09-11T06:17:09.679886+0000","last_became_peered":"2024-09-11T06:17:09.679886+0000","last_unstale":"2024-09-11T06:18:27.392969+0000","last_undegraded":"2024-09-11T06:18:27.392969+0000","last_fullsized":"2024-09-11T06:18:27.392969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:39:27.216431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048662400000000001,"stat_sum":{"num_bytes":27263312,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1840,"num_read_kb":33338,"num_write":237,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.f","version":"100'227","reported_seq":2818,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.393579+0000","last_change":"2024-09-11T06:18:27.394144+0000","last_active":"2024-09-11T06:18:27.393579+0000","last_peered":"2024-09-11T06:18:27.393579+0000","last_clean":"2024-09-11T06:18:27.393579+0000","last_became_active":"2024-09-11T06:18:01.252680+0000","last_became_peered":"2024-09-11T06:18:01.252680+0000","last_unstale":"2024-09-11T06:18:27.393579+0000","last_undegraded":"2024-09-11T06:18:27.393579+0000","last_fullsized":"2024-09-11T06:18:27.393579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.626649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089326800000000001,"stat_sum":{"num_bytes":31838446,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3541,"num_read_kb":26313,"num_write":271,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":16758,"num_keys_recovered":9,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.10","version":"99'186","reported_seq":1941,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.418229+0000","last_change":"2024-09-11T06:18:23.502133+0000","last_active":"2024-09-11T06:18:26.418229+0000","last_peered":"2024-09-11T06:18:26.418229+0000","last_clean":"2024-09-11T06:18:26.418229+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:18:26.418229+0000","last_undegraded":"2024-09-11T06:18:26.418229+0000","last_fullsized":"2024-09-11T06:18:26.418229+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:42.078082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000533038,"stat_sum":{"num_bytes":44386499,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3069,"num_read_kb":33308,"num_write":204,"num_write_kb":22006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.11","version":"99'242","reported_seq":2510,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386416+0000","last_change":"2024-09-11T06:18:27.386708+0000","last_active":"2024-09-11T06:18:27.386416+0000","last_peered":"2024-09-11T06:18:27.386416+0000","last_clean":"2024-09-11T06:18:27.386416+0000","last_became_active":"2024-09-11T06:17:09.683890+0000","last_became_peered":"2024-09-11T06:17:09.683890+0000","last_unstale":"2024-09-11T06:18:27.386416+0000","last_undegraded":"2024-09-11T06:18:27.386416+0000","last_fullsized":"2024-09-11T06:18:27.386416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:25:41.492747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015193590000000001,"stat_sum":{"num_bytes":37225963,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2623,"num_read_kb":36590,"num_write":297,"num_write_kb":20772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.12","version":"100'112","reported_seq":1498,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380142+0000","last_change":"2024-09-11T06:18:23.361110+0000","last_active":"2024-09-11T06:18:26.380142+0000","last_peered":"2024-09-11T06:18:26.380142+0000","last_clean":"2024-09-11T06:18:26.380142+0000","last_became_active":"2024-09-11T06:17:37.166037+0000","last_became_peered":"2024-09-11T06:17:37.166037+0000","last_unstale":"2024-09-11T06:18:26.380142+0000","last_undegraded":"2024-09-11T06:18:26.380142+0000","last_fullsized":"2024-09-11T06:18:26.380142+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:47:56.795805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038180000000000001,"stat_sum":{"num_bytes":21414457,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1047,"num_read_kb":18934,"num_write":210,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":771314,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.13","version":"100'213","reported_seq":1990,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385443+0000","last_change":"2024-09-11T06:18:27.385729+0000","last_active":"2024-09-11T06:18:27.385443+0000","last_peered":"2024-09-11T06:18:27.385443+0000","last_clean":"2024-09-11T06:18:27.385443+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:18:27.385443+0000","last_undegraded":"2024-09-11T06:18:27.385443+0000","last_fullsized":"2024-09-11T06:18:27.385443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:00.847669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082069100000000002,"stat_sum":{"num_bytes":43980048,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1700,"num_read_kb":28665,"num_write":333,"num_write_kb":21073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1047096839,"num_objects":890,"num_object_clones":0,"num_object_copies":1780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":890,"num_whiteouts":0,"num_read":86904,"num_read_kb":882487,"num_write":12329,"num_write_kb":594389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":52803112,"num_keys_recovered":80,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81367040,"data_stored":750323464,"data_compressed":19757640,"data_compressed_allocated":65990656,"data_compressed_original":737486325,"omap_allocated":8763,"internal_metadata":0},"log_size":7660,"ondisk_log_size":7660,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50704,"kb_used_data":11196,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321136,"statfs":{"total":96636764160,"available":96584843264,"internally_reserved":0,"allocated":11464704,"data_stored":92911083,"data_compressed":2645399,"data_compressed_allocated":8454144,"data_compressed_original":90818948,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45408,"kb_used_data":10056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326432,"statfs":{"total":96636764160,"available":96590266368,"internally_reserved":0,"allocated":10297344,"data_stored":87430376,"data_compressed":2002696,"data_compressed_allocated":7389184,"data_compressed_original":85429560,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":15768,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":16146432,"data_stored":138293085,"data_compressed":3819832,"data_compressed_allocated":12181504,"data_compressed_original":135390867,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53100,"kb_used_data":13584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318740,"statfs":{"total":96636764160,"available":96582389760,"internally_reserved":0,"allocated":13910016,"data_stored":118647104,"data_compressed":3281321,"data_compressed_allocated":10502144,"data_compressed_original":116242059,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991235,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38184,"kb_used_data":9620,"kb_used_omap":10,"kb_used_meta":28533,"kb_avail":94333656,"statfs":{"total":96636764160,"available":96597663744,"internally_reserved":0,"allocated":9850880,"data_stored":84442728,"data_compressed":2097654,"data_compressed_allocated":7241728,"data_compressed_original":82680105,"omap_allocated":10357,"internal_metadata":29218699},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":12048,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":12337152,"data_stored":105684662,"data_compressed":2579940,"data_compressed_allocated":8982528,"data_compressed_original":103333354,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48756,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323084,"statfs":{"total":96636764160,"available":96586838016,"internally_reserved":0,"allocated":9474048,"data_stored":77242448,"data_compressed":2000363,"data_compressed_allocated":6692864,"data_compressed_original":75334161,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41548,"kb_used_data":6188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330292,"statfs":{"total":96636764160,"available":96594219008,"internally_reserved":0,"allocated":6336512,"data_stored":43174226,"data_compressed":1271825,"data_compressed_allocated":3891200,"data_compressed_original":41576695,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11157504,"data_stored":105122311,"data_compressed":2579940,"data_compressed_allocated":8982528,"data_compressed_original":103333354,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8613888,"data_stored":83290009,"data_compressed":2088985,"data_compressed_allocated":7204864,"data_compressed_original":82106665,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12730368,"data_stored":118084753,"data_compressed":3281321,"data_compressed_allocated":10502144,"data_compressed_original":116242059,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14962688,"data_stored":137730715,"data_compressed":3819832,"data_compressed_allocated":12181504,"data_compressed_original":135390867,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":86861540,"data_compressed":2002696,"data_compressed_allocated":7389184,"data_compressed_original":85429560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10227712,"data_stored":91758364,"data_compressed":2636730,"data_compressed_allocated":8417280,"data_compressed_original":90245508,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9306112,"data_stored":84773143,"data_compressed":2076212,"data_compressed_allocated":7417856,"data_compressed_original":83145233,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5263360,"data_stored":42702629,"data_compressed":1271924,"data_compressed_allocated":3895296,"data_compressed_original":41593079,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:18:29.157 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T06:18:29.157 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:18:29.157 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T06:18:29.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:18:29.197 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:29.196+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:29.253 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:29.253 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:29.254 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:29.254 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:29.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:29.306 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:29.305+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:29.369 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2271 3.16 3:6f6a1c77:::rbd_data.116dc3b5629f.0000000000000026:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.109869996, 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012468982999999999, 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2271 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258002+0000", 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258004+0000", 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6419999999999999e-06 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258011+0000", 2024-09-11T06:18:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4599999999999997e-06 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258025+0000", 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3804e-05 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258033+0000", 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4239999999999993e-06 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258089+0000", 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.588e-05 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.258147+0000", 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8220000000000002e-05 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.260204+0000", 2024-09-11T06:18:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020570269999999999 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270393+0000", 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010188657 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270403+0000", 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0421999999999999e-05 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270437+0000", 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3373e-05 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.270471+0000", 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4073999999999999e-05 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2403 3.e 3:764e97df:::rbd_data.116dc3b5629f.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.926233095000001, 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018324528999999999, 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2403 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441639+0000", 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441640+0000", 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441646+0000", 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:18:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441656+0000", 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0257e-05 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441661+0000", 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0549999999999999e-06 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441710+0000", 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8446999999999999e-05 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.441761+0000", 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1060999999999998e-05 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.444470+0000", 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027092539999999999 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459870+0000", 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015399629 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459881+0000", 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1382e-05 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459926+0000", 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4505000000000002e-05 2024-09-11T06:18:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.459963+0000", 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7759999999999998e-05 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28475 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2834432~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.023483269000003, 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011213330000000001, 2024-09-11T06:18:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28475 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344389+0000", 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6899999999999997e-07 2024-09-11T06:18:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344391+0000", 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2050000000000001e-06 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344398+0000", 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3380000000000001e-06 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344403+0000", 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.882e-06 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355471+0000", 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011068056 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355528+0000", 2024-09-11T06:18:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6821999999999999e-05 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355602+0000", 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4457999999999998e-05 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28476 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3162112~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.023463266, 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464858, 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28476 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344409+0000", 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3700000000000001e-07 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344411+0000", 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.052e-06 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344417+0000", 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344422+0000", 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7589999999999997e-06 2024-09-11T06:18:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355649+0000", 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011227305999999999 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355742+0000", 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2974999999999997e-05 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355874+0000", 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013158000000000001 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28477 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3489792~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.023443927000002, 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011629143999999999, 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28477 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344428+0000", 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344429+0000", 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.06e-07 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344445+0000", 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6001000000000001e-05 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344451+0000", 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9569999999999996e-06 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344456+0000", 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8350000000000003e-06 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355921+0000", 2024-09-11T06:18:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011464919 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.355991+0000", 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9424000000000005e-05 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356057+0000", 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6501999999999994e-05 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28478 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3817472~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.023407970000001, 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011937405, 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28478 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344464+0000", 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000003e-07 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344467+0000", 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344473+0000", 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:18:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344478+0000", 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8720000000000001e-06 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356268+0000", 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011790629 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356317+0000", 2024-09-11T06:18:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8594999999999998e-05 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356401+0000", 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4469999999999996e-05 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28479 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4145152~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.023387769999999, 2024-09-11T06:18:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012172307, 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28479 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344484+0000", 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344485+0000", 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6600000000000002e-07 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344486+0000", 2024-09-11T06:18:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.894e-06 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344493+0000", 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0909999999999998e-06 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.344497+0000", 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.464e-06 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356440+0000", 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011942790999999999 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356532+0000", 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2093000000000001e-05 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.356656+0000", 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012460800000000001 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28824 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3129344~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.001712314000002, 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011315202, 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28824 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366160+0000", 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366162+0000", 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8360000000000001e-06 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366167+0000", 2024-09-11T06:18:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366172+0000", 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377208+0000", 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011035872 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377326+0000", 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118474 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377475+0000", 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000148675 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28825 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3342336~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.001694403000002, 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011577013000000001, 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28825 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366178+0000", 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.41e-07 2024-09-11T06:18:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366180+0000", 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7880000000000001e-06 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366185+0000", 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7309999999999998e-06 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366190+0000", 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377508+0000", 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011317763 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377595+0000", 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6674000000000004e-05 2024-09-11T06:18:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377755+0000", 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015964899999999999 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28826 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3457024~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.001675642999999, 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011917782, 2024-09-11T06:18:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28826 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366196+0000", 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366197+0000", 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-07 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366233+0000", 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6746999999999999e-05 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366283+0000", 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9579000000000001e-05 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366289+0000", 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8799999999999996e-06 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.377787+0000", 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011498058 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378003+0000", 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215553 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378114+0000", 2024-09-11T06:18:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111576 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28827 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3670016~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.001572791000001, 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012035376, 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28827 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366299+0000", 2024-09-11T06:18:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366300+0000", 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9100000000000004e-07 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366307+0000", 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5850000000000002e-06 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366315+0000", 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4290000000000004e-06 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366319+0000", 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6310000000000002e-06 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378147+0000", 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011827725000000001 2024-09-11T06:18:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378228+0000", 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1207999999999999e-05 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378335+0000", 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010620699999999999 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28828 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3784704~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.001545651999997, 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012221928999999999, 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28828 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366326+0000", 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366327+0000", 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366359+0000", 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2202000000000001e-05 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366415+0000", 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5828000000000001e-05 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366425+0000", 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0176e-05 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378366+0000", 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011941139 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378446+0000", 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0144999999999999e-05 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378548+0000", 2024-09-11T06:18:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010201599999999999 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28829 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3997696~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.001436572000003, 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012320490999999999, 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28829 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366435+0000", 2024-09-11T06:18:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366436+0000", 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2200000000000003e-07 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366439+0000", 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366446+0000", 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9580000000000001e-06 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366451+0000", 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378579+0000", 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012127816 2024-09-11T06:18:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378660+0000", 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1391999999999996e-05 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378756+0000", 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5610000000000001e-05 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28830 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4112384~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.001412928999997, 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012505113, 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28830 2024-09-11T06:18:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366459+0000", 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366461+0000", 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0159999999999998e-06 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366467+0000", 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7679999999999997e-06 2024-09-11T06:18:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.366472+0000", 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378786+0000", 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012313783 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378863+0000", 2024-09-11T06:18:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7307999999999999e-05 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378964+0000", 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101242 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28832 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.999817391999997, 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011082763000000001, 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28832 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368055+0000", 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368056+0000", 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6500000000000008e-07 2024-09-11T06:18:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368060+0000", 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3800000000000004e-06 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368069+0000", 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0280000000000006e-06 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.368076+0000", 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0690000000000004e-06 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.378995+0000", 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010918638 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379071+0000", 2024-09-11T06:18:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.379137+0000", 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6068000000000005e-05 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28892 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 2703360~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.997391301999997, 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011111242, 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28892 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370481+0000", 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6699999999999999e-07 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370483+0000", 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7320000000000001e-06 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370609+0000", 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012621900000000001 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.370907+0000", 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029802600000000001 2024-09-11T06:18:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381393+0000", 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010486430999999999 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381481+0000", 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7565999999999995e-05 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.381592+0000", 2024-09-11T06:18:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110901 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28895 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 3686400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.996831284999999, 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011282359, 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28895 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371041+0000", 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4799999999999999e-07 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371047+0000", 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2999999999999998e-06 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371055+0000", 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6149999999999999e-06 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371060+0000", 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.853e-06 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382125+0000", 2024-09-11T06:18:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011064978 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382209+0000", 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3665000000000006e-05 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382323+0000", 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001145 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:28896 3.16 3:6e77a68d:::rbd_data.116d770b822.0000000000000007:13 [read 4014080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.996804730000001, 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011490497000000001, 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 28896 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371067+0000", 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371068+0000", 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371070+0000", 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.091e-06 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371076+0000", 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4389999999999997e-06 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.371080+0000", 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2350000000000001e-06 2024-09-11T06:18:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382360+0000", 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011279811000000001 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382447+0000", 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7306999999999996e-05 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:48.382558+0000", 2024-09-11T06:18:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110216 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:33858 3.1 e66/24 3:813e6a9a:::rbd_header.116de94696bd:head v 66'309, mlcod=65'307)", 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.150759372000003, 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.031257166000000003, 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217113+0000", 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7700000000000001e-07 2024-09-11T06:18:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.217117+0000", 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4519999999999999e-06 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247505+0000", 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030387882000000001 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247521+0000", 2024-09-11T06:18:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5610000000000001e-05 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247591+0000", 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0219e-05 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.247617+0000", 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6393999999999998e-05 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248310+0000", 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000693094 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:52.248370+0000", 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9338e-05 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:37167 3.14 e71/24 3:2d16ab43:::rbd_data.116d2df99cf8.0000000000000000:head v 71'56, mlcod=69'54)", 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.078831272000002, 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020546310000000002, 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.289041+0000", 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0699999999999998e-07 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298061+0000", 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090201050000000005 2024-09-11T06:18:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298090+0000", 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8428e-05 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298101+0000", 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1426999999999999e-05 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298180+0000", 2024-09-11T06:18:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9118999999999999e-05 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.298208+0000", 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7798999999999999e-05 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.309523+0000", 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011315488 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:57.309587+0000", 2024-09-11T06:18:29.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3637000000000001e-05 2024-09-11T06:18:29.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.467 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.467 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.467 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:29.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:18:29.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:29.470 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:29.467+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:29.490 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:18:29.490 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 103, 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:18:29.389180+0000", 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:18:18.325942+0000", 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:16:42.356322+0000", 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2024-09-11T06:18:29.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 6, 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:18:29.492 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:18:29.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:18:29.494 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:18:29.495 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:18:29.496 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:18:29.497 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:18:29.498 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:18:29.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:18:29.500 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:18:29.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:18:29.502 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:18:29.503 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:18:29.504 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:18:29.505 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:18:29.506 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:18:29.506 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:18:29.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.506 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:18:29.506 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:18:29.506 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:18:29.506 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:18:29.506 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:18:29.507 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:18:29.508 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:18:29.509 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:18:29.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:18:29.511 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:18:29.512 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:18:29.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.512 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:18:29.512 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:18:29.512 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:18:29.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:18:29.513 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:18:29.514 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "103", 2024-09-11T06:18:29.515 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 43, 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 103, 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:18:29.516 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:18:29.517 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.518 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:18:29.519 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:18:29.520 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:18:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:18:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:18:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:18:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:18:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:18:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:18:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:18:29.522 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 56, 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:18:29.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:18:29.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:18:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:18:29.528 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:18:29.529 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.6932525634765625, 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 54, 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 92, 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 92, 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 56, 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:18:29.530 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:18:29.531 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.532 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.533 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/747530186", 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/747530186", 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/747530186", 2024-09-11T06:18:29.534 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/747530186", 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:18:29.535 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 74, 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:18:29.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:18:29.538 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:18:29.539 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 720689704 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/720689704", 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/720689704", 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/720689704", 2024-09-11T06:18:29.540 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/720689704", 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:18:29.541 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 92, 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:18:29.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:18:29.545 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:18:29.546 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 92, 2024-09-11T06:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:18:29.548 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:18:29.552 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:18:29.553 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 95, 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:18:29.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:18:29.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:18:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:18:29.558 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 74, 2024-09-11T06:18:29.559 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:18:29.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:18:29.563 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.019287109375, 2024-09-11T06:18:29.564 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 43, 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:18:29.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:18:29.569 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:18:29.570 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 56 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:18:29.572 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:18:29.573 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:18:29.575 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.f", 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: 7, 2024-09-11T06:18:29.576 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.12", 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 3, 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 4 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:18:29.578 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 18, 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.579 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 20, 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 22, 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 24, 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 26, 2024-09-11T06:18:29.580 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 28, 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 30, 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 32, 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 34, 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 36, 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 38, 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 40, 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 42, 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:18:29.583 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:18:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:18:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:18:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:18:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:18:29.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.584 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:29.586 INFO:tasks.thrashosds.thrasher:j is {'epoch': 103, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:18:29.389180+0000', 'last_up_change': '2024-09-11T06:18:18.325942+0000', 'last_in_change': '2024-09-11T06:16:42.356322+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 43, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 56, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6932525634765625, 'last_clean_begin': 15, 'last_clean_end': 54, 'up_from': 92, 'up_thru': 92, 'down_at': 56, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 747530186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 747530186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 747530186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 747530186}]}, 'public_addr': '172.21.15.70:6817/747530186', 'cluster_addr': '172.21.15.70:6819/747530186', 'heartbeat_back_addr': '172.21.15.70:6823/747530186', 'heartbeat_front_addr': '172.21.15.70:6821/747530186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 720689704}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 720689704}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 720689704}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 720689704}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 720689704}]}, 'public_addr': '172.21.15.70:6809/720689704', 'cluster_addr': '172.21.15.70:6811/720689704', 'heartbeat_back_addr': '172.21.15.70:6815/720689704', 'heartbeat_front_addr': '172.21.15.70:6813/720689704', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 92, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 92, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 95, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.019287109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 43, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 56}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.f', 'osds': [7, 2]}], 'pg_upmap_items': [{'pgid': '3.12', 'mappings': [{'from': 3, 'to': 4}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 18, 'length': 1}, {'begin': 20, 'length': 1}, {'begin': 22, 'length': 1}, {'begin': 24, 'length': 1}, {'begin': 26, 'length': 1}, {'begin': 28, 'length': 1}, {'begin': 30, 'length': 1}, {'begin': 32, 'length': 1}, {'begin': 34, 'length': 1}, {'begin': 36, 'length': 1}, {'begin': 38, 'length': 1}, {'begin': 40, 'length': 1}, {'begin': 42, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:18:29.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:18:29.588 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:29.588+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:29.688 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:29.687+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:29.691 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:29.691 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:29.691 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:29.691 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:29.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:29.789 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:29.788+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:29.805 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:29.806 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:29.806 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:29.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:29.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:29.890+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:29.921 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 90.299849127000002, 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:29.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:29.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:29.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.928 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 90.005413548999996, 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:29.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7388503550000003, 2024-09-11T06:18:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:18:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63573 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 61440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182788+0000", 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7366910749999995, 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051903875000000002, 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63573 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182788+0000", 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182788+0000", 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182788+0000", 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5499999999999998e-07 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182790+0000", 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9989999999999998e-06 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182796+0000", 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.643e-06 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182800+0000", 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3229999999999999e-06 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.233775+0000", 2024-09-11T06:18:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.050974797000000002 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.234109+0000", 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00033460599999999999 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.234691+0000", 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000582052 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63574 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182806+0000", 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7366729059999999, 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052195775999999999, 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63574 2024-09-11T06:18:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182806+0000", 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182806+0000", 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182806+0000", 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182808+0000", 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8950000000000001e-06 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182814+0000", 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.784e-06 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182818+0000", 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2429999999999999e-06 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.234750+0000", 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931746000000001 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.234851+0000", 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101266 2024-09-11T06:18:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235001+0000", 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015048700000000001 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63575 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 172032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182823+0000", 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7366552679999998, 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052927758999999998, 2024-09-11T06:18:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63575 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182823+0000", 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182823+0000", 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182824+0000", 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182825+0000", 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7740000000000001e-06 2024-09-11T06:18:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182831+0000", 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182837+0000", 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5079999999999996e-06 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235035+0000", 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05219845 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235134+0000", 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8868000000000003e-05 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235751+0000", 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061721499999999995 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63576 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7366365899999998, 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053575987999999998, 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63576 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182844+0000", 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182850+0000", 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9970000000000004e-06 2024-09-11T06:18:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182854+0000", 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1829999999999996e-06 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235811+0000", 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052956403999999999 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235933+0000", 2024-09-11T06:18:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012229799999999999 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236418+0000", 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048509399999999999 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63577 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7366176700000002, 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053525649000000002, 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63577 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.22e-07 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182863+0000", 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9e-06 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182876+0000", 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.311e-05 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182887+0000", 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1109e-05 2024-09-11T06:18:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236375+0000", 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053487499000000001 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236387+0000", 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1708999999999999e-05 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63578 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7365741630000002, 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053516941999999998, 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63578 2024-09-11T06:18:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182905+0000", 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182908+0000", 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6249999999999999e-06 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182915+0000", 2024-09-11T06:18:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.525e-06 2024-09-11T06:18:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182921+0000", 2024-09-11T06:18:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.48e-06 2024-09-11T06:18:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236412+0000", 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053491483999999999 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236421+0000", 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63579 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7365016310000003, 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053483819000000002, 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63579 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182978+0000", 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.99e-07 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182980+0000", 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182988+0000", 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182995+0000", 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0129999999999996e-06 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236448+0000", 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053452983000000003 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236461+0000", 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2865e-05 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63580 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7364751529999998, 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053488579000000001, 2024-09-11T06:18:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63580 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183004+0000", 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183006+0000", 2024-09-11T06:18:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0650000000000001e-06 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183013+0000", 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183018+0000", 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236482+0000", 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053463869999999997 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236492+0000", 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0471e-05 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63599 3.9 3.3cb87fc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.184409+0000", 2024-09-11T06:18:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7350697779999997, 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052129752000000001, 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63599 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184409+0000", 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184409+0000", 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184410+0000", 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3099999999999996e-07 2024-09-11T06:18:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184414+0000", 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5700000000000003e-06 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184423+0000", 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4039999999999995e-06 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184429+0000", 2024-09-11T06:18:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236527+0000", 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052097301999999998 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236539+0000", 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878999999999999e-05 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63600 3.9 3.3cb87fc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.184442+0000", 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7350367760000003, 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052128345999999999, 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63600 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184442+0000", 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184442+0000", 2024-09-11T06:18:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184442+0000", 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3600000000000004e-07 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184445+0000", 2024-09-11T06:18:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7369999999999998e-06 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184452+0000", 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.686e-06 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184457+0000", 2024-09-11T06:18:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9239999999999998e-06 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236559+0000", 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052102087999999998 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236570+0000", 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1375e-05 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63601 3.9 3.3cb87fc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.184465+0000", 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7350137199999995, 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052149283999999997, 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63601 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184465+0000", 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184465+0000", 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184465+0000", 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5999999999999999e-07 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184468+0000", 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2620000000000001e-06 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184474+0000", 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3119999999999999e-06 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184479+0000", 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7570000000000004e-06 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236601+0000", 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05212224 2024-09-11T06:18:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236614+0000", 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3253e-05 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63602 3.9 3.3cb87fc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.184494+0000", 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7349847040000004, 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052171578000000003, 2024-09-11T06:18:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63602 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184494+0000", 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184494+0000", 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184494+0000", 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3300000000000002e-07 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184496+0000", 2024-09-11T06:18:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7239999999999999e-06 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184501+0000", 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5090000000000004e-06 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184504+0000", 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0259999999999999e-06 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236653+0000", 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052149775000000002 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236665+0000", 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2011000000000001e-05 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63603 3.9 3.3cb87fc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.184508+0000", 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7349707609999996, 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052187288999999998, 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63603 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184508+0000", 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184508+0000", 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184508+0000", 2024-09-11T06:18:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184509+0000", 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.15e-06 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184512+0000", 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9900000000000002e-06 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184515+0000", 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236685+0000", 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052170126999999997 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236695+0000", 2024-09-11T06:18:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0161e-05 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63604 3.9 3.3cb87fc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.184518+0000", 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7349608889999999, 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052211015999999999, 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63604 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184518+0000", 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184518+0000", 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184518+0000", 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184519+0000", 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0270000000000001e-06 2024-09-11T06:18:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184522+0000", 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9000000000000002e-06 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184528+0000", 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9540000000000001e-06 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236717+0000", 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052188817999999998 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236729+0000", 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2105e-05 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63605 3.9 3.3cb87fc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.184532+0000", 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7349464970000001, 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052225893000000002, 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63605 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184532+0000", 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184532+0000", 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184532+0000", 2024-09-11T06:18:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184534+0000", 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.849e-06 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184540+0000", 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5650000000000001e-06 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184544+0000", 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2570000000000001e-06 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236748+0000", 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052203871999999998 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236758+0000", 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0025e-05 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63606 3.9 3.3cb87fc9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.184550+0000", 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7349282270000002, 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052238113000000003, 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63606 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184550+0000", 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184550+0000", 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184551+0000", 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184553+0000", 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1069999999999999e-06 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184559+0000", 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9089999999999997e-06 2024-09-11T06:18:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.184563+0000", 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4580000000000003e-06 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236777+0000", 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052214179999999999 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236788+0000", 2024-09-11T06:18:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1107999999999999e-05 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:64321 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.241752+0000", 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6777263619999996, 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052926501000000001, 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 64321 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.241752+0000", 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.241752+0000", 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.241753+0000", 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7100000000000001e-07 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.241756+0000", 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7030000000000002e-06 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.241763+0000", 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2139999999999999e-06 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.241768+0000", 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2510000000000002e-06 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.281855+0000", 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.040086485999999998 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.281954+0000", 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9036000000000005e-05 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.294679+0000", 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012725139999999999 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:30.015 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:30.017 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:18:30.018 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:18:30.019 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-11T06:18:29.393389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1047687226,"num_objects":894,"num_object_clones":0,"num_object_copies":1788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":894,"num_whiteouts":0,"num_read":87020,"num_read_kb":882587,"num_write":12490,"num_write_kb":596807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":52803112,"num_keys_recovered":80,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7780,"ondisk_log_size":7780,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":384544,"kb_used_data":87712,"kb_used_omap":21,"kb_used_meta":296618,"kb_avail":754590176,"statfs":{"total":773094113280,"available":772700340224,"internally_reserved":0,"allocated":89817088,"data_stored":747825712,"data_compressed":19699030,"data_compressed_allocated":65335296,"data_compressed_original":730805749,"omap_allocated":21513,"internal_metadata":303737847},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":138680198,"num_objects":206,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":206,"num_whiteouts":0,"num_read":24938,"num_read_kb":109754,"num_write":1022,"num_write_kb":78891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.295470"},"pg_stats":[{"pgid":"3.1f","version":"100'176","reported_seq":2230,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.373030+0000","last_change":"2024-09-11T06:18:23.496602+0000","last_active":"2024-09-11T06:18:26.373030+0000","last_peered":"2024-09-11T06:18:26.373030+0000","last_clean":"2024-09-11T06:18:26.373030+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:18:26.373030+0000","last_undegraded":"2024-09-11T06:18:26.373030+0000","last_fullsized":"2024-09-11T06:18:26.373030+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:38.326698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010885549999999999,"stat_sum":{"num_bytes":44881177,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1942,"num_read_kb":18975,"num_write":338,"num_write_kb":20744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1e","version":"99'252","reported_seq":2106,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372856+0000","last_change":"2024-09-11T06:18:23.495924+0000","last_active":"2024-09-11T06:18:26.372856+0000","last_peered":"2024-09-11T06:18:26.372856+0000","last_clean":"2024-09-11T06:18:26.372856+0000","last_became_active":"2024-09-11T06:17:09.686913+0000","last_became_peered":"2024-09-11T06:17:09.686913+0000","last_unstale":"2024-09-11T06:18:26.372856+0000","last_undegraded":"2024-09-11T06:18:26.372856+0000","last_fullsized":"2024-09-11T06:18:26.372856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:27:17.806895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000586941,"stat_sum":{"num_bytes":11261782,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2385,"num_read_kb":9514,"num_write":446,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1d","version":"101'322","reported_seq":4151,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.387445+0000","last_change":"2024-09-11T06:18:27.387445+0000","last_active":"2024-09-11T06:18:27.387445+0000","last_peered":"2024-09-11T06:18:27.387445+0000","last_clean":"2024-09-11T06:18:27.387445+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:18:27.387445+0000","last_undegraded":"2024-09-11T06:18:27.387445+0000","last_fullsized":"2024-09-11T06:18:27.387445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:01.236738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014999309999999999,"stat_sum":{"num_bytes":83451094,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4668,"num_read_kb":69943,"num_write":592,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.1c","version":"99'126","reported_seq":1940,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.419901+0000","last_change":"2024-09-11T06:18:23.502303+0000","last_active":"2024-09-11T06:18:26.419901+0000","last_peered":"2024-09-11T06:18:26.419901+0000","last_clean":"2024-09-11T06:18:26.419901+0000","last_became_active":"2024-09-11T06:18:19.335163+0000","last_became_peered":"2024-09-11T06:18:19.335163+0000","last_unstale":"2024-09-11T06:18:26.419901+0000","last_undegraded":"2024-09-11T06:18:26.419901+0000","last_fullsized":"2024-09-11T06:18:26.419901+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:51.752308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066701599999999998,"stat_sum":{"num_bytes":29876572,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2070,"num_read_kb":14320,"num_write":225,"num_write_kb":10502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1622976,"num_keys_recovered":38,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.1b","version":"99'303","reported_seq":1988,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384854+0000","last_change":"2024-09-11T06:18:27.385064+0000","last_active":"2024-09-11T06:18:27.384854+0000","last_peered":"2024-09-11T06:18:27.384854+0000","last_clean":"2024-09-11T06:18:27.384854+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:18:27.384854+0000","last_undegraded":"2024-09-11T06:18:27.384854+0000","last_fullsized":"2024-09-11T06:18:27.384854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:28.681644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049185500000000003,"stat_sum":{"num_bytes":27264127,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2254,"num_read_kb":28111,"num_write":494,"num_write_kb":19239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.1a","version":"99'234","reported_seq":3374,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.457176+0000","last_change":"2024-09-11T06:18:23.495930+0000","last_active":"2024-09-11T06:18:26.457176+0000","last_peered":"2024-09-11T06:18:26.457176+0000","last_clean":"2024-09-11T06:18:26.457176+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:18:26.457176+0000","last_undegraded":"2024-09-11T06:18:26.457176+0000","last_fullsized":"2024-09-11T06:18:26.457176+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:15.532544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060037600000000001,"stat_sum":{"num_bytes":35087594,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3349,"num_read_kb":42453,"num_write":289,"num_write_kb":22333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.19","version":"100'207","reported_seq":2420,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385432+0000","last_change":"2024-09-11T06:18:27.385639+0000","last_active":"2024-09-11T06:18:27.385432+0000","last_peered":"2024-09-11T06:18:27.385432+0000","last_clean":"2024-09-11T06:18:27.385432+0000","last_became_active":"2024-09-11T06:18:19.336396+0000","last_became_peered":"2024-09-11T06:18:19.336396+0000","last_unstale":"2024-09-11T06:18:27.385432+0000","last_undegraded":"2024-09-11T06:18:27.385432+0000","last_fullsized":"2024-09-11T06:18:27.385432+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:40:27.491302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092286600000000005,"stat_sum":{"num_bytes":22480997,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2463,"num_read_kb":20562,"num_write":295,"num_write_kb":12336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2873672,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.18","version":"100'721","reported_seq":3205,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.452643+0000","last_change":"2024-09-11T06:18:23.496287+0000","last_active":"2024-09-11T06:18:26.452643+0000","last_peered":"2024-09-11T06:18:26.452643+0000","last_clean":"2024-09-11T06:18:26.452643+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:18:26.452643+0000","last_undegraded":"2024-09-11T06:18:26.452643+0000","last_fullsized":"2024-09-11T06:18:26.452643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:16:40.123111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086039500000000002,"stat_sum":{"num_bytes":25286142,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5301,"num_read_kb":19317,"num_write":1207,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.17","version":"100'129","reported_seq":2768,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.419011+0000","last_change":"2024-09-11T06:18:23.496526+0000","last_active":"2024-09-11T06:18:26.419011+0000","last_peered":"2024-09-11T06:18:26.419011+0000","last_clean":"2024-09-11T06:18:26.419011+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:18:26.419011+0000","last_undegraded":"2024-09-11T06:18:26.419011+0000","last_fullsized":"2024-09-11T06:18:26.419011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:59.890241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010661889999999999,"stat_sum":{"num_bytes":39314549,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2339,"num_read_kb":23409,"num_write":216,"num_write_kb":11665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.16","version":"99'200","reported_seq":2066,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.393207+0000","last_change":"2024-09-11T06:18:27.393492+0000","last_active":"2024-09-11T06:18:27.393207+0000","last_peered":"2024-09-11T06:18:27.393207+0000","last_clean":"2024-09-11T06:18:27.393207+0000","last_became_active":"2024-09-11T06:17:09.686021+0000","last_became_peered":"2024-09-11T06:17:09.686021+0000","last_unstale":"2024-09-11T06:18:27.393207+0000","last_undegraded":"2024-09-11T06:18:27.393207+0000","last_fullsized":"2024-09-11T06:18:27.393207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:36.992386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070350700000000003,"stat_sum":{"num_bytes":25083082,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2131,"num_read_kb":23019,"num_write":295,"num_write_kb":18371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.15","version":"99'181","reported_seq":2286,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.391192+0000","last_change":"2024-09-11T06:18:27.391621+0000","last_active":"2024-09-11T06:18:27.391192+0000","last_peered":"2024-09-11T06:18:27.391192+0000","last_clean":"2024-09-11T06:18:27.391192+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:18:27.391192+0000","last_undegraded":"2024-09-11T06:18:27.391192+0000","last_fullsized":"2024-09-11T06:18:27.391192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:11.189983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017611529999999999,"stat_sum":{"num_bytes":28672271,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1940,"num_read_kb":29935,"num_write":286,"num_write_kb":29287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.14","version":"99'102","reported_seq":2755,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385685+0000","last_change":"2024-09-11T06:18:27.386340+0000","last_active":"2024-09-11T06:18:27.385685+0000","last_peered":"2024-09-11T06:18:27.385685+0000","last_clean":"2024-09-11T06:18:27.385685+0000","last_became_active":"2024-09-11T06:17:09.682654+0000","last_became_peered":"2024-09-11T06:17:09.682654+0000","last_unstale":"2024-09-11T06:18:27.385685+0000","last_undegraded":"2024-09-11T06:18:27.385685+0000","last_fullsized":"2024-09-11T06:18:27.385685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:18.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013973080000000001,"stat_sum":{"num_bytes":52734446,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2394,"num_read_kb":53471,"num_write":191,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385261+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:18:27.385261+0000","last_peered":"2024-09-11T06:18:27.385261+0000","last_clean":"2024-09-11T06:18:27.385261+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:18:27.385261+0000","last_undegraded":"2024-09-11T06:18:27.385261+0000","last_fullsized":"2024-09-11T06:18:27.385261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"99'136","reported_seq":2994,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385220+0000","last_change":"2024-09-11T06:18:27.385449+0000","last_active":"2024-09-11T06:18:27.385220+0000","last_peered":"2024-09-11T06:18:27.385220+0000","last_clean":"2024-09-11T06:18:27.385220+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:18:27.385220+0000","last_undegraded":"2024-09-11T06:18:27.385220+0000","last_fullsized":"2024-09-11T06:18:27.385220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:29.145094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087526599999999998,"stat_sum":{"num_bytes":37505167,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2551,"num_read_kb":36826,"num_write":254,"num_write_kb":22788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384564+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:18:27.384564+0000","last_peered":"2024-09-11T06:18:27.384564+0000","last_clean":"2024-09-11T06:18:27.384564+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:18:27.384564+0000","last_undegraded":"2024-09-11T06:18:27.384564+0000","last_fullsized":"2024-09-11T06:18:27.384564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"99'128","reported_seq":1775,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385143+0000","last_change":"2024-09-11T06:18:27.385356+0000","last_active":"2024-09-11T06:18:27.385143+0000","last_peered":"2024-09-11T06:18:27.385143+0000","last_clean":"2024-09-11T06:18:27.385143+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:18:27.385143+0000","last_undegraded":"2024-09-11T06:18:27.385143+0000","last_fullsized":"2024-09-11T06:18:27.385143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:10:18.926263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000678124,"stat_sum":{"num_bytes":26498254,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1463,"num_read_kb":23134,"num_write":192,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385860+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:18:27.385860+0000","last_peered":"2024-09-11T06:18:27.385860+0000","last_clean":"2024-09-11T06:18:27.385860+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:18:27.385860+0000","last_undegraded":"2024-09-11T06:18:27.385860+0000","last_fullsized":"2024-09-11T06:18:27.385860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"100'350","reported_seq":3293,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.430183+0000","last_change":"2024-09-11T06:18:23.361137+0000","last_active":"2024-09-11T06:18:26.430183+0000","last_peered":"2024-09-11T06:18:26.430183+0000","last_clean":"2024-09-11T06:18:26.430183+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:18:26.430183+0000","last_undegraded":"2024-09-11T06:18:26.430183+0000","last_fullsized":"2024-09-11T06:18:26.430183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:55:02.843476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058890899999999998,"stat_sum":{"num_bytes":37392643,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":3683,"num_read_kb":47772,"num_write":676,"num_write_kb":25705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372902+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:18:26.372902+0000","last_peered":"2024-09-11T06:18:26.372902+0000","last_clean":"2024-09-11T06:18:26.372902+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:18:26.372902+0000","last_undegraded":"2024-09-11T06:18:26.372902+0000","last_fullsized":"2024-09-11T06:18:26.372902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"100'298","reported_seq":2845,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.392825+0000","last_change":"2024-09-11T06:18:27.393111+0000","last_active":"2024-09-11T06:18:27.392825+0000","last_peered":"2024-09-11T06:18:27.392825+0000","last_clean":"2024-09-11T06:18:27.392825+0000","last_became_active":"2024-09-11T06:17:09.680887+0000","last_became_peered":"2024-09-11T06:17:09.680887+0000","last_unstale":"2024-09-11T06:18:27.392825+0000","last_undegraded":"2024-09-11T06:18:27.392825+0000","last_fullsized":"2024-09-11T06:18:27.392825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:49.505140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052785199999999999,"stat_sum":{"num_bytes":21809112,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3489,"num_read_kb":21655,"num_write":397,"num_write_kb":9118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.3","version":"101'420","reported_seq":3704,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.399433+0000","last_change":"2024-09-11T06:18:27.391505+0000","last_active":"2024-09-11T06:18:27.399433+0000","last_peered":"2024-09-11T06:18:27.399433+0000","last_clean":"2024-09-11T06:18:27.399433+0000","last_became_active":"2024-09-11T06:17:09.676881+0000","last_became_peered":"2024-09-11T06:17:09.676881+0000","last_unstale":"2024-09-11T06:18:27.399433+0000","last_undegraded":"2024-09-11T06:18:27.399433+0000","last_fullsized":"2024-09-11T06:18:27.399433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:47.187158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001738493,"stat_sum":{"num_bytes":41647280,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5308,"num_read_kb":27788,"num_write":540,"num_write_kb":21253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":179,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385475+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:18:27.385475+0000","last_peered":"2024-09-11T06:18:27.385475+0000","last_clean":"2024-09-11T06:18:27.385475+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:18:27.385475+0000","last_undegraded":"2024-09-11T06:18:27.385475+0000","last_fullsized":"2024-09-11T06:18:27.385475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"99'245","reported_seq":2173,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.418642+0000","last_change":"2024-09-11T06:18:23.496212+0000","last_active":"2024-09-11T06:18:26.418642+0000","last_peered":"2024-09-11T06:18:26.418642+0000","last_clean":"2024-09-11T06:18:26.418642+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:18:26.418642+0000","last_undegraded":"2024-09-11T06:18:26.418642+0000","last_fullsized":"2024-09-11T06:18:26.418642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:16:44.678122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093509300000000001,"stat_sum":{"num_bytes":22197462,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2303,"num_read_kb":21492,"num_write":457,"num_write_kb":20828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.372840+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:18:26.372840+0000","last_peered":"2024-09-11T06:18:26.372840+0000","last_clean":"2024-09-11T06:18:26.372840+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:18:26.372840+0000","last_undegraded":"2024-09-11T06:18:26.372840+0000","last_fullsized":"2024-09-11T06:18:26.372840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'360","reported_seq":1569,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380057+0000","last_change":"2024-09-11T06:18:23.360858+0000","last_active":"2024-09-11T06:18:26.380057+0000","last_peered":"2024-09-11T06:18:26.380057+0000","last_clean":"2024-09-11T06:18:26.380057+0000","last_became_active":"2024-09-11T06:17:09.679986+0000","last_became_peered":"2024-09-11T06:17:09.679986+0000","last_unstale":"2024-09-11T06:18:26.380057+0000","last_undegraded":"2024-09-11T06:18:26.380057+0000","last_fullsized":"2024-09-11T06:18:26.380057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:31.341940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041977699999999998,"stat_sum":{"num_bytes":20209097,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2310,"num_read_kb":16744,"num_write":644,"num_write_kb":16894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":177,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384670+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:18:27.384670+0000","last_peered":"2024-09-11T06:18:27.384670+0000","last_clean":"2024-09-11T06:18:27.384670+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:18:27.384670+0000","last_undegraded":"2024-09-11T06:18:27.384670+0000","last_fullsized":"2024-09-11T06:18:27.384670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"99'187","reported_seq":2030,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385510+0000","last_change":"2024-09-11T06:18:27.385753+0000","last_active":"2024-09-11T06:18:27.385510+0000","last_peered":"2024-09-11T06:18:27.385510+0000","last_clean":"2024-09-11T06:18:27.385510+0000","last_became_active":"2024-09-11T06:17:09.675683+0000","last_became_peered":"2024-09-11T06:17:09.675683+0000","last_unstale":"2024-09-11T06:18:27.385510+0000","last_undegraded":"2024-09-11T06:18:27.385510+0000","last_fullsized":"2024-09-11T06:18:27.385510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:09:58.234973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098683899999999999,"stat_sum":{"num_bytes":19072157,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2057,"num_read_kb":14812,"num_write":341,"num_write_kb":14039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":178,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385014+0000","last_change":"2024-09-11T06:17:01.627558+0000","last_active":"2024-09-11T06:18:27.385014+0000","last_peered":"2024-09-11T06:18:27.385014+0000","last_clean":"2024-09-11T06:18:27.385014+0000","last_became_active":"2024-09-11T06:16:59.909769+0000","last_became_peered":"2024-09-11T06:16:59.909769+0000","last_unstale":"2024-09-11T06:18:27.385014+0000","last_undegraded":"2024-09-11T06:18:27.385014+0000","last_fullsized":"2024-09-11T06:18:27.385014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:37.567832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.375773+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:18:26.375773+0000","last_peered":"2024-09-11T06:18:26.375773+0000","last_clean":"2024-09-11T06:18:26.375773+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:18:26.375773+0000","last_undegraded":"2024-09-11T06:18:26.375773+0000","last_fullsized":"2024-09-11T06:18:26.375773+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"99'235","reported_seq":3457,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.384780+0000","last_change":"2024-09-11T06:18:27.385041+0000","last_active":"2024-09-11T06:18:27.384780+0000","last_peered":"2024-09-11T06:18:27.384780+0000","last_clean":"2024-09-11T06:18:27.384780+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:18:27.384780+0000","last_undegraded":"2024-09-11T06:18:27.384780+0000","last_fullsized":"2024-09-11T06:18:27.384780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:57.242706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049313999999999998,"stat_sum":{"num_bytes":28727681,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4175,"num_read_kb":27586,"num_write":299,"num_write_kb":17443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.9","version":"99'165","reported_seq":3874,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386501+0000","last_change":"2024-09-11T06:18:27.386820+0000","last_active":"2024-09-11T06:18:27.386501+0000","last_peered":"2024-09-11T06:18:27.386501+0000","last_clean":"2024-09-11T06:18:27.386501+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:18:27.386501+0000","last_undegraded":"2024-09-11T06:18:27.386501+0000","last_fullsized":"2024-09-11T06:18:27.386501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:52:55.546850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001531075,"stat_sum":{"num_bytes":56440272,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":3541,"num_read_kb":35693,"num_write":316,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.a","version":"99'130","reported_seq":2395,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385862+0000","last_change":"2024-09-11T06:18:27.386142+0000","last_active":"2024-09-11T06:18:27.385862+0000","last_peered":"2024-09-11T06:18:27.385862+0000","last_clean":"2024-09-11T06:18:27.385862+0000","last_became_active":"2024-09-11T06:18:19.333935+0000","last_became_peered":"2024-09-11T06:18:19.333935+0000","last_unstale":"2024-09-11T06:18:27.385862+0000","last_undegraded":"2024-09-11T06:18:27.385862+0000","last_fullsized":"2024-09-11T06:18:27.385862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:22:54.422206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011792829999999999,"stat_sum":{"num_bytes":36823159,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2070,"num_read_kb":27820,"num_write":183,"num_write_kb":14811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":9995151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.b","version":"99'335","reported_seq":1764,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380090+0000","last_change":"2024-09-11T06:18:23.360901+0000","last_active":"2024-09-11T06:18:26.380090+0000","last_peered":"2024-09-11T06:18:26.380090+0000","last_clean":"2024-09-11T06:18:26.380090+0000","last_became_active":"2024-09-11T06:18:01.255735+0000","last_became_peered":"2024-09-11T06:18:01.255735+0000","last_unstale":"2024-09-11T06:18:26.380090+0000","last_undegraded":"2024-09-11T06:18:26.380090+0000","last_fullsized":"2024-09-11T06:18:26.380090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:34:11.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044582600000000002,"stat_sum":{"num_bytes":21374640,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2268,"num_read_kb":11408,"num_write":642,"num_write_kb":17866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.c","version":"99'238","reported_seq":1968,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.389953+0000","last_change":"2024-09-11T06:18:27.390192+0000","last_active":"2024-09-11T06:18:27.389953+0000","last_peered":"2024-09-11T06:18:27.389953+0000","last_clean":"2024-09-11T06:18:27.389953+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:18:27.389953+0000","last_undegraded":"2024-09-11T06:18:27.389953+0000","last_fullsized":"2024-09-11T06:18:27.389953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:52:59.330035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050497599999999997,"stat_sum":{"num_bytes":16242923,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2067,"num_read_kb":12848,"num_write":333,"num_write_kb":9186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.d","version":"99'335","reported_seq":2117,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386862+0000","last_change":"2024-09-11T06:18:27.387227+0000","last_active":"2024-09-11T06:18:27.386862+0000","last_peered":"2024-09-11T06:18:27.386862+0000","last_clean":"2024-09-11T06:18:27.386862+0000","last_became_active":"2024-09-11T06:18:19.334462+0000","last_became_peered":"2024-09-11T06:18:19.334462+0000","last_unstale":"2024-09-11T06:18:27.386862+0000","last_undegraded":"2024-09-11T06:18:27.386862+0000","last_fullsized":"2024-09-11T06:18:27.386862+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:13.705578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001614437,"stat_sum":{"num_bytes":29654434,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2563,"num_read_kb":26732,"num_write":629,"num_write_kb":17828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":7078861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.e","version":"99'165","reported_seq":2028,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.392969+0000","last_change":"2024-09-11T06:18:27.393223+0000","last_active":"2024-09-11T06:18:27.392969+0000","last_peered":"2024-09-11T06:18:27.392969+0000","last_clean":"2024-09-11T06:18:27.392969+0000","last_became_active":"2024-09-11T06:17:09.679886+0000","last_became_peered":"2024-09-11T06:17:09.679886+0000","last_unstale":"2024-09-11T06:18:27.392969+0000","last_undegraded":"2024-09-11T06:18:27.392969+0000","last_fullsized":"2024-09-11T06:18:27.392969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:39:27.216431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048662400000000001,"stat_sum":{"num_bytes":27263312,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1840,"num_read_kb":33338,"num_write":237,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.f","version":"100'227","reported_seq":2818,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.393579+0000","last_change":"2024-09-11T06:18:27.394144+0000","last_active":"2024-09-11T06:18:27.393579+0000","last_peered":"2024-09-11T06:18:27.393579+0000","last_clean":"2024-09-11T06:18:27.393579+0000","last_became_active":"2024-09-11T06:18:01.252680+0000","last_became_peered":"2024-09-11T06:18:01.252680+0000","last_unstale":"2024-09-11T06:18:27.393579+0000","last_undegraded":"2024-09-11T06:18:27.393579+0000","last_fullsized":"2024-09-11T06:18:27.393579+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.626649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089326800000000001,"stat_sum":{"num_bytes":31838446,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3541,"num_read_kb":26313,"num_write":271,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":16758,"num_keys_recovered":9,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.10","version":"99'186","reported_seq":1941,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.418229+0000","last_change":"2024-09-11T06:18:23.502133+0000","last_active":"2024-09-11T06:18:26.418229+0000","last_peered":"2024-09-11T06:18:26.418229+0000","last_clean":"2024-09-11T06:18:26.418229+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:18:26.418229+0000","last_undegraded":"2024-09-11T06:18:26.418229+0000","last_fullsized":"2024-09-11T06:18:26.418229+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:42.078082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000533038,"stat_sum":{"num_bytes":44386499,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3069,"num_read_kb":33308,"num_write":204,"num_write_kb":22006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.11","version":"99'242","reported_seq":2510,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.386416+0000","last_change":"2024-09-11T06:18:27.386708+0000","last_active":"2024-09-11T06:18:27.386416+0000","last_peered":"2024-09-11T06:18:27.386416+0000","last_clean":"2024-09-11T06:18:27.386416+0000","last_became_active":"2024-09-11T06:17:09.683890+0000","last_became_peered":"2024-09-11T06:17:09.683890+0000","last_unstale":"2024-09-11T06:18:27.386416+0000","last_undegraded":"2024-09-11T06:18:27.386416+0000","last_fullsized":"2024-09-11T06:18:27.386416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:25:41.492747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015193590000000001,"stat_sum":{"num_bytes":37225963,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2623,"num_read_kb":36590,"num_write":297,"num_write_kb":20772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]},{"pgid":"3.12","version":"100'112","reported_seq":1498,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T06:18:26.380142+0000","last_change":"2024-09-11T06:18:23.361110+0000","last_active":"2024-09-11T06:18:26.380142+0000","last_peered":"2024-09-11T06:18:26.380142+0000","last_clean":"2024-09-11T06:18:26.380142+0000","last_became_active":"2024-09-11T06:17:37.166037+0000","last_became_peered":"2024-09-11T06:17:37.166037+0000","last_unstale":"2024-09-11T06:18:26.380142+0000","last_undegraded":"2024-09-11T06:18:26.380142+0000","last_fullsized":"2024-09-11T06:18:26.380142+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:47:56.795805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038180000000000001,"stat_sum":{"num_bytes":21414457,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1047,"num_read_kb":18934,"num_write":210,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":771314,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"}]},{"pgid":"3.13","version":"100'213","reported_seq":1990,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T06:18:27.385443+0000","last_change":"2024-09-11T06:18:27.385729+0000","last_active":"2024-09-11T06:18:27.385443+0000","last_peered":"2024-09-11T06:18:27.385443+0000","last_clean":"2024-09-11T06:18:27.385443+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:18:27.385443+0000","last_undegraded":"2024-09-11T06:18:27.385443+0000","last_fullsized":"2024-09-11T06:18:27.385443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:00.847669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082069100000000002,"stat_sum":{"num_bytes":43980048,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1700,"num_read_kb":28665,"num_write":333,"num_write_kb":21073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"16","length":"1"},{"start":"18","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"20","length":"1"},{"start":"22","length":"1"},{"start":"24","length":"1"},{"start":"26","length":"1"},{"start":"28","length":"1"},{"start":"2a","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1047096839,"num_objects":890,"num_object_clones":0,"num_object_copies":1780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":890,"num_whiteouts":0,"num_read":86904,"num_read_kb":882487,"num_write":12329,"num_write_kb":594389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":52803112,"num_keys_recovered":80,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81367040,"data_stored":750323464,"data_compressed":19757640,"data_compressed_allocated":65990656,"data_compressed_original":737486325,"omap_allocated":8763,"internal_metadata":0},"log_size":7660,"ondisk_log_size":7660,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50704,"kb_used_data":11196,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321136,"statfs":{"total":96636764160,"available":96584843264,"internally_reserved":0,"allocated":11464704,"data_stored":92911083,"data_compressed":2645399,"data_compressed_allocated":8454144,"data_compressed_original":90818948,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45408,"kb_used_data":10056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326432,"statfs":{"total":96636764160,"available":96590266368,"internally_reserved":0,"allocated":10297344,"data_stored":87430376,"data_compressed":2002696,"data_compressed_allocated":7389184,"data_compressed_original":85429560,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":15768,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":16146432,"data_stored":138293085,"data_compressed":3819832,"data_compressed_allocated":12181504,"data_compressed_original":135390867,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53100,"kb_used_data":13584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318740,"statfs":{"total":96636764160,"available":96582389760,"internally_reserved":0,"allocated":13910016,"data_stored":118647104,"data_compressed":3281321,"data_compressed_allocated":10502144,"data_compressed_original":116242059,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991235,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38184,"kb_used_data":9620,"kb_used_omap":10,"kb_used_meta":28533,"kb_avail":94333656,"statfs":{"total":96636764160,"available":96597663744,"internally_reserved":0,"allocated":9850880,"data_stored":84442728,"data_compressed":2097654,"data_compressed_allocated":7241728,"data_compressed_original":82680105,"omap_allocated":10357,"internal_metadata":29218699},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":12048,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":12337152,"data_stored":105684662,"data_compressed":2579940,"data_compressed_allocated":8982528,"data_compressed_original":103333354,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48756,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323084,"statfs":{"total":96636764160,"available":96586838016,"internally_reserved":0,"allocated":9474048,"data_stored":77242448,"data_compressed":2000363,"data_compressed_allocated":6692864,"data_compressed_original":75334161,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41548,"kb_used_data":6188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330292,"statfs":{"total":96636764160,"available":96594219008,"internally_reserved":0,"allocated":6336512,"data_stored":43174226,"data_compressed":1271825,"data_compressed_allocated":3891200,"data_compressed_original":41576695,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11157504,"data_stored":105122311,"data_compressed":2579940,"data_compressed_allocated":8982528,"data_compressed_original":103333354,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8613888,"data_stored":83290009,"data_compressed":2088985,"data_compressed_allocated":7204864,"data_compressed_original":82106665,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12730368,"data_stored":118084753,"data_compressed":3281321,"data_compressed_allocated":10502144,"data_compressed_original":116242059,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14962688,"data_stored":137730715,"data_compressed":3819832,"data_compressed_allocated":12181504,"data_compressed_original":135390867,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":86861540,"data_compressed":2002696,"data_compressed_allocated":7389184,"data_compressed_original":85429560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10227712,"data_stored":91758364,"data_compressed":2636730,"data_compressed_allocated":8417280,"data_compressed_original":90245508,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9306112,"data_stored":84773143,"data_compressed":2076212,"data_compressed_allocated":7417856,"data_compressed_original":83145233,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5263360,"data_stored":42702629,"data_compressed":1271924,"data_compressed_allocated":3895296,"data_compressed_original":41593079,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:18:30.022 INFO:tasks.thrashosds.thrasher:Setting 1.0 to [6, 5, 3, 1] 2024-09-11T06:18:30.023 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '1.0', '6', '5', '3', '1'] 2024-09-11T06:18:30.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 1.0 6 5 3 1 2024-09-11T06:18:30.023 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:30.016+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:30.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:30.099 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:18:30.116 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:30.115+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:30.158 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:30.159 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:30.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90590 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143268+0000", 2024-09-11T06:18:30.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011979027999999999, 2024-09-11T06:18:30.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012007347999999999, 2024-09-11T06:18:30.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.160 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90590 2024-09-11T06:18:30.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.161 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143268+0000", 2024-09-11T06:18:30.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143268+0000", 2024-09-11T06:18:30.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143268+0000", 2024-09-11T06:18:30.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4400000000000001e-07 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143269+0000", 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143273+0000", 2024-09-11T06:18:30.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0300000000000004e-06 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143276+0000", 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7070000000000001e-06 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90591 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143285+0000", 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.01196211, 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012081550999999999, 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90591 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143285+0000", 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143285+0000", 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143285+0000", 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143287+0000", 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4589999999999999e-06 2024-09-11T06:18:30.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143290+0000", 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.472e-06 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143293+0000", 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5189999999999999e-06 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90592 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143296+0000", 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011950975000000001, 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01211487, 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90592 2024-09-11T06:18:30.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143296+0000", 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143296+0000", 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143296+0000", 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6600000000000003e-07 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143297+0000", 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0139999999999999e-06 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143300+0000", 2024-09-11T06:18:30.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0450000000000001e-06 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143303+0000", 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.559e-06 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90593 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143305+0000", 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011941411000000001, 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01213535, 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90593 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143305+0000", 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143305+0000", 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143306+0000", 2024-09-11T06:18:30.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4699999999999998e-07 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143307+0000", 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.057e-06 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143310+0000", 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9569999999999998e-06 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143312+0000", 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.542e-06 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90594 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143315+0000", 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011931971, 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012157194, 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.177 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.178 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90594 2024-09-11T06:18:30.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.178 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143315+0000", 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143315+0000", 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143315+0000", 2024-09-11T06:18:30.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143316+0000", 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0300000000000001e-06 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143319+0000", 2024-09-11T06:18:30.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:18:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143322+0000", 2024-09-11T06:18:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3630000000000001e-06 2024-09-11T06:18:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.182 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90595 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.182 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143324+0000", 2024-09-11T06:18:30.182 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011922663999999999, 2024-09-11T06:18:30.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012202414999999999, 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90595 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143324+0000", 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143324+0000", 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143324+0000", 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4499999999999998e-07 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143326+0000", 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0279999999999999e-06 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143328+0000", 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.914e-06 2024-09-11T06:18:30.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143331+0000", 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90596 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143334+0000", 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011913329, 2024-09-11T06:18:30.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012246721, 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90596 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143334+0000", 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143334+0000", 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143334+0000", 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143335+0000", 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3900000000000003e-07 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143338+0000", 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143340+0000", 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5900000000000002e-06 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.190 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90597 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143343+0000", 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.01190388, 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012292574000000001, 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90597 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143343+0000", 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143343+0000", 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143343+0000", 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5100000000000001e-07 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143344+0000", 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0720000000000001e-06 2024-09-11T06:18:30.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143350+0000", 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143354+0000", 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1930000000000003e-06 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90598 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143358+0000", 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011888891, 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012326208, 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90598 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143358+0000", 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143358+0000", 2024-09-11T06:18:30.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143358+0000", 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7000000000000001e-07 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143359+0000", 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.153e-06 2024-09-11T06:18:30.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143363+0000", 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9179999999999996e-06 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143367+0000", 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.241e-06 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.198 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90599 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143375+0000", 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.01187234, 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012345698, 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90599 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.199 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143375+0000", 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143375+0000", 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143375+0000", 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.72e-07 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143376+0000", 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.252e-06 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143381+0000", 2024-09-11T06:18:30.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4299999999999999e-06 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143386+0000", 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90600 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143390+0000", 2024-09-11T06:18:30.202 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.01185689, 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012388411, 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90600 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143390+0000", 2024-09-11T06:18:30.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143390+0000", 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143390+0000", 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4200000000000002e-07 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143391+0000", 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143398+0000", 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8480000000000003e-06 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143401+0000", 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.205 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90650 3.6 3:655ee216:::rbd_data.116d94c57ffc.0000000000000007:2b [read 174080~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143949+0000", 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011298132000000001, 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01188822, 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90650 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143949+0000", 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143949+0000", 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143949+0000", 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143950+0000", 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3859999999999999e-06 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143954+0000", 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5650000000000002e-06 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143959+0000", 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.155689+0000", 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011729827999999999 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.155735+0000", 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5998000000000002e-05 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90651 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143962+0000", 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011284641, 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011939276, 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90651 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143962+0000", 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143962+0000", 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143963+0000", 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143964+0000", 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7630000000000001e-06 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143971+0000", 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7780000000000002e-06 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143974+0000", 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.112e-06 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.213 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90652 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143978+0000", 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011269015, 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.011976894, 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.214 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90652 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143978+0000", 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143978+0000", 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143978+0000", 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8700000000000002e-07 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143985+0000", 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8129999999999998e-06 2024-09-11T06:18:30.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143989+0000", 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.653e-06 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143992+0000", 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5580000000000001e-06 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90469 3.2 3:41aa15c6:::rbd_data.116d94c57ffc.0000000000000002:2b [read 237568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.140743+0000", 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014504369, 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015262693000000001, 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90469 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140743+0000", 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140743+0000", 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140743+0000", 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5100000000000001e-07 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140744+0000", 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.074e-06 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140747+0000", 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.027e-06 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140758+0000", 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1525000000000001e-05 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.155862+0000", 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015103408 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.155941+0000", 2024-09-11T06:18:30.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9165999999999994e-05 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90653 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143996+0000", 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011250621000000001, 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012072447, 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90653 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143996+0000", 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143996+0000", 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143997+0000", 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143998+0000", 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7740000000000001e-06 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144004+0000", 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1159999999999998e-06 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144009+0000", 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1150000000000002e-06 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90470 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.140764+0000", 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014482457000000001, 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015370389999999999, 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.225 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90470 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140764+0000", 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140764+0000", 2024-09-11T06:18:30.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140765+0000", 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140766+0000", 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.421e-06 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140770+0000", 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5030000000000002e-06 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140772+0000", 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6900000000000001e-06 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90654 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.144012+0000", 2024-09-11T06:18:30.228 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011234447999999999, 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012160957999999999, 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90654 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144012+0000", 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144012+0000", 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144013+0000", 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-07 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144014+0000", 2024-09-11T06:18:30.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4449999999999999e-06 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144017+0000", 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2049999999999998e-06 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144020+0000", 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5280000000000002e-06 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90471 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.140775+0000", 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014471738, 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015425227999999999, 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90471 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140775+0000", 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140775+0000", 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140775+0000", 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:18:30.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140777+0000", 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1650000000000001e-06 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140780+0000", 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8340000000000001e-06 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140783+0000", 2024-09-11T06:18:30.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6019999999999998e-06 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90655 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.144023+0000", 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011224384, 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012213926, 2024-09-11T06:18:30.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90655 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144023+0000", 2024-09-11T06:18:30.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144023+0000", 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144023+0000", 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5199999999999998e-07 2024-09-11T06:18:30.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144024+0000", 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0869999999999999e-06 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144027+0000", 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.965e-06 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144029+0000", 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.576e-06 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90472 3.2 3.63a85582 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.140786+0000", 2024-09-11T06:18:30.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.014461066, 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015504301999999999, 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90472 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140786+0000", 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140786+0000", 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140786+0000", 2024-09-11T06:18:30.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140787+0000", 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140790+0000", 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.016e-06 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.140794+0000", 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1289999999999998e-06 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90656 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.144032+0000", 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011214864, 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012311134, 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.243 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90656 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144032+0000", 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144032+0000", 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144032+0000", 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144033+0000", 2024-09-11T06:18:30.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.012e-06 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144037+0000", 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0380000000000001e-06 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144041+0000", 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1409999999999998e-06 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.247 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90657 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.247 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.144060+0000", 2024-09-11T06:18:30.247 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011187046000000001, 2024-09-11T06:18:30.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012332064, 2024-09-11T06:18:30.247 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.247 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.247 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90657 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144060+0000", 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144060+0000", 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144060+0000", 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3200000000000005e-07 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144063+0000", 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1280000000000002e-06 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144068+0000", 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8950000000000003e-06 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144073+0000", 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4689999999999999e-06 2024-09-11T06:18:30.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90658 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.144087+0000", 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011160073, 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012336331000000001, 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90658 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144087+0000", 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144087+0000", 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144087+0000", 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144089+0000", 2024-09-11T06:18:30.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0619999999999999e-06 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144095+0000", 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-06 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144100+0000", 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6249999999999998e-06 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90659 3.6 3.68477aa6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.144106+0000", 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.011140524000000001, 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.012371118, 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90659 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.255 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144106+0000", 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144106+0000", 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:30.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144107+0000", 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8799999999999998e-07 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144109+0000", 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8500000000000001e-06 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144114+0000", 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8100000000000003e-06 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:30.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.144120+0000", 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 25 2024-09-11T06:18:30.258 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:30.259 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:30.260 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:30.260 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:30.260 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:30.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:30.261 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:30.258+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:30.262 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:30.262 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:30.278 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:30.278 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:30.294 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:30.295 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:30.311 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:30.312 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:30.328 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:30.328 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:30.345 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:30.345 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:30.360 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:30.360+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:30.366 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:30.366 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:30.375 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:30.461 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:30.461+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:30.542 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:30.542 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:30.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:30.562 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:30.561+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:30.663 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:30.662+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:30.747 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:30.748 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:30.757 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:30.764 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:30.763+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:30.859 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:30.860 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:30.865 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:30.863+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:30.868 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:30.966 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:30.964+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:31.012 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:31.012 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:31.021 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:31.100 INFO:teuthology.orchestra.run.smithi070.stderr:set 1.0 pg_upmap_items mapping to [6->5,3->1] 2024-09-11T06:18:31.104 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:31.103+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:31.147 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-11T06:18:31.168 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:31.168 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:31.169 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:31.167+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:31.177 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:31.269 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:31.268+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:31.320 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:31.320 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:31.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:31.373 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:31.371+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:31.424 INFO:teuthology.orchestra.run.smithi070.stdout:2900 write 0x3b14d2d thru 0x3b17bb5 (0x2e89 bytes) 2024-09-11T06:18:31.432 INFO:teuthology.orchestra.run.smithi070.stdout:2901 punch from 0x365475b to 0x365d863, (0x9108 bytes) 2024-09-11T06:18:31.432 INFO:teuthology.orchestra.run.smithi070.stdout:2903 clone 22 order 24 su 131072 sc 14 2024-09-11T06:18:31.435 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:31.435 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:31.444 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:31.486 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:31.484+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:31.571 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:31.570+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:31.587 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:31.587 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:31.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:31.672 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:31.672+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:31.739 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:31.739 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:31.747 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:31.773 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:31.772+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:31.850 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:31.850 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:31.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:31.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:31.872+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:31.966 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:31.967 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:31.974 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:31.973+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:31.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:32.075 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:32.074+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:32.078 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:32.078 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:32.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:32.117 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:18:32.176 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:32.175+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:32.233 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:32.233 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:32.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:32.277 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:32.275+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:32.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:32.377 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:32.376+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:32.387 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:32.387 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:32.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:32.478 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:32.477+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:32.496 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:32.496 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:32.516 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:32.516 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:32.529 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:32.530 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:32.546 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:32.546 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:32.552 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:32.553 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:32.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:32.564 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:32.564 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:32.582 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:32.582 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:32.582 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:32.581+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:32.599 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:32.616 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:32.616 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:32.668 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.863243892, 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5268899550000001, 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:18:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:18:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.526870615, 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:18:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:18:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:18:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5268522660000001, 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:18:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:18:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5268340820000001, 2024-09-11T06:18:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:18:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.698 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5268152960000001, 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:18:32.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:18:32.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5267962969999997, 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:18:32.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:32.709 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5267677079999999, 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:32.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:18:32.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.714 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5265545820000002, 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:18:32.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:18:32.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:32.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5239996950000001, 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:18:32.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:18:32.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:18:32.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5239760040000001, 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:18:32.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:32.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.523955978, 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:18:32.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:18:32.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5239144229999999, 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5238904799999999, 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:18:32.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:32.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5238690720000001, 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:32.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5238482840000001, 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:18:32.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:18:32.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:18:32.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.757 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5238282490000001, 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:18:32.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5238081120000002, 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:18:32.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:18:32.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:32.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5237861150000001, 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:18:32.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:32.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.5237660499999999, 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:32.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:32.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:18:32.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:18:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:32.781 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:32.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:32.783 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:32.781+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:32.883 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:32.882+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:32.926 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:32.926 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:32.926 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:32.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:18:33.019 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:33.018+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:33.078 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:33.078 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:33.078 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:33.078 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:33.078 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:33.084 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:33.084+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:33.086 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:18:33.186 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:33.185+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:33.231 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90583 3.e 3:70a8eccc:::rbd_data.116d94c57ffc.0000000000000001:2b [read 210944~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144008+0000", 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0859171939999999, 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.056702283999999999, 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90583 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144008+0000", 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144008+0000", 2024-09-11T06:18:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144009+0000", 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1399999999999997e-07 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144012+0000", 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0589999999999998e-06 2024-09-11T06:18:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144021+0000", 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6109999999999994e-06 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144027+0000", 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3369999999999996e-06 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200476+0000", 2024-09-11T06:18:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.056449273000000001 2024-09-11T06:18:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200514+0000", 2024-09-11T06:18:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7985000000000003e-05 2024-09-11T06:18:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200711+0000", 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000196405 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90584 3.e 3:70a8eccc:::rbd_data.116d94c57ffc.0000000000000001:2b [read 223232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144035+0000", 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0858901350000001, 2024-09-11T06:18:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05695426, 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90584 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144035+0000", 2024-09-11T06:18:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144035+0000", 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144036+0000", 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7899999999999999e-07 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144038+0000", 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9530000000000002e-06 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144044+0000", 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5699999999999998e-06 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144056+0000", 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.137e-05 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200734+0000", 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.056678540999999999 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200789+0000", 2024-09-11T06:18:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4273e-05 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200990+0000", 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020107400000000001 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90585 3.e 3:70a8eccc:::rbd_data.116d94c57ffc.0000000000000001:2b [read 235520~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144063+0000", 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0858628449999999, 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057278348, 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90585 2024-09-11T06:18:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144063+0000", 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144063+0000", 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144063+0000", 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3099999999999998e-07 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144065+0000", 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0470000000000001e-06 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144072+0000", 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6719999999999998e-06 2024-09-11T06:18:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144077+0000", 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7539999999999997e-06 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201017+0000", 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.056940505000000002 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201084+0000", 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6769999999999999e-05 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201341+0000", 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025716900000000002 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90586 3.e 3:70a8eccc:::rbd_data.116d94c57ffc.0000000000000001:2b [read 247808~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144083+0000", 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.085842864, 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057561498000000003, 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90586 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144083+0000", 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144083+0000", 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144083+0000", 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144085+0000", 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.874e-06 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144091+0000", 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1140000000000002e-06 2024-09-11T06:18:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144096+0000", 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.69e-06 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201380+0000", 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057283912999999999 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201449+0000", 2024-09-11T06:18:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9502e-05 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201644+0000", 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019503200000000001 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90587 3.e 3:70a8eccc:::rbd_data.116d94c57ffc.0000000000000001:2b [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144102+0000", 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.085824063, 2024-09-11T06:18:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057774183999999999, 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90587 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144102+0000", 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144102+0000", 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144102+0000", 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144104+0000", 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.917e-06 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144110+0000", 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0839999999999997e-06 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144114+0000", 2024-09-11T06:18:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3970000000000004e-06 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201673+0000", 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057558638000000002 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201719+0000", 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5618000000000003e-05 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201876+0000", 2024-09-11T06:18:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015715999999999999 2024-09-11T06:18:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90588 3.e 3:70a8eccc:::rbd_data.116d94c57ffc.0000000000000001:2b [read 272384~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144120+0000", 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0858055690000001, 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058016726999999997, 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90588 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144120+0000", 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144120+0000", 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144120+0000", 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144122+0000", 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144128+0000", 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2129999999999996e-06 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144133+0000", 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6920000000000001e-06 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201895+0000", 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057761313000000002 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.201965+0000", 2024-09-11T06:18:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0902999999999995e-05 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202137+0000", 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017137000000000001 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90589 3.e 3:70a8eccc:::rbd_data.116d94c57ffc.0000000000000001:2b [read 284672~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144139+0000", 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0857861459999998, 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058366894000000002, 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90589 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144139+0000", 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144139+0000", 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144140+0000", 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0800000000000005e-07 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144142+0000", 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144148+0000", 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9800000000000003e-06 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144153+0000", 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202184+0000", 2024-09-11T06:18:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058031200999999998 2024-09-11T06:18:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202262+0000", 2024-09-11T06:18:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7514000000000004e-05 2024-09-11T06:18:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202506+0000", 2024-09-11T06:18:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024454199999999999 2024-09-11T06:18:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90660 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 153600~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144449+0000", 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0854768730000002, 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057975143, 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90660 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144449+0000", 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144449+0000", 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144449+0000", 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2699999999999999e-07 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144451+0000", 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144457+0000", 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1720000000000004e-06 2024-09-11T06:18:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144474+0000", 2024-09-11T06:18:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7017999999999999e-05 2024-09-11T06:18:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202156+0000", 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057681298999999998 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202216+0000", 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0658000000000001e-05 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202424+0000", 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020754899999999999 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90661 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 165888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144481+0000", 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0854445130000001, 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058212618000000001, 2024-09-11T06:18:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90661 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144481+0000", 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144481+0000", 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144482+0000", 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144490+0000", 2024-09-11T06:18:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:18:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144497+0000", 2024-09-11T06:18:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6830000000000002e-06 2024-09-11T06:18:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144501+0000", 2024-09-11T06:18:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6750000000000001e-06 2024-09-11T06:18:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202439+0000", 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057937227000000001 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202495+0000", 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6008999999999999e-05 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202694+0000", 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019917900000000001 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90662 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 178176~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144510+0000", 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0854151839999999, 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058449665999999997, 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90662 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144510+0000", 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144510+0000", 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144511+0000", 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144518+0000", 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0249999999999997e-06 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144525+0000", 2024-09-11T06:18:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8240000000000002e-06 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144535+0000", 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8209999999999997e-06 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202721+0000", 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058186548999999997 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202764+0000", 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2963000000000002e-05 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202960+0000", 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019594999999999999 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90663 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 190464~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144541+0000", 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0853843250000001, 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058624352999999997, 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90663 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144541+0000", 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144541+0000", 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144542+0000", 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6400000000000003e-07 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144544+0000", 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.052e-06 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144564+0000", 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0489e-05 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144570+0000", 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.202979+0000", 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058409610000000001 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203031+0000", 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1955e-05 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203166+0000", 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013421599999999999 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90664 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 202752~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144577+0000", 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.085348728, 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058837071999999997, 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90664 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144577+0000", 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144577+0000", 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146078+0000", 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015006679999999999 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146083+0000", 2024-09-11T06:18:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T06:18:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146091+0000", 2024-09-11T06:18:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5739999999999996e-06 2024-09-11T06:18:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146098+0000", 2024-09-11T06:18:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999997e-06 2024-09-11T06:18:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203184+0000", 2024-09-11T06:18:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057086716000000003 2024-09-11T06:18:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203246+0000", 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1871000000000004e-05 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203414+0000", 2024-09-11T06:18:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000167808 2024-09-11T06:18:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90665 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 215040~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.146109+0000", 2024-09-11T06:18:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0838164259999998, 2024-09-11T06:18:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057577999999999997, 2024-09-11T06:18:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90665 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146109+0000", 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146109+0000", 2024-09-11T06:18:33.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146110+0000", 2024-09-11T06:18:33.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T06:18:33.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146112+0000", 2024-09-11T06:18:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0250000000000001e-06 2024-09-11T06:18:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146117+0000", 2024-09-11T06:18:33.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.57e-06 2024-09-11T06:18:33.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146121+0000", 2024-09-11T06:18:33.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9149999999999998e-06 2024-09-11T06:18:33.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203447+0000", 2024-09-11T06:18:33.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057326294 2024-09-11T06:18:33.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203514+0000", 2024-09-11T06:18:33.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6215000000000002e-05 2024-09-11T06:18:33.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203687+0000", 2024-09-11T06:18:33.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017362700000000001 2024-09-11T06:18:33.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90666 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 227328~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.146127+0000", 2024-09-11T06:18:33.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0837986869999998, 2024-09-11T06:18:33.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057871748000000001, 2024-09-11T06:18:33.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90666 2024-09-11T06:18:33.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146127+0000", 2024-09-11T06:18:33.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146127+0000", 2024-09-11T06:18:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146127+0000", 2024-09-11T06:18:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146129+0000", 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8190000000000001e-06 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146134+0000", 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1970000000000004e-06 2024-09-11T06:18:33.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146139+0000", 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203733+0000", 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057594474 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203819+0000", 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5754000000000006e-05 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.203999+0000", 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017979199999999999 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90667 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 239616~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.146144+0000", 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0837818449999999, 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058160209999999997, 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90667 2024-09-11T06:18:33.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146144+0000", 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146144+0000", 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146144+0000", 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8099999999999999e-07 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146146+0000", 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146152+0000", 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8030000000000002e-06 2024-09-11T06:18:33.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146156+0000", 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3699999999999997e-06 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204032+0000", 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057875660000000002 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204109+0000", 2024-09-11T06:18:33.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7134999999999999e-05 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204304+0000", 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019531400000000001 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90668 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 251904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.146161+0000", 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0837645849999999, 2024-09-11T06:18:33.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058491599999999998, 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90668 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146161+0000", 2024-09-11T06:18:33.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146161+0000", 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146161+0000", 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146163+0000", 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.629e-06 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146169+0000", 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6189999999999999e-06 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146173+0000", 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-06 2024-09-11T06:18:33.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204333+0000", 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058159717 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204409+0000", 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5867999999999999e-05 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204653+0000", 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024396300000000001 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90669 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 264192~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.146178+0000", 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.083747587, 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058693302000000003, 2024-09-11T06:18:33.320 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90669 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146178+0000", 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146178+0000", 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146178+0000", 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146180+0000", 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6559999999999999e-06 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146185+0000", 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4639999999999997e-06 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146191+0000", 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8030000000000002e-06 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204687+0000", 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058495263999999998 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204734+0000", 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7725999999999997e-05 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204871+0000", 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013706100000000001 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90670 3.16 3:6c4b956d:::rbd_data.116d94c57ffc.0000000000000008:2b [read 276480~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.146197+0000", 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.083729027, 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.059114392000000002, 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90670 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146197+0000", 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146197+0000", 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146197+0000", 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146199+0000", 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8279999999999999e-06 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146204+0000", 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5659999999999997e-06 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146209+0000", 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204974+0000", 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.058765137000000002 2024-09-11T06:18:33.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.205045+0000", 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0766000000000007e-05 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.205311+0000", 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000266333 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90694 3.e 3:73d1875f:::rbd_object_map.116d419b7418.000000000000002c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.146930+0000", 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.082995516, 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062643639000000001, 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90694 2024-09-11T06:18:33.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146930+0000", 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146930+0000", 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146931+0000", 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3799999999999996e-07 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146936+0000", 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7389999999999999e-06 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146950+0000", 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4062e-05 2024-09-11T06:18:33.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.146957+0000", 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9770000000000003e-06 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204888+0000", 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057931605999999997 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.204958+0000", 2024-09-11T06:18:33.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0147000000000004e-05 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.205306+0000", 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034704400000000002 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.208608+0000", 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033024450000000002 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.209461+0000", 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085318500000000001 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.209525+0000", 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3378000000000002e-05 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.209574+0000", 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9218000000000002e-05 2024-09-11T06:18:33.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90695 3.e 3:73d1875f:::rbd_object_map.116d419b7418.000000000000002c:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.152378+0000", 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0775471630000002, 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.057333688000000001, 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90695 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.152378+0000", 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.152378+0000", 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.152380+0000", 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5519999999999999e-06 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.152389+0000", 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2220000000000008e-06 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.152400+0000", 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.152408+0000", 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9990000000000008e-06 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.205787+0000", 2024-09-11T06:18:33.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053379490000000002 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.205877+0000", 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0209000000000003e-05 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.206236+0000", 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035814799999999997 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.208668+0000", 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024328850000000001 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.209586+0000", 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00091777299999999998 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.209668+0000", 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1990000000000006e-05 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.209712+0000", 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3918000000000002e-05 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.342 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:33.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:33.344 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:33.342+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:33.403 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:18:33.444 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:33.442+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:33.546 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:33.545+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:33.551 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:33.551 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:33.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99531 3.11 3.871d0f71 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.548876+0000", 2024-09-11T06:18:33.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00034451499999999999, 2024-09-11T06:18:33.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000374201, 2024-09-11T06:18:33.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99531 2024-09-11T06:18:33.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548876+0000", 2024-09-11T06:18:33.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548876+0000", 2024-09-11T06:18:33.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548877+0000", 2024-09-11T06:18:33.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:33.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548879+0000", 2024-09-11T06:18:33.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548885+0000", 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999997e-06 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548890+0000", 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1649999999999997e-06 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99534 3.1d 3:bc48f0fe:::rbd_data.116d419b7418.00000000000000aa:snapdir [list-snaps] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.548935+0000", 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00028570499999999998, 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038142800000000001, 2024-09-11T06:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99534 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548935+0000", 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548935+0000", 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548936+0000", 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999999999999995e-07 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548940+0000", 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.07e-06 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548949+0000", 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7779999999999996e-06 2024-09-11T06:18:33.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548956+0000", 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000001e-06 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549281+0000", 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00032582899999999997 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99536 3.1d 3.4cd99f7d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.548986+0000", 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000235329, 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039685600000000001, 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99536 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548986+0000", 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548986+0000", 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548986+0000", 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2600000000000002e-07 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548989+0000", 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8930000000000001e-06 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548997+0000", 2024-09-11T06:18:33.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6480000000000003e-06 2024-09-11T06:18:33.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549003+0000", 2024-09-11T06:18:33.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8939999999999998e-06 2024-09-11T06:18:33.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99543 3.11 3.78def271 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549040+0000", 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00018055799999999999, 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039718700000000002, 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99543 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549040+0000", 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549040+0000", 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549041+0000", 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3000000000000001e-07 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549048+0000", 2024-09-11T06:18:33.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8680000000000001e-06 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549055+0000", 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2400000000000001e-06 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549067+0000", 2024-09-11T06:18:33.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2069000000000001e-05 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99422 3.11 3:8a6e49a5:::rbd_data.116d419b7418.0000000000000022:snapdir [list-snaps] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.548304+0000", 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00091746899999999997, 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011920520000000001, 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99422 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548304+0000", 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548304+0000", 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548304+0000", 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548306+0000", 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.939e-06 2024-09-11T06:18:33.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548312+0000", 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2600000000000002e-06 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.548317+0000", 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4680000000000003e-06 2024-09-11T06:18:33.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549438+0000", 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001121321 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99585 3.1d 3.5f8243bd (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549181+0000", 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9507e-05, 2024-09-11T06:18:33.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00037403000000000002, 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99585 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549181+0000", 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549181+0000", 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549182+0000", 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549184+0000", 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.874e-06 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549190+0000", 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8610000000000003e-06 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549194+0000", 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3950000000000003e-06 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.578 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99590 3.d 3:b745186e:::rbd_data.116d419b7418.00000000000000e8:snapdir [list-snaps] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549220+0000", 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.0750000000000001e-06, 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039214700000000003, 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99590 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549220+0000", 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549220+0000", 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549220+0000", 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549222+0000", 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0219999999999999e-06 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549229+0000", 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2480000000000001e-06 2024-09-11T06:18:33.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549233+0000", 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8439999999999997e-06 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549561+0000", 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00032751299999999998 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549622+0000", 2024-09-11T06:18:33.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0714999999999997e-05 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99592 3.11 3.6ddd9e31 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549239+0000", 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999814, 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044241400000000002, 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99592 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549239+0000", 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549239+0000", 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549240+0000", 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3600000000000004e-07 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549242+0000", 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8780000000000001e-06 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549248+0000", 2024-09-11T06:18:33.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4629999999999998e-06 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549252+0000", 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.16e-06 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99594 3.d 3.964248cd (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549260+0000", 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999614, 2024-09-11T06:18:33.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048046200000000002, 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99594 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549260+0000", 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549260+0000", 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549260+0000", 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2499999999999995e-07 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549262+0000", 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.821e-06 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549268+0000", 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.947e-06 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549273+0000", 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99595 3.d 3.a94319ad (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549278+0000", 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999428, 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051692600000000002, 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99595 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549278+0000", 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549278+0000", 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549279+0000", 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000002e-07 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549280+0000", 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.671e-06 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549286+0000", 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8549999999999998e-06 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549290+0000", 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2910000000000001e-06 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99610 3.11 3.b0ae8031 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549297+0000", 2024-09-11T06:18:33.593 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999242, 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055207499999999996, 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99610 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549297+0000", 2024-09-11T06:18:33.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549297+0000", 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549297+0000", 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549299+0000", 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6920000000000001e-06 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549305+0000", 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9240000000000004e-06 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549315+0000", 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0271999999999999e-05 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99615 3.9 3.4f784929 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549321+0000", 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998999, 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058917699999999997, 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99615 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549321+0000", 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549321+0000", 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549322+0000", 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2e-07 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549328+0000", 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3380000000000001e-06 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549335+0000", 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.652e-06 2024-09-11T06:18:33.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549340+0000", 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9989999999999999e-06 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99621 3.9 3.a4a5de49 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549346+0000", 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998746, 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00061704000000000001, 2024-09-11T06:18:33.600 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99621 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549346+0000", 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549346+0000", 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549347+0000", 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2399999999999998e-07 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549349+0000", 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.875e-06 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549354+0000", 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549359+0000", 2024-09-11T06:18:33.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4129999999999999e-06 2024-09-11T06:18:33.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99623 3.11 3.b1cf6491 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.604 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549365+0000", 2024-09-11T06:18:33.604 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.999856, 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065390200000000004, 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99623 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549365+0000", 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549365+0000", 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549365+0000", 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549373+0000", 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5639999999999999e-06 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549377+0000", 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3200000000000001e-06 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549380+0000", 2024-09-11T06:18:33.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8420000000000001e-06 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99634 3.1d 3:b95750d5:::rbd_data.116d419b7418.000000000000011a:snapdir [list-snaps] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549437+0000", 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997845, 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064387500000000002, 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99634 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549437+0000", 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549437+0000", 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549437+0000", 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549439+0000", 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549446+0000", 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0330000000000003e-06 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549458+0000", 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2417e-05 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.550031+0000", 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00057257599999999999 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99635 3.11 3.fa6b56f1 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549465+0000", 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997559, 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067861400000000002, 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99635 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549465+0000", 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549465+0000", 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549466+0000", 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1500000000000005e-07 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549468+0000", 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549474+0000", 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8170000000000004e-06 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549479+0000", 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9370000000000001e-06 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:99691 3.9 3.e3c48069 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.549577+0000", 2024-09-11T06:18:33.615 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9996443, 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062057400000000004, 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 99691 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549577+0000", 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549577+0000", 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549577+0000", 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-07 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549583+0000", 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5809999999999996e-06 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549589+0000", 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1890000000000004e-06 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.549594+0000", 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7949999999999998e-06 2024-09-11T06:18:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.619 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.619 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:18:33.619 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 17 2024-09-11T06:18:33.619 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:33.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:33.661 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:33.660+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:33.747 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:33.745+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:33.798 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:33.799 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:33.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:33.857 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:33.856+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:33.942 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:33.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 94.321342053999999, 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:33.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:33.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:33.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 94.026906475999994, 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:33.952 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:33.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7603432820000009, 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63576 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7581295170000004, 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053575987999999998, 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63576 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:33.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182844+0000", 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182850+0000", 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9970000000000004e-06 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182854+0000", 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1829999999999996e-06 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235811+0000", 2024-09-11T06:18:33.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052956403999999999 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235933+0000", 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012229799999999999 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236418+0000", 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048509399999999999 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63577 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7581105969999999, 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053525649000000002, 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63577 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.967 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:33.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.22e-07 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182863+0000", 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9e-06 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182876+0000", 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.311e-05 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182887+0000", 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1109e-05 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236375+0000", 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053487499000000001 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236387+0000", 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1708999999999999e-05 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63578 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7580670900000008, 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053516941999999998, 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63578 2024-09-11T06:18:33.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182905+0000", 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182908+0000", 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6249999999999999e-06 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182915+0000", 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.525e-06 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182921+0000", 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.48e-06 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236412+0000", 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053491483999999999 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236421+0000", 2024-09-11T06:18:33.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63579 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:33.975 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.757994558, 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053483819000000002, 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63579 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182978+0000", 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.99e-07 2024-09-11T06:18:33.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182980+0000", 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182988+0000", 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182995+0000", 2024-09-11T06:18:33.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0129999999999996e-06 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236448+0000", 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053452983000000003 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236461+0000", 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2865e-05 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63580 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7579680799999995, 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053488579000000001, 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63580 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183004+0000", 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183006+0000", 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0650000000000001e-06 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183013+0000", 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T06:18:33.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183018+0000", 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236482+0000", 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053463869999999997 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236492+0000", 2024-09-11T06:18:33.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0471e-05 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90636 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 145408~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.796825331, 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053568440000000002, 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90636 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144147+0000", 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144148+0000", 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144154+0000", 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4990000000000002e-06 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144158+0000", 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3680000000000004e-06 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197315+0000", 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05315698 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197352+0000", 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6510000000000001e-05 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197715+0000", 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036306199999999999 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90637 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7968083569999997, 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053721428000000002, 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90637 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144165+0000", 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144171+0000", 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2909999999999998e-06 2024-09-11T06:18:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144175+0000", 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0029999999999996e-06 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197740+0000", 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053565861999999999 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197779+0000", 2024-09-11T06:18:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8339e-05 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197885+0000", 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105807 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90638 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7967912269999999, 2024-09-11T06:18:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053925155000000002, 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90638 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144181+0000", 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144183+0000", 2024-09-11T06:18:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9479999999999998e-06 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144188+0000", 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4709999999999998e-06 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144193+0000", 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7040000000000002e-06 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197927+0000", 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053734188000000002 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197993+0000", 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5839000000000004e-05 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198105+0000", 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011268 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90639 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.796772818, 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054132671, 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90639 2024-09-11T06:18:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144201+0000", 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144207+0000", 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0510000000000002e-06 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144212+0000", 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198160+0000", 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053948788999999997 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198221+0000", 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0395e-05 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198331+0000", 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110541 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90640 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7967544599999998, 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054316443999999998, 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90640 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3099999999999999e-07 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144219+0000", 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7549999999999999e-06 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144224+0000", 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2839999999999997e-06 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144229+0000", 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4549999999999997e-06 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198363+0000", 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054134045999999998 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198417+0000", 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198534+0000", 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116767 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90641 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.79673756, 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534245000000002, 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90641 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0499999999999999e-07 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144236+0000", 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144242+0000", 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5210000000000002e-06 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144253+0000", 2024-09-11T06:18:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1297e-05 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198574+0000", 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054321665999999998 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198647+0000", 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2031000000000002e-05 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198768+0000", 2024-09-11T06:18:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121703 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90642 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7967128799999998, 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054727525999999999, 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90642 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144261+0000", 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144267+0000", 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7749999999999998e-06 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144271+0000", 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5399999999999997e-06 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198806+0000", 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534816999999999 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198867+0000", 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0776999999999998e-05 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198986+0000", 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119203 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90643 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7966948509999998, 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054909368, 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90643 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144279+0000", 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.801e-06 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144284+0000", 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.451e-06 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144289+0000", 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199018+0000", 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054728994000000003 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199072+0000", 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3705999999999997e-05 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199186+0000", 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114521 2024-09-11T06:18:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90644 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7966776639999997, 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055086361, 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90644 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144296+0000", 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.728e-06 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144301+0000", 2024-09-11T06:18:34.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4009999999999996e-06 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144306+0000", 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4159999999999997e-06 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199216+0000", 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054910051000000001 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199269+0000", 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3341000000000003e-05 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199380+0000", 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111103 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.796660691, 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:18:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7966432650000002, 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:18:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7966260090000001, 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:18:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:34.038 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:34.039 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:34.040 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:34.038+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:34.140 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:34.138+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:34.143 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:34.143 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:34.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:34.241 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:34.240+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:34.294 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:34.294 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:34.294 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:34.294 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:34.294 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:34.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:34.346 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:34.345+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:34.409 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.091356914000002, 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:34.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:34.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.778783696000005, 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:34.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68119 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 405504~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.460892+0000", 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9464676940000007, 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016864649999999998, 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.423 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68119 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.460892+0000", 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.460892+0000", 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.460893+0000", 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.460895+0000", 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9570000000000001e-06 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.460900+0000", 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.460905+0000", 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5580000000000002e-06 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.476733+0000", 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.015828458 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.477591+0000", 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00085726699999999999 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.477757+0000", 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000166188 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.427 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68185 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:29 [read 106496~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461250+0000", 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.946109409, 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016872557999999999, 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.428 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68185 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461250+0000", 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461250+0000", 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461251+0000", 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461253+0000", 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461259+0000", 2024-09-11T06:18:34.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1399999999999997e-06 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461264+0000", 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9919999999999998e-06 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.477788+0000", 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016524232 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.477870+0000", 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1798999999999994e-05 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478123+0000", 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00025289600000000001 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68251 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 20480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.432 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461330+0000", 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9460300030000006, 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017065271999999999, 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68251 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461330+0000", 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461330+0000", 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461330+0000", 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:18:34.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461332+0000", 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8819999999999999e-06 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461338+0000", 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8220000000000003e-06 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461343+0000", 2024-09-11T06:18:34.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6970000000000001e-06 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478156+0000", 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016813100000000001 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478246+0000", 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9693999999999999e-05 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478395+0000", 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000149548 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68252 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 90112~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461352+0000", 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9460078490000008, 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017250814999999999, 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.437 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68252 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461352+0000", 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461352+0000", 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461352+0000", 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-07 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461354+0000", 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.928e-06 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461360+0000", 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461365+0000", 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5569999999999997e-06 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478389+0000", 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017023898999999999 2024-09-11T06:18:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478484+0000", 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5697000000000002e-05 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478603+0000", 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118496 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68253 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 131072~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461371+0000", 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9459892199999995, 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017502355000000001, 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68253 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461371+0000", 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461371+0000", 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461371+0000", 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8400000000000005e-07 2024-09-11T06:18:34.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461373+0000", 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-06 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461378+0000", 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2120000000000002e-06 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461383+0000", 2024-09-11T06:18:34.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2250000000000002e-06 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478655+0000", 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017272451000000001 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478738+0000", 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2859000000000001e-05 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478873+0000", 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013509399999999999 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68255 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 159744~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461388+0000", 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9459716359999994, 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017810148000000001, 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68255 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461388+0000", 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461388+0000", 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461389+0000", 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461391+0000", 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9810000000000002e-06 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461396+0000", 2024-09-11T06:18:34.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8150000000000002e-06 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461401+0000", 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5689999999999998e-06 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.478917+0000", 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017515640999999998 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479039+0000", 2024-09-11T06:18:34.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012245800000000001 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479198+0000", 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015927399999999999 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68256 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9459537400000002, 2024-09-11T06:18:34.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018100349000000002, 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68256 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:34.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461407+0000", 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6800000000000001e-07 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461416+0000", 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8409999999999995e-06 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461422+0000", 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.806e-06 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461427+0000", 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5040000000000004e-06 2024-09-11T06:18:34.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479297+0000", 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017870381000000001 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479385+0000", 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7690999999999998e-05 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479506+0000", 2024-09-11T06:18:34.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012165800000000001 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68257 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9459252720000002, 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018398100000000001, 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.455 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68257 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999995e-07 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461437+0000", 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2740000000000002e-06 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461444+0000", 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6769999999999998e-06 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461450+0000", 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7810000000000002e-06 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479581+0000", 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018131278000000001 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479687+0000", 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105931 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479833+0000", 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014557200000000001 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68258 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 311296~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9459042140000005, 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01871913, 2024-09-11T06:18:34.459 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68258 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.32e-07 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461464+0000", 2024-09-11T06:18:34.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461470+0000", 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1120000000000001e-06 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461475+0000", 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7199999999999997e-06 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479865+0000", 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018390118 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480028+0000", 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016266800000000001 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480175+0000", 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147236 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.463 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68259 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 339968~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9458797529999998, 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018993309999999999, 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.464 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68259 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461481+0000", 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6499999999999999e-07 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461483+0000", 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461488+0000", 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5319999999999997e-06 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461493+0000", 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.634e-06 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480206+0000", 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018713032000000001 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480367+0000", 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016139799999999999 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480473+0000", 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106346 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68260 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 380928~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9458615540000004, 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019218077, 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68260 2024-09-11T06:18:34.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461499+0000", 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461501+0000", 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7600000000000001e-06 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461506+0000", 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7989999999999999e-06 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461511+0000", 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480510+0000", 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018999095000000001 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480604+0000", 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3795000000000006e-05 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480716+0000", 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112389 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68326 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.945426908, 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019001186999999999, 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.473 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68326 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9299999999999998e-07 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461935+0000", 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461941+0000", 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461947+0000", 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9519999999999999e-06 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480755+0000", 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018807739 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480838+0000", 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3145000000000004e-05 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480934+0000", 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6009999999999997e-05 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68343 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9453896220000004, 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019314591999999998, 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68343 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:34.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461971+0000", 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461977+0000", 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0950000000000001e-06 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461982+0000", 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2950000000000001e-06 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461986+0000", 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9779999999999999e-06 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480964+0000", 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01897832 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481041+0000", 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6755000000000006e-05 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481285+0000", 2024-09-11T06:18:34.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000243804 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68352 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9453282759999997, 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019458092, 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.482 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68352 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4099999999999999e-07 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462034+0000", 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.725e-06 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462040+0000", 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462044+0000", 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4619999999999998e-06 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481326+0000", 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281586999999999 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481420+0000", 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3727000000000006e-05 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481490+0000", 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0174999999999998e-05 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68369 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9452884929999996, 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019575028000000001, 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.486 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68369 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462072+0000", 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9399999999999995e-07 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462074+0000", 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.711e-06 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462080+0000", 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-06 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462084+0000", 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5279999999999997e-06 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481519+0000", 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019434165 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481575+0000", 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6489000000000001e-05 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481646+0000", 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1271000000000003e-05 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.490 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68378 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.464238+0000", 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.9431222590000008, 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017553803999999999, 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68378 2024-09-11T06:18:34.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464238+0000", 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464238+0000", 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464239+0000", 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8899999999999998e-07 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464243+0000", 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.16e-06 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464252+0000", 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5610000000000004e-06 2024-09-11T06:18:34.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464259+0000", 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2269999999999996e-06 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481674+0000", 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017414658 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481724+0000", 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0250999999999997e-05 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481791+0000", 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7057999999999994e-05 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68395 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.464539+0000", 2024-09-11T06:18:34.495 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 8.942820824, 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017381264, 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68395 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464539+0000", 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464539+0000", 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464540+0000", 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2900000000000003e-07 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464543+0000", 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.546e-06 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464552+0000", 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999992e-06 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.464558+0000", 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0519999999999998e-06 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481817+0000", 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017258860000000001 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481864+0000", 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7670000000000003e-05 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481920+0000", 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6109000000000001e-05 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.499 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:90600 3.2 3:41aa15c6:::rbd_data.116d94c57ffc.0000000000000002:2b [read 276480~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:30.143390+0000", 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.2639698670000001, 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.016838147000000001, 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:34.500 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 90600 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143390+0000", 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:34.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143390+0000", 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143390+0000", 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4200000000000002e-07 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143391+0000", 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0899999999999999e-06 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:34.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143398+0000", 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8480000000000003e-06 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.143401+0000", 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.159993+0000", 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01659184 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.160063+0000", 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9880000000000002e-05 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:30.160228+0000", 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016553299999999999 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:34.504 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:34.506 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-11T06:18:34.506 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.506 INFO:teuthology.orchestra.run.smithi070.stdout:2906 read 0x1e01e2 thru 0x1e6d97 (0x6bb6 bytes) 2024-09-11T06:18:34.506 INFO:teuthology.orchestra.run.smithi070.stdout:2907 punch from 0x1739828 to 0x173cfbe, (0x3796 bytes) 2024-09-11T06:18:34.506 INFO:teuthology.orchestra.run.smithi070.stdout:2908 trunc from 0x3b17bb6 to 0x97e0302 2024-09-11T06:18:34.507 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:34.505+0000 7f3360afc640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33586) UID: 0 2024-09-11T06:18:34.507 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:34.510 INFO:teuthology.orchestra.run.smithi070.stdout:2910 read 0x1937624 thru 0x193e335 (0x6d12 bytes) 2024-09-11T06:18:34.510 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.510 INFO:teuthology.orchestra.run.smithi070.stdout:2914 punch from 0x13bf6f4 to 0x13ceada, (0xf3e6 bytes) 2024-09-11T06:18:34.510 INFO:teuthology.orchestra.run.smithi070.stdout:2916 writesame 0x65bbbd thru 0x6650c4 data_size 0x4c(0x9508 bytes) 2024-09-11T06:18:34.512 INFO:teuthology.orchestra.run.smithi070.stdout:2917 read 0x70df79a thru 0x70e1ca8 (0x250f bytes) 2024-09-11T06:18:34.522 INFO:teuthology.orchestra.run.smithi070.stdout:2921 trunc from 0x97e0302 to 0x1015675 2024-09-11T06:18:34.545 INFO:teuthology.orchestra.run.smithi070.stdout:2922 write 0x71c6d64 thru 0x71d2423 (0xb6c0 bytes) 2024-09-11T06:18:34.548 INFO:teuthology.orchestra.run.smithi070.stdout:2923 punch from 0x52688f0 to 0x5275e09, (0xd519 bytes) 2024-09-11T06:18:34.548 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.548 INFO:teuthology.orchestra.run.smithi070.stdout:2925 punch from 0x3b91dec to 0x3b9b9e8, (0x9bfc bytes) 2024-09-11T06:18:34.548 INFO:teuthology.orchestra.run.smithi070.stdout:2926 punch from 0x249f7e3 to 0x24aa45d, (0xac7a bytes) 2024-09-11T06:18:34.562 INFO:teuthology.orchestra.run.smithi070.stdout:2927 writesame 0xe4e6cba thru 0xe4f115b data_size 0xd(0xa4a2 bytes) 2024-09-11T06:18:34.562 INFO:teuthology.orchestra.run.smithi070.stdout:2928 read 0x3a3d275 thru 0x3a478c9 (0xa655 bytes) 2024-09-11T06:18:34.563 INFO:teuthology.orchestra.run.smithi070.stdout:2930 read 0xadd88f0 thru 0xade18d6 (0x8fe7 bytes) 2024-09-11T06:18:34.563 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.570 INFO:teuthology.orchestra.run.smithi070.stdout:2933 trunc from 0xe4f115c to 0x8bad411 2024-09-11T06:18:34.578 INFO:teuthology.orchestra.run.smithi070.stdout:2935 writesame 0x561729e thru 0x561d2b5 data_size 0x7b(0x6018 bytes) 2024-09-11T06:18:34.580 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.593 INFO:teuthology.orchestra.run.smithi070.stdout:2938 write 0xe68adeb thru 0xe692d95 (0x7fab bytes) 2024-09-11T06:18:34.596 INFO:teuthology.orchestra.run.smithi070.stdout:2940 read 0x1470466 thru 0x147bca0 (0xb83b bytes) 2024-09-11T06:18:34.597 INFO:teuthology.orchestra.run.smithi070.stdout:2941 writesame 0x4273fac thru 0x4280049 data_size 0x5(0xc09e bytes) 2024-09-11T06:18:34.601 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.601 INFO:teuthology.orchestra.run.smithi070.stdout:2944 read 0xe06258e thru 0xe068597 (0x600a bytes) 2024-09-11T06:18:34.601 INFO:teuthology.orchestra.run.smithi070.stdout:2945 write 0x97bad74 thru 0x97be974 (0x3c01 bytes) 2024-09-11T06:18:34.603 INFO:teuthology.orchestra.run.smithi070.stdout:2947 punch from 0x6083004 to 0x6088224, (0x5220 bytes) 2024-09-11T06:18:34.603 INFO:teuthology.orchestra.run.smithi070.stdout:2950 read 0x651ed6b thru 0x65220b4 (0x334a bytes) 2024-09-11T06:18:34.603 INFO:teuthology.orchestra.run.smithi070.stdout:2952 punch from 0xcb5f52a to 0xcb65f4e, (0x6a24 bytes) 2024-09-11T06:18:34.604 INFO:teuthology.orchestra.run.smithi070.stdout:2953 read 0xdd95dd7 thru 0xdd9f40d (0x9637 bytes) 2024-09-11T06:18:34.607 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:34.605+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:34.614 INFO:teuthology.orchestra.run.smithi070.stdout:2955 trunc from 0xe692d96 to 0x5a94493 2024-09-11T06:18:34.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:34.629 INFO:teuthology.orchestra.run.smithi070.stdout:2956 read 0x3387170 thru 0x3396ffd (0xfe8e bytes) 2024-09-11T06:18:34.630 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.639 INFO:teuthology.orchestra.run.smithi070.stdout:2958 write 0x874d21a thru 0x8750404 (0x31eb bytes) 2024-09-11T06:18:34.640 INFO:teuthology.orchestra.run.smithi070.stdout:2960 read 0x2f958b2 thru 0x2fa0e48 (0xb597 bytes) 2024-09-11T06:18:34.640 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.641 INFO:teuthology.orchestra.run.smithi070.stdout:2962 punch from 0x1f2455c to 0x1f2da28, (0x94cc bytes) 2024-09-11T06:18:34.650 INFO:teuthology.orchestra.run.smithi070.stdout:2963 trunc from 0x8750405 to 0x460530 2024-09-11T06:18:34.660 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:34.660 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:34.661 INFO:teuthology.orchestra.run.smithi070.stdout:2964 read 0xf68ec thru 0xff8dd (0x8ff2 bytes) 2024-09-11T06:18:34.661 INFO:teuthology.orchestra.run.smithi070.stdout:2965 read 0x20cdd2 thru 0x21418a (0x73b9 bytes) 2024-09-11T06:18:34.669 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:34.683 INFO:teuthology.orchestra.run.smithi070.stdout:2966 writesame 0xd16bfef thru 0xd16e23e data_size 0x30(0x2250 bytes) 2024-09-11T06:18:34.684 INFO:teuthology.orchestra.run.smithi070.stdout:2967 writesame 0x75c1803 thru 0x75d162b data_size 0x41(0xfe29 bytes) 2024-09-11T06:18:34.686 INFO:teuthology.orchestra.run.smithi070.stdout:2969 writesame 0x2536780 thru 0x2545705 data_size 0x3e(0xef86 bytes) 2024-09-11T06:18:34.688 INFO:teuthology.orchestra.run.smithi070.stdout:2971 writesame 0x40bde3a thru 0x40cd722 data_size 0x1(0xf8e9 bytes) 2024-09-11T06:18:34.707 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:34.706+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:34.716 INFO:teuthology.orchestra.run.smithi070.stdout:2972 trunc from 0xd16e23f to 0xc25f823 2024-09-11T06:18:34.725 INFO:teuthology.orchestra.run.smithi070.stdout:2974 read 0x48079c9 thru 0x4810ddf (0x9417 bytes) 2024-09-11T06:18:34.725 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.725 INFO:teuthology.orchestra.run.smithi070.stdout:2979 write 0x44db434 thru 0x44dcc0d (0x17da bytes) 2024-09-11T06:18:34.726 INFO:teuthology.orchestra.run.smithi070.stdout:2982 writesame 0xc1637f0 thru 0xc16e695 data_size 0xa(0xaea6 bytes) 2024-09-11T06:18:34.729 INFO:teuthology.orchestra.run.smithi070.stdout:2983 punch from 0x39e3562 to 0x39f1f6f, (0xea0d bytes) 2024-09-11T06:18:34.730 INFO:teuthology.orchestra.run.smithi070.stdout:2985 write 0x8b3aa2f thru 0x8b3d28f (0x2861 bytes) 2024-09-11T06:18:34.730 INFO:teuthology.orchestra.run.smithi070.stdout:2986 write 0x49e2f85 thru 0x49e5875 (0x28f1 bytes) 2024-09-11T06:18:34.732 INFO:teuthology.orchestra.run.smithi070.stdout:2987 write 0x9ff5ad1 thru 0xa005a5f (0xff8f bytes) 2024-09-11T06:18:34.734 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.734 INFO:teuthology.orchestra.run.smithi070.stdout:2990 read 0x2a7e7e9 thru 0x2a7ff40 (0x1758 bytes) 2024-09-11T06:18:34.734 INFO:teuthology.orchestra.run.smithi070.stdout:2991 read 0x8d3fbfa thru 0x8d42f86 (0x338d bytes) 2024-09-11T06:18:34.735 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.742 INFO:teuthology.orchestra.run.smithi070.stdout:2993 writesame 0xda7acb3 thru 0xda80147 data_size 0x1(0x5495 bytes) 2024-09-11T06:18:34.743 INFO:teuthology.orchestra.run.smithi070.stdout:2994 read 0xbf96c52 thru 0xbfa2fd8 (0xc387 bytes) 2024-09-11T06:18:34.744 INFO:teuthology.orchestra.run.smithi070.stdout:2995 write 0xd42cef3 thru 0xd43c5ad (0xf6bb bytes) 2024-09-11T06:18:34.746 INFO:teuthology.orchestra.run.smithi070.stdout:2996 punch from 0x175ca30 to 0x176139b, (0x496b bytes) 2024-09-11T06:18:34.746 INFO:teuthology.orchestra.run.smithi070.stdout:2998 read 0xda15c8 thru 0xda9825 (0x825e bytes) 2024-09-11T06:18:34.746 INFO:teuthology.orchestra.run.smithi070.stdout:2999 writesame 0x23e0845 thru 0x23e5b39 data_size 0x1(0x52f5 bytes) 2024-09-11T06:18:34.757 INFO:teuthology.orchestra.run.smithi070.stdout:3000 read 0x80ae4d2 thru 0x80b3191 (0x4cc0 bytes) 2024-09-11T06:18:34.757 INFO:teuthology.orchestra.run.smithi070.stdout:3001 punch from 0x491cc95 to 0x4927d59, (0xb0c4 bytes) 2024-09-11T06:18:34.758 INFO:teuthology.orchestra.run.smithi070.stdout:3002 write 0xc8e0c9e thru 0xc8ea65e (0x99c1 bytes) 2024-09-11T06:18:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:34.767 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:34.774 INFO:teuthology.orchestra.run.smithi070.stdout:3003 trunc from 0xda80148 to 0x2fcee0c 2024-09-11T06:18:34.783 INFO:teuthology.orchestra.run.smithi070.stdout:3004 punch from 0x19d9ff4 to 0x19e8004, (0xe010 bytes) 2024-09-11T06:18:34.783 INFO:teuthology.orchestra.run.smithi070.stdout:3005 punch from 0x2a432a3 to 0x2a4c199, (0x8ef6 bytes) 2024-09-11T06:18:34.783 INFO:teuthology.orchestra.run.smithi070.stdout:3006 write 0x180482e thru 0x181464d (0xfe20 bytes) 2024-09-11T06:18:34.785 INFO:teuthology.orchestra.run.smithi070.stdout:3007 write 0x3dfde8 thru 0x3e27ee (0x2a07 bytes) 2024-09-11T06:18:34.791 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:34.791 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:34.793 INFO:teuthology.orchestra.run.smithi070.stdout:3008 write 0x4012421 thru 0x4017164 (0x4d44 bytes) 2024-09-11T06:18:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:3011 read 0x197599c thru 0x197e0d8 (0x873d bytes) 2024-09-11T06:18:34.808 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:34.808 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:34.808 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:34.806+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:34.813 INFO:teuthology.orchestra.run.smithi070.stdout:3012 write 0xe32c0fa thru 0xe3313f5 (0x52fc bytes) 2024-09-11T06:18:34.816 INFO:teuthology.orchestra.run.smithi070.stdout:3014 punch from 0xc1cdd5c to 0xc1cfd44, (0x1fe8 bytes) 2024-09-11T06:18:34.816 INFO:teuthology.orchestra.run.smithi070.stdout:3015 write 0x97bf2ec thru 0x97c3558 (0x426d bytes) 2024-09-11T06:18:34.817 INFO:teuthology.orchestra.run.smithi070.stdout:3016 read 0xca39306 thru 0xca456c7 (0xc3c2 bytes) 2024-09-11T06:18:34.818 INFO:teuthology.orchestra.run.smithi070.stdout:3017 punch from 0x6788dfd to 0x6791271, (0x8474 bytes) 2024-09-11T06:18:34.818 INFO:teuthology.orchestra.run.smithi070.stdout:3022 read 0x668ef83 thru 0x6692d96 (0x3e14 bytes) 2024-09-11T06:18:34.818 INFO:teuthology.orchestra.run.smithi070.stdout:3023 read 0x4cf9a60 thru 0x4d091f4 (0xf795 bytes) 2024-09-11T06:18:34.819 INFO:teuthology.orchestra.run.smithi070.stdout:3025 writesame 0x8c157b7 thru 0x8c17da7 data_size 0x1(0x25f1 bytes) 2024-09-11T06:18:34.822 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:34.822 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:34.822 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:34.824 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:34.825 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:34.828 INFO:teuthology.orchestra.run.smithi070.stdout:3026 trunc from 0xe3313f6 to 0x9f6dbac 2024-09-11T06:18:34.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:34.844 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:34.844 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:34.846 INFO:teuthology.orchestra.run.smithi070.stdout:3028 write 0xaa40f8a thru 0xaa49f3c (0x8fb3 bytes) 2024-09-11T06:18:34.847 INFO:teuthology.orchestra.run.smithi070.stdout:3032 writesame 0x738bb1 thru 0x747f52 data_size 0x9a(0xf3a2 bytes) 2024-09-11T06:18:34.849 INFO:teuthology.orchestra.run.smithi070.stdout:3033 read 0x789299c thru 0x78995bc (0x6c21 bytes) 2024-09-11T06:18:34.850 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:3039 trunc from 0xaa49f3d to 0x8db75dd 2024-09-11T06:18:34.860 INFO:teuthology.orchestra.run.smithi070.stdout:3040 read 0x5d77372 thru 0x5d7f79d (0x842c bytes) 2024-09-11T06:18:34.862 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:34.863 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:34.873 INFO:teuthology.orchestra.run.smithi070.stdout:3042 writesame 0xe6cfb16 thru 0xe6d5c85 data_size 0x8(0x6170 bytes) 2024-09-11T06:18:34.873 INFO:teuthology.orchestra.run.smithi070.stdout:3043 write 0xda88c74 thru 0xda90bea (0x7f77 bytes) 2024-09-11T06:18:34.874 INFO:teuthology.orchestra.run.smithi070.stdout:3044 write 0xbe4982b thru 0xbe4a1ef (0x9c5 bytes) 2024-09-11T06:18:34.876 INFO:teuthology.orchestra.run.smithi070.stdout:3045 read 0xa96db47 thru 0xa96df10 (0x3ca bytes) 2024-09-11T06:18:34.876 INFO:teuthology.orchestra.run.smithi070.stdout:3047 read 0xd9e2e36 thru 0xd9ebd85 (0x8f50 bytes) 2024-09-11T06:18:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:3048 punch from 0x936da36 to 0x93716d7, (0x3ca1 bytes) 2024-09-11T06:18:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:3049 write 0xc57b216 thru 0xc584361 (0x914c bytes) 2024-09-11T06:18:34.881 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:34.881 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:34.887 INFO:teuthology.orchestra.run.smithi070.stdout:3051 trunc from 0xe6d5c86 to 0x69b05a4 2024-09-11T06:18:34.896 INFO:teuthology.orchestra.run.smithi070.stdout:3052 punch from 0x63abc25 to 0x63b8983, (0xcd5e bytes) 2024-09-11T06:18:34.896 INFO:teuthology.orchestra.run.smithi070.stdout:3053 punch from 0x20e16f5 to 0x20ed5ea, (0xbef5 bytes) 2024-09-11T06:18:34.896 INFO:teuthology.orchestra.run.smithi070.stdout:3055 writesame 0x1e7c718 thru 0x1e81b08 data_size 0x39(0x53f1 bytes) 2024-09-11T06:18:34.897 INFO:teuthology.orchestra.run.smithi070.stdout:3057 writesame 0x1f890af thru 0x1f91eae data_size 0x80(0x8e00 bytes) 2024-09-11T06:18:34.899 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.901 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:34.901 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:34.903 INFO:teuthology.orchestra.run.smithi070.stdout:3059 trunc from 0x69b05a4 to 0xa3e90a4 2024-09-11T06:18:34.909 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:34.908+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:34.909 INFO:teuthology.orchestra.run.smithi070.stdout:3061 read 0x4f7a3af thru 0x4f7d6bc (0x330e bytes) 2024-09-11T06:18:34.909 INFO:teuthology.orchestra.run.smithi070.stdout:3062 punch from 0x95d07fc to 0x95d0f7b, (0x77f bytes) 2024-09-11T06:18:34.909 INFO:teuthology.orchestra.run.smithi070.stdout:3064 write 0x6abe4e9 thru 0x6ac61ac (0x7cc4 bytes) 2024-09-11T06:18:34.911 INFO:teuthology.orchestra.run.smithi070.stdout:3067 write 0x6f02899 thru 0x6f06dc3 (0x452b bytes) 2024-09-11T06:18:34.920 INFO:teuthology.orchestra.run.smithi070.stdout:3068 writesame 0xbc0a0aa thru 0xbc193d4 data_size 0x1(0xf32b bytes) 2024-09-11T06:18:34.931 INFO:teuthology.orchestra.run.smithi070.stdout:3069 writesame 0xec1970c thru 0xec1f994 data_size 0x5(0x6289 bytes) 2024-09-11T06:18:34.931 INFO:teuthology.orchestra.run.smithi070.stdout:3070 read 0xa0b8abe thru 0xa0c6a16 (0xdf59 bytes) 2024-09-11T06:18:34.931 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.932 INFO:teuthology.orchestra.run.smithi070.stdout:3073 write 0xe6dc7dc thru 0xe6de58e (0x1db3 bytes) 2024-09-11T06:18:34.935 INFO:teuthology.orchestra.run.smithi070.stdout:3074 write 0x8920fba thru 0x8929c89 (0x8cd0 bytes) 2024-09-11T06:18:34.937 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:34.937 INFO:teuthology.orchestra.run.smithi070.stdout:3076 write 0x6abfb3 thru 0x6ad3b3 (0x1401 bytes) 2024-09-11T06:18:34.938 INFO:teuthology.orchestra.run.smithi070.stdout:3078 read 0x34746dc thru 0x347e090 (0x99b5 bytes) 2024-09-11T06:18:34.939 INFO:teuthology.orchestra.run.smithi070.stdout:3079 read 0x3e5c3fc thru 0x3e61937 (0x553c bytes) 2024-09-11T06:18:34.939 INFO:teuthology.orchestra.run.smithi070.stdout:3080 read 0x2b893e4 thru 0x2b904e3 (0x7100 bytes) 2024-09-11T06:18:34.940 INFO:teuthology.orchestra.run.smithi070.stdout:3081 write 0x6fb35bd thru 0x6fb3bc7 (0x60b bytes) 2024-09-11T06:18:34.941 INFO:teuthology.orchestra.run.smithi070.stdout:3082 read 0xbd531c5 thru 0xbd562a3 (0x30df bytes) 2024-09-11T06:18:34.941 INFO:teuthology.orchestra.run.smithi070.stdout:3083 read 0x2b0c657 thru 0x2b1ac3a (0xe5e4 bytes) 2024-09-11T06:18:34.950 INFO:teuthology.orchestra.run.smithi070.stdout:3084 trunc from 0xec1f995 to 0x74b9fa0 2024-09-11T06:18:34.966 INFO:teuthology.orchestra.run.smithi070.stdout:3085 punch from 0x178285 to 0x17a0f6, (0x1e71 bytes) 2024-09-11T06:18:34.966 INFO:teuthology.orchestra.run.smithi070.stdout:3086 read 0x330408d thru 0x331144c (0xd3c0 bytes) 2024-09-11T06:18:34.973 INFO:teuthology.orchestra.run.smithi070.stdout:3088 writesame 0x7f54ad3 thru 0x7f61cde data_size 0x6(0xd20c bytes) 2024-09-11T06:18:34.976 INFO:teuthology.orchestra.run.smithi070.stdout:3090 read 0x6ef97e7 thru 0x6f035b4 (0x9dce bytes) 2024-09-11T06:18:34.977 INFO:teuthology.orchestra.run.smithi070.stdout:3091 read 0x551d733 thru 0x551f31c (0x1bea bytes) 2024-09-11T06:18:34.983 INFO:teuthology.orchestra.run.smithi070.stdout:3092 trunc from 0x7f61cdf to 0x1e75ff9 2024-09-11T06:18:34.988 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:34.988 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:34.998 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:35.006 INFO:teuthology.orchestra.run.smithi070.stdout:3093 write 0x7cb641a thru 0x7cbb42b (0x5012 bytes) 2024-09-11T06:18:35.008 INFO:teuthology.orchestra.run.smithi070.stdout:3094 write 0x53c4883 thru 0x53cb9f1 (0x716f bytes) 2024-09-11T06:18:35.019 INFO:teuthology.orchestra.run.smithi070.stdout:3095 writesame 0x9d7413d thru 0x9d775bc data_size 0x38(0x3480 bytes) 2024-09-11T06:18:35.020 INFO:teuthology.orchestra.run.smithi070.stdout:3096 read 0x184a16e thru 0x184df5f (0x3df2 bytes) 2024-09-11T06:18:35.020 INFO:teuthology.orchestra.run.smithi070.stdout:3099 writesame 0x76407b0 thru 0x7644c3e data_size 0x1(0x448f bytes) 2024-09-11T06:18:35.029 INFO:teuthology.orchestra.run.smithi070.stdout:3100 read 0x3b357e8 thru 0x3b36487 (0xca0 bytes) 2024-09-11T06:18:35.029 INFO:teuthology.orchestra.run.smithi070.stdout:3101 writesame 0x2396539 thru 0x2397f47 data_size 0x1(0x1a0f bytes) 2024-09-11T06:18:35.033 INFO:teuthology.orchestra.run.smithi070.stdout:3102 read 0x3f1be41 thru 0x3f26f69 (0xb129 bytes) 2024-09-11T06:18:35.033 INFO:teuthology.orchestra.run.smithi070.stdout:3104 read 0x4cb62d0 thru 0x4cc35fa (0xd32b bytes) 2024-09-11T06:18:35.034 INFO:teuthology.orchestra.run.smithi070.stdout:3106 read 0x29e7067 thru 0x29f69cf (0xf969 bytes) 2024-09-11T06:18:35.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:35.040+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:35.045 INFO:teuthology.orchestra.run.smithi070.stdout:3107 trunc from 0x9d775bd to 0x10e0b1 2024-09-11T06:18:35.065 INFO:teuthology.orchestra.run.smithi070.stdout:3108 read 0xe6cb0 thru 0xf10c4 (0xa415 bytes) 2024-09-11T06:18:35.066 INFO:teuthology.orchestra.run.smithi070.stdout:3109 read 0x10a323 thru 0x10e0b0 (0x3d8e bytes) 2024-09-11T06:18:35.067 INFO:teuthology.orchestra.run.smithi070.stdout:3113 punch from 0x33fac to 0x3863e, (0x4692 bytes) 2024-09-11T06:18:35.075 INFO:teuthology.orchestra.run.smithi070.stdout:3115 trunc from 0x10e0b1 to 0x6e4b5e1 2024-09-11T06:18:35.081 INFO:teuthology.orchestra.run.smithi070.stdout:3118 write 0x1f0a7fa thru 0x1f179bb (0xd1c2 bytes) 2024-09-11T06:18:35.086 INFO:teuthology.orchestra.run.smithi070.stdout:3119 writesame 0x13ff057 thru 0x140b2bb data_size 0x25(0xc265 bytes) 2024-09-11T06:18:35.087 INFO:teuthology.orchestra.run.smithi070.stdout:3120 write 0x2ffd140 thru 0x3006778 (0x9639 bytes) 2024-09-11T06:18:35.094 INFO:teuthology.orchestra.run.smithi070.stdout:3123 writesame 0x70eed10 thru 0x70f3f6e data_size 0x21(0x525f bytes) 2024-09-11T06:18:35.104 INFO:teuthology.orchestra.run.smithi070.stdout:3124 write 0x9486970 thru 0x9488ebd (0x254e bytes) 2024-09-11T06:18:35.108 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:35.108 INFO:teuthology.orchestra.run.smithi070.stdout:3126 read 0x894da94 thru 0x8958081 (0xa5ee bytes) 2024-09-11T06:18:35.108 INFO:teuthology.orchestra.run.smithi070.stdout:3127 read 0x64e1533 thru 0x64ed5f0 (0xc0be bytes) 2024-09-11T06:18:35.108 INFO:teuthology.orchestra.run.smithi070.stdout:3130 read 0x3d5454a thru 0x3d58c2c (0x46e3 bytes) 2024-09-11T06:18:35.110 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:35.110+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:35.111 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:35.111 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:35.116 INFO:teuthology.orchestra.run.smithi070.stdout:3134 trunc from 0x9488ebe to 0x31490f6 2024-09-11T06:18:35.120 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:35.124 INFO:teuthology.orchestra.run.smithi070.stdout:3135 read 0xb086a1 thru 0xb1090c (0x826c bytes) 2024-09-11T06:18:35.144 INFO:teuthology.orchestra.run.smithi070.stdout:3136 writesame 0xe2d039e thru 0xe2d7d52 data_size 0x1(0x79b5 bytes) 2024-09-11T06:18:35.145 INFO:teuthology.orchestra.run.smithi070.stdout:3138 punch from 0x1fc716b to 0x1fc7d3d, (0xbd2 bytes) 2024-09-11T06:18:35.145 INFO:teuthology.orchestra.run.smithi070.stdout:3139 punch from 0x3fa7c20 to 0x3fa895b, (0xd3b bytes) 2024-09-11T06:18:35.150 INFO:teuthology.orchestra.run.smithi070.stdout:3141 write 0xe677323 thru 0xe6775df (0x2bd bytes) 2024-09-11T06:18:35.153 INFO:teuthology.orchestra.run.smithi070.stdout:3142 read 0x5982e0b thru 0x598b502 (0x86f8 bytes) 2024-09-11T06:18:35.154 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:35.154 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:35.154 INFO:teuthology.orchestra.run.smithi070.stdout:3149 write 0x9dba93a thru 0x9dc6909 (0xbfd0 bytes) 2024-09-11T06:18:35.155 INFO:teuthology.orchestra.run.smithi070.stdout:3150 punch from 0x20d048e to 0x20d6467, (0x5fd9 bytes) 2024-09-11T06:18:35.155 INFO:teuthology.orchestra.run.smithi070.stdout:3151 read 0x71d8f24 thru 0x71e0d96 (0x7e73 bytes) 2024-09-11T06:18:35.156 INFO:teuthology.orchestra.run.smithi070.stdout:3152 writesame 0x206964d thru 0x2070f3b data_size 0x1(0x78ef bytes) 2024-09-11T06:18:35.173 INFO:teuthology.orchestra.run.smithi070.stdout:3155 trunc from 0xe6775e0 to 0xc6c4ae1 2024-09-11T06:18:35.187 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:35.187 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:35.196 INFO:teuthology.orchestra.run.smithi070.stdout:3159 write 0xec072b9 thru 0xec16c1f (0xf967 bytes) 2024-09-11T06:18:35.199 INFO:teuthology.orchestra.run.smithi070.stdout:3160 write 0xc49ae8c thru 0xc4a4268 (0x93dd bytes) 2024-09-11T06:18:35.201 INFO:teuthology.orchestra.run.smithi070.stdout:3161 writesame 0xbbb2f84 thru 0xbbbdb1e data_size 0x1(0xab9b bytes) 2024-09-11T06:18:35.211 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:35.209+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:35.221 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:35.221 INFO:teuthology.orchestra.run.smithi070.stdout:3163 writesame 0xb697c75 thru 0xb6a545d data_size 0x1(0xd7e9 bytes) 2024-09-11T06:18:35.238 INFO:teuthology.orchestra.run.smithi070.stdout:3164 writesame 0x6db91f3 thru 0x6db923a data_size 0x1(0x48 bytes) 2024-09-11T06:18:35.247 INFO:teuthology.orchestra.run.smithi070.stdout:3165 trunc from 0xec16c20 to 0x9f39246 2024-09-11T06:18:35.270 INFO:teuthology.orchestra.run.smithi070.stdout:3169 trunc from 0x9f39246 to 0x13429b7 2024-09-11T06:18:35.274 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:35.275 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:35.278 INFO:teuthology.orchestra.run.smithi070.stdout:3170 read 0x47d724 thru 0x48a509 (0xcde6 bytes) 2024-09-11T06:18:35.279 INFO:teuthology.orchestra.run.smithi070.stdout:3171 read 0xce4c6 thru 0xcf0ab (0xbe6 bytes) 2024-09-11T06:18:35.284 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:35.287 INFO:teuthology.orchestra.run.smithi070.stdout:3173 write 0x2a384f4 thru 0x2a39b20 (0x162d bytes) 2024-09-11T06:18:35.296 INFO:teuthology.orchestra.run.smithi070.stdout:3174 writesame 0x3f71de3 thru 0x3f77d11 data_size 0x7(0x5f2f bytes) 2024-09-11T06:18:35.297 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:35.310 INFO:teuthology.orchestra.run.smithi070.stdout:3176 writesame 0xa9d15f1 thru 0xa9d2701 data_size 0x1(0x1111 bytes) 2024-09-11T06:18:35.311 INFO:teuthology.orchestra.run.smithi070.stdout:3177 punch from 0x10a8a58 to 0x10a95a9, (0xb51 bytes) 2024-09-11T06:18:35.318 INFO:teuthology.orchestra.run.smithi070.stdout:3178 write 0xbbac831 thru 0xbbad341 (0xb11 bytes) 2024-09-11T06:18:35.320 INFO:teuthology.orchestra.run.smithi070.stdout:3179 write 0x2be66ce thru 0x2beb0d1 (0x4a04 bytes) 2024-09-11T06:18:35.321 INFO:teuthology.orchestra.run.smithi070.stdout:3181 write 0x905c9a2 thru 0x90642ad (0x790c bytes) 2024-09-11T06:18:35.323 INFO:teuthology.orchestra.run.smithi070.stdout:3182 read 0x9bcd9af thru 0x9bd1321 (0x3973 bytes) 2024-09-11T06:18:35.323 INFO:teuthology.orchestra.run.smithi070.stdout:3184 clone 23 order 22 su 65536 sc 5 2024-09-11T06:18:35.325 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:35.323+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:35.413 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:35.411+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:35.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:18:35.429 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:35.429 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:35.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:35.514 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:35.513+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:35.584 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:35.584 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:35.593 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:35.636 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:35.635+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:35.696 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:35.696 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:35.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:35.715 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:35.714+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:35.816 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:35.814+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:35.848 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:35.849 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:35.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:35.917 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:35.916+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:35.961 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:35.961 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:35.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:36.017 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:36.016+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:36.111 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:36.111 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:36.116 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 6, 7, 1] 2024-09-11T06:18:36.116 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:18:36.116 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 2, 3, 4, 5, 6, 7, 1] 2024-09-11T06:18:36.116 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T06:18:36.116 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:18:36.119 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:36.118+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:36.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:36.155 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T06:18:36.156 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.2 2024-09-11T06:18:36.156 INFO:tasks.thrashosds.thrasher:remote for osd 2 is ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:18:36.156 DEBUG:teuthology.orchestra.run.smithi070:> type ceph-objectstore-tool 2024-09-11T06:18:36.211 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T06:18:36.212 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op list-pgs 2024-09-11T06:18:36.219 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:36.218+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:36.301 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:36.301 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:36.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:36.320 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:36.319+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:18:36.415 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:36.415 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:36.421 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:36.420+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:36.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:36.522 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:36.521+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:36.571 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:36.571 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:36.580 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:36.623 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:36.621+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:36.723 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:36.722+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:36.725 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:36.725 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:36.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:36.825 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:36.824+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:36.836 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:36.836 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:36.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:36.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:36.951 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:36.951 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:36.951 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:36.950+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:36.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:37.027 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:37.025+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:37.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:37.062 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:37.063 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:37.063 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:37.079 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:37.079 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:37.096 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:37.112 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:37.112 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:37.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:37.112 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:37.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:37.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:37.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 97.490826036000001, 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:37.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:37.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 97.196390457999996, 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:37.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:37.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.929827264, 2024-09-11T06:18:37.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:18:37.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:18:37.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63576 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.927613499, 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053575987999999998, 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63576 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182844+0000", 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182850+0000", 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9970000000000004e-06 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182854+0000", 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1829999999999996e-06 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235811+0000", 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052956403999999999 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235933+0000", 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012229799999999999 2024-09-11T06:18:37.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236418+0000", 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048509399999999999 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63577 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:37.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.927594579000001, 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053525649000000002, 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63577 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.22e-07 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182863+0000", 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9e-06 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182876+0000", 2024-09-11T06:18:37.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.311e-05 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182887+0000", 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1109e-05 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236375+0000", 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053487499000000001 2024-09-11T06:18:37.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236387+0000", 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1708999999999999e-05 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63578 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.927551072, 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053516941999999998, 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63578 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182905+0000", 2024-09-11T06:18:37.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182908+0000", 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6249999999999999e-06 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182915+0000", 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.525e-06 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182921+0000", 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.48e-06 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236412+0000", 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053491483999999999 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236421+0000", 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63579 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.927478539999999, 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053483819000000002, 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63579 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182978+0000", 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.99e-07 2024-09-11T06:18:37.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182980+0000", 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182988+0000", 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182995+0000", 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0129999999999996e-06 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236448+0000", 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053452983000000003 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236461+0000", 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2865e-05 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63580 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.927452062, 2024-09-11T06:18:37.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053488579000000001, 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63580 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183004+0000", 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183006+0000", 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0650000000000001e-06 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183013+0000", 2024-09-11T06:18:37.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183018+0000", 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236482+0000", 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053463869999999997 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236492+0000", 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0471e-05 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90636 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 145408~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:37.157 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.966309313, 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053568440000000002, 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90636 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144147+0000", 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144148+0000", 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144154+0000", 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4990000000000002e-06 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144158+0000", 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3680000000000004e-06 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197315+0000", 2024-09-11T06:18:37.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05315698 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197352+0000", 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6510000000000001e-05 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197715+0000", 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036306199999999999 2024-09-11T06:18:37.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90637 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9662923389999998, 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053721428000000002, 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90637 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144165+0000", 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144171+0000", 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2909999999999998e-06 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144175+0000", 2024-09-11T06:18:37.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0029999999999996e-06 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197740+0000", 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053565861999999999 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197779+0000", 2024-09-11T06:18:37.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8339e-05 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197885+0000", 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105807 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90638 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.966275209, 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053925155000000002, 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90638 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144181+0000", 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144183+0000", 2024-09-11T06:18:37.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9479999999999998e-06 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144188+0000", 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4709999999999998e-06 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144193+0000", 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7040000000000002e-06 2024-09-11T06:18:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197927+0000", 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053734188000000002 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197993+0000", 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5839000000000004e-05 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198105+0000", 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011268 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90639 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9662568, 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054132671, 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90639 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144201+0000", 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T06:18:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144207+0000", 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0510000000000002e-06 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144212+0000", 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198160+0000", 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053948788999999997 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198221+0000", 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0395e-05 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198331+0000", 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110541 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90640 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9662384419999999, 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054316443999999998, 2024-09-11T06:18:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90640 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3099999999999999e-07 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144219+0000", 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7549999999999999e-06 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144224+0000", 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2839999999999997e-06 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144229+0000", 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4549999999999997e-06 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198363+0000", 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054134045999999998 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198417+0000", 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198534+0000", 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116767 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90641 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9662215419999995, 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534245000000002, 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90641 2024-09-11T06:18:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0499999999999999e-07 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144236+0000", 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144242+0000", 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5210000000000002e-06 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144253+0000", 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1297e-05 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198574+0000", 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054321665999999998 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198647+0000", 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2031000000000002e-05 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198768+0000", 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121703 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90642 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9661968620000003, 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054727525999999999, 2024-09-11T06:18:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90642 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144261+0000", 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144267+0000", 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7749999999999998e-06 2024-09-11T06:18:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144271+0000", 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5399999999999997e-06 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198806+0000", 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534816999999999 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198867+0000", 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0776999999999998e-05 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198986+0000", 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119203 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90643 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9661788329999998, 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054909368, 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90643 2024-09-11T06:18:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144279+0000", 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.801e-06 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144284+0000", 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.451e-06 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144289+0000", 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199018+0000", 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054728994000000003 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199072+0000", 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3705999999999997e-05 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199186+0000", 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114521 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90644 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9661616459999998, 2024-09-11T06:18:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055086361, 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90644 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144296+0000", 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.728e-06 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144301+0000", 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4009999999999996e-06 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144306+0000", 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4159999999999997e-06 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199216+0000", 2024-09-11T06:18:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054910051000000001 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199269+0000", 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3341000000000003e-05 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199380+0000", 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111103 2024-09-11T06:18:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9661446729999996, 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:18:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9661272470000002, 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.9661099909999997, 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:18:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:18:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:18:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:37.227 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:37.228 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:37.229 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:37.230 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:37.230 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:37.228+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:37.330 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:37.329+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:37.332 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:37.332 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:37.346 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:37.346 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:37.347 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:37.347 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:37.349 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:37.349 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:37.352 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:37.352 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:37.356 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:37.432 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:37.430+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:37.479 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:37.479 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:37.479 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:37.479 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:37.479 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:37.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:37.533 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:37.531+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:37.633 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:37.632+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 78.317263490000002, 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.635 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:37.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:37.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.004690272000005, 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68256 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.171860316, 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018100349000000002, 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68256 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461407+0000", 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6800000000000001e-07 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461416+0000", 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8409999999999995e-06 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461422+0000", 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.806e-06 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461427+0000", 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5040000000000004e-06 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479297+0000", 2024-09-11T06:18:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017870381000000001 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479385+0000", 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7690999999999998e-05 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479506+0000", 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012165800000000001 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68257 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.171831848, 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018398100000000001, 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68257 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999995e-07 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461437+0000", 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2740000000000002e-06 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461444+0000", 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6769999999999998e-06 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461450+0000", 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7810000000000002e-06 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479581+0000", 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018131278000000001 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479687+0000", 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105931 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479833+0000", 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014557200000000001 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68258 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 311296~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.17181079, 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01871913, 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68258 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.32e-07 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461464+0000", 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461470+0000", 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1120000000000001e-06 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461475+0000", 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7199999999999997e-06 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479865+0000", 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018390118 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480028+0000", 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016266800000000001 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480175+0000", 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147236 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68259 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 339968~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.171786329, 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018993309999999999, 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68259 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461481+0000", 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6499999999999999e-07 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461483+0000", 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461488+0000", 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5319999999999997e-06 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461493+0000", 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.634e-06 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480206+0000", 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018713032000000001 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480367+0000", 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016139799999999999 2024-09-11T06:18:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480473+0000", 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106346 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68260 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 380928~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.17176813, 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019218077, 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68260 2024-09-11T06:18:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461499+0000", 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461501+0000", 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7600000000000001e-06 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461506+0000", 2024-09-11T06:18:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7989999999999999e-06 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461511+0000", 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480510+0000", 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018999095000000001 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480604+0000", 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3795000000000006e-05 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480716+0000", 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112389 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68326 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.171333484, 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019001186999999999, 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68326 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9299999999999998e-07 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461935+0000", 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461941+0000", 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461947+0000", 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9519999999999999e-06 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480755+0000", 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018807739 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480838+0000", 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3145000000000004e-05 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480934+0000", 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6009999999999997e-05 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68343 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.171296198, 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019314591999999998, 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68343 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461971+0000", 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461977+0000", 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0950000000000001e-06 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461982+0000", 2024-09-11T06:18:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2950000000000001e-06 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461986+0000", 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9779999999999999e-06 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480964+0000", 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01897832 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481041+0000", 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6755000000000006e-05 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481285+0000", 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000243804 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68352 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.171234852, 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019458092, 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68352 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4099999999999999e-07 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462034+0000", 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.725e-06 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462040+0000", 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462044+0000", 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4619999999999998e-06 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481326+0000", 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281586999999999 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481420+0000", 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3727000000000006e-05 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481490+0000", 2024-09-11T06:18:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0174999999999998e-05 2024-09-11T06:18:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68369 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.171195068999999, 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019575028000000001, 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68369 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462072+0000", 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9399999999999995e-07 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462074+0000", 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.711e-06 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462080+0000", 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-06 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462084+0000", 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5279999999999997e-06 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481519+0000", 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019434165 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481575+0000", 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6489000000000001e-05 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481646+0000", 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1271000000000003e-05 2024-09-11T06:18:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:110494 3.1b 3:db2012be:::rbd_data.116d6837dfb5.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 2.9444480660000001, 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026675217000000001, 2024-09-11T06:18:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 110494 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688819+0000", 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4399999999999999e-07 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688823+0000", 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7699999999999999e-06 2024-09-11T06:18:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688831+0000", 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6820000000000003e-06 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688835+0000", 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1980000000000003e-06 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688876+0000", 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1313999999999998e-05 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688932+0000", 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5559000000000001e-05 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.693699+0000", 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004767238 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715356+0000", 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021657342 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715375+0000", 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9241000000000001e-05 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715435+0000", 2024-09-11T06:18:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9509000000000002e-05 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715494+0000", 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8619999999999998e-05 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111656 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 1900544~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.196172718, 2024-09-11T06:18:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017837603, 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111656 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437096+0000", 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437103+0000", 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3860000000000004e-06 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437108+0000", 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2750000000000003e-06 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454788+0000", 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017679812999999999 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454836+0000", 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7882e-05 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454931+0000", 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5673000000000004e-05 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111657 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.19613857300000001, 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018066136, 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111657 2024-09-11T06:18:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437132+0000", 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2310000000000001e-06 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437141+0000", 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2539999999999998e-06 2024-09-11T06:18:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437147+0000", 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.19e-06 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454968+0000", 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017820722000000001 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455050+0000", 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1954999999999997e-05 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455194+0000", 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014418499999999999 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111658 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2555904~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.19610989100000001, 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018208022000000001, 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111658 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437160+0000", 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7250000000000002e-06 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437167+0000", 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7669999999999998e-06 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437172+0000", 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2830000000000001e-06 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455224+0000", 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018051851000000001 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455271+0000", 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7277999999999997e-05 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455365+0000", 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3572000000000005e-05 2024-09-11T06:18:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111659 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2752512~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.196088138, 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018392750999999999, 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111659 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437179+0000", 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437181+0000", 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437187+0000", 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-11T06:18:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437192+0000", 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455406+0000", 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018214088 2024-09-11T06:18:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455460+0000", 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3782000000000001e-05 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455571+0000", 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011140499999999999 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111665 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 1769472~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.19606844200000001, 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018690556000000001, 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111665 2024-09-11T06:18:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437200+0000", 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437207+0000", 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3759999999999996e-06 2024-09-11T06:18:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437212+0000", 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1410000000000004e-06 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455621+0000", 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018408620000000001 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455715+0000", 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4238000000000001e-05 2024-09-11T06:18:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455889+0000", 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173769 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111666 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 1966080~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.19604833299999999, 2024-09-11T06:18:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018930618, 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111666 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437219+0000", 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437221+0000", 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9709999999999998e-06 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437227+0000", 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.268e-06 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437232+0000", 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1490000000000002e-06 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455924+0000", 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018692200999999999 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456003+0000", 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8368999999999995e-05 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456149+0000", 2024-09-11T06:18:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014622999999999999 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111667 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.19602853000000001, 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019219610000000002, 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111667 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437245+0000", 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1049999999999997e-06 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437252+0000", 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9399999999999996e-06 2024-09-11T06:18:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437258+0000", 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3639999999999998e-06 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456202+0000", 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018944427999999999 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456295+0000", 2024-09-11T06:18:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3268000000000002e-05 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456458+0000", 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016213100000000001 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111668 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 2621440~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.19600225299999999, 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019372776000000001, 2024-09-11T06:18:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111668 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437265+0000", 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437267+0000", 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.069e-06 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437273+0000", 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3690000000000003e-06 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437278+0000", 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.169e-06 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456496+0000", 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019217304000000001 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456547+0000", 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1004000000000002e-05 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456637+0000", 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0402000000000006e-05 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:37.731 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:37.732 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:37.734 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:37.733+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:37.837 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:37.837 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:37.838 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:37.835+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:37.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:37.938 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:37.937+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.f 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.e 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.3 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.1 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.1e 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.16 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.2 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.14 2024-09-11T06:18:37.954 INFO:teuthology.orchestra.run.smithi070.stdout:3.11 2024-09-11T06:18:37.955 INFO:teuthology.orchestra.run.smithi070.stdout:3.5 2024-09-11T06:18:37.955 INFO:teuthology.orchestra.run.smithi070.stdout:2.3 2024-09-11T06:18:37.988 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:37.988 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:37.988 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:37.988 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:37.988 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:37.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:38.042 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:38.041+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:38.142 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:38.140+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:38.144 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:38.144 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29679 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3260416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706889410999999, 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025777099000000001, 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29679 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436323+0000", 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0079999999999999e-06 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436326+0000", 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436329+0000", 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461989+0000", 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025660388999999999 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462029+0000", 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9854000000000002e-05 2024-09-11T06:18:38.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462099+0000", 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0167999999999996e-05 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29680 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3473408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706879893, 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025900241000000001, 2024-09-11T06:18:38.149 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29680 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436332+0000", 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1899999999999999e-07 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436333+0000", 2024-09-11T06:18:38.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.049e-06 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436336+0000", 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8830000000000002e-06 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436338+0000", 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4700000000000001e-06 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462122+0000", 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025784081 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462162+0000", 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9774999999999998e-05 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462232+0000", 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9764000000000005e-05 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29681 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3588096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706868335000003, 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026043075999999998, 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29681 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436344+0000", 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436348+0000", 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-06 2024-09-11T06:18:38.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436350+0000", 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462257+0000", 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025906966999999999 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462304+0000", 2024-09-11T06:18:38.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7448999999999999e-05 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462386+0000", 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.174e-05 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29682 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706858326000003, 2024-09-11T06:18:38.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026216950999999999, 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29682 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:38.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436354+0000", 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436357+0000", 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436360+0000", 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.464e-06 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462412+0000", 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026052230999999999 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462459+0000", 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7207999999999999e-05 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462570+0000", 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110968 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.162 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29683 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706848890000003, 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026370945, 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29683 2024-09-11T06:18:38.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436363+0000", 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436364+0000", 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436367+0000", 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436369+0000", 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5059999999999998e-06 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462606+0000", 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026237114999999998 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462653+0000", 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:18:38.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462733+0000", 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0605999999999994e-05 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29684 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706839283999997, 2024-09-11T06:18:38.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026632194000000001, 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29684 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436373+0000", 2024-09-11T06:18:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6899999999999996e-07 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436376+0000", 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9699999999999999e-06 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436379+0000", 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462758+0000", 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026378990000000001 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462846+0000", 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8641999999999996e-05 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463004+0000", 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015788 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29685 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706829769999999, 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026764263, 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29685 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.172 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:38.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436383+0000", 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436386+0000", 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436388+0000", 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6570000000000001e-06 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463023+0000", 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026634722 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463068+0000", 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5025999999999999e-05 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463146+0000", 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7729000000000001e-05 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29686 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706819781, 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026966905999999999, 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29686 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436393+0000", 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436396+0000", 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.915e-06 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436398+0000", 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463173+0000", 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026774703 2024-09-11T06:18:38.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463242+0000", 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9770000000000005e-05 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463358+0000", 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116038 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29687 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706810552999997, 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027120658999999998, 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29687 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436402+0000", 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436405+0000", 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8899999999999999e-06 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436407+0000", 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463391+0000", 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026983285999999999 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463433+0000", 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2481999999999997e-05 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463521+0000", 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8373000000000002e-05 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.184 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29688 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706801151999997, 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027291494999999999, 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.185 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29688 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436411+0000", 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-06 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436414+0000", 2024-09-11T06:18:38.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8940000000000002e-06 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436417+0000", 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5069999999999999e-06 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463562+0000", 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027144622 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463621+0000", 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9108999999999999e-05 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463702+0000", 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29689 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.189 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706791625000001, 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027435349000000001, 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29689 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:38.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436423+0000", 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436426+0000", 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0010000000000002e-06 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436429+0000", 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4739999999999999e-06 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463726+0000", 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027297482000000001 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463780+0000", 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3714000000000001e-05 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463855+0000", 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5278000000000007e-05 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29690 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706779812000001, 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027575023000000001, 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.194 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29690 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436433+0000", 2024-09-11T06:18:38.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436436+0000", 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8959999999999999e-06 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436438+0000", 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.514e-06 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463880+0000", 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027442151000000001 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463924+0000", 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3983000000000002e-05 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464007+0000", 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2274000000000005e-05 2024-09-11T06:18:38.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29691 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706769715, 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027733827999999999, 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29691 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:38.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436443+0000", 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.279e-06 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436446+0000", 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436449+0000", 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464034+0000", 2024-09-11T06:18:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027585492 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464082+0000", 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7444999999999997e-05 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464175+0000", 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3954000000000002e-05 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29692 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5439488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706759884999997, 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027927924, 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29692 2024-09-11T06:18:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436452+0000", 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436453+0000", 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1179999999999999e-06 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436456+0000", 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436458+0000", 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464214+0000", 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027755618999999999 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464266+0000", 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2354000000000001e-05 2024-09-11T06:18:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464379+0000", 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011328900000000001 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29693 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5554176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706750483, 2024-09-11T06:18:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028112022, 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29693 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436462+0000", 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.031e-06 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436465+0000", 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3230000000000002e-06 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436468+0000", 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4870000000000001e-06 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464414+0000", 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027946104999999999 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464468+0000", 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3637999999999997e-05 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464573+0000", 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105232 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29694 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5767168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706740541999999, 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028256073999999999, 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29694 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436472+0000", 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:18:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436475+0000", 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8870000000000001e-06 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436478+0000", 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464591+0000", 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028113171999999999 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464643+0000", 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950999999999998e-05 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464727+0000", 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4133000000000002e-05 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29695 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5881856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706730843999999, 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02845924, 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29695 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436482+0000", 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.111e-06 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436485+0000", 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436487+0000", 2024-09-11T06:18:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5859999999999999e-06 2024-09-11T06:18:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464762+0000", 2024-09-11T06:18:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028274773 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464848+0000", 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6269999999999999e-05 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464940+0000", 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1345e-05 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29696 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6094848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706721113999997, 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028603799999999999, 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29696 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436491+0000", 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.879999999999999e-07 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436494+0000", 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8339999999999999e-06 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436497+0000", 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.328e-06 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464970+0000", 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028473196999999999 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465017+0000", 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465094+0000", 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6606999999999993e-05 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29697 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6209536~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 49.706708499000001, 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028751832000000001, 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29697 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436504+0000", 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.319e-06 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436508+0000", 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2729999999999998e-06 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436510+0000", 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465125+0000", 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028614537999999998 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465174+0000", 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8965000000000003e-05 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465255+0000", 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0798999999999997e-05 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.799972015000002, 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:18:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.237 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:38.238 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:38.243 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:38.242+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:38.344 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:38.344+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:38.381 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:38.382 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:38.382 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:38.382 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:38.390 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:38.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:18:38.474 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:38.473+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:38.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op export --pgid 3.3 --file /var/log/ceph/exp.3.3.2 2024-09-11T06:18:38.495 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:38.495 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:38.495 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:38.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:38.548 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:38.546+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:38.568 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090282092999999, 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.618 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:18:38.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090263643999997, 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:18:38.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090232847000003, 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:18:38.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:18:38.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090213839, 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:18:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:18:38.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.636 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090195170999998, 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.637 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:18:38.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090173112000002, 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:18:38.641 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:18:38.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090154247999997, 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.645 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:18:38.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090134466999999, 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.650 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.650 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:18:38.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090115539000003, 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:18:38.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090075059, 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:18:38.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.090044949999999, 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.663 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:18:38.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087953753999997, 2024-09-11T06:18:38.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:18:38.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087876833000003, 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:18:38.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:18:38.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087852533000003, 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.676 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:38.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087817114000003, 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.680 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.683 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087799910000001, 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.684 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:18:38.687 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087783647000002, 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:18:38.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:38.692 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087766670000001, 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:38.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:18:38.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:38.696 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087750685000003, 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:38.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:38.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.087732715999998, 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.701 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:18:38.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:38.705 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:38.705 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:38.707 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3185 write 0x2f00188 thru 0x2f0451e (0x4397 bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3186 write 0xea1dc48 thru 0xea2ab8a (0xcf43 bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3187 write 0x41058fd thru 0x410d28b (0x798f bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3188 write 0x5bd1936 thru 0x5bde236 (0xc901 bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3190 write 0x951926f thru 0x951a752 (0x14e4 bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3192 read 0x935b553 thru 0x935d4d3 (0x1f81 bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3193 read 0xaeac3a3 thru 0xaeb6f20 (0xab7e bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3194 read 0xd177d thru 0xd7c81 (0x6505 bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3195 read 0x57e463d thru 0x57f0187 (0xbb4b bytes) 2024-09-11T06:18:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:3196 read 0x4bf6445 thru 0x4bfa412 (0x3fce bytes) 2024-09-11T06:18:38.709 INFO:teuthology.orchestra.run.smithi070.stdout:3198 writesame 0xe94e85b thru 0xe956bd7 data_size 0x1(0x837d bytes) 2024-09-11T06:18:38.709 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:38.705+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:38.710 INFO:teuthology.orchestra.run.smithi070.stdout:3199 trunc from 0xea2ab8b to 0x7984da6 2024-09-11T06:18:38.734 INFO:teuthology.orchestra.run.smithi070.stdout:3200 trunc from 0x7984da6 to 0xc48d284 2024-09-11T06:18:38.740 INFO:teuthology.orchestra.run.smithi070.stdout:3203 write 0x5c695de thru 0x5c6a1be (0xbe1 bytes) 2024-09-11T06:18:38.743 INFO:teuthology.orchestra.run.smithi070.stdout:3204 punch from 0x5df38c3 to 0x5dffe74, (0xc5b1 bytes) 2024-09-11T06:18:38.743 INFO:teuthology.orchestra.run.smithi070.stdout:3205 read 0x45e50da thru 0x45e8269 (0x3190 bytes) 2024-09-11T06:18:38.743 INFO:teuthology.orchestra.run.smithi070.stdout:3206 write 0x2c22d2c thru 0x2c23ef6 (0x11cb bytes) 2024-09-11T06:18:38.745 INFO:teuthology.orchestra.run.smithi070.stdout:3207 write 0xb0c79ac thru 0xb0cd414 (0x5a69 bytes) 2024-09-11T06:18:38.758 INFO:teuthology.orchestra.run.smithi070.stdout:3210 trunc from 0xc48d284 to 0x41bc2cf 2024-09-11T06:18:38.774 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:38.775 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:38.781 INFO:teuthology.orchestra.run.smithi070.stdout:3215 trunc from 0x41bc2cf to 0xa026230 2024-09-11T06:18:38.787 INFO:teuthology.orchestra.run.smithi070.stdout:3216 write 0x3a8328c thru 0x3a8a495 (0x720a bytes) 2024-09-11T06:18:38.796 INFO:teuthology.orchestra.run.smithi070.stdout:3217 trunc from 0xa026230 to 0x2d1f290 2024-09-11T06:18:38.806 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:38.805+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:38.810 INFO:teuthology.orchestra.run.smithi070.stdout:3219 punch from 0x73ae70 to 0x73bef7, (0x1087 bytes) 2024-09-11T06:18:38.829 INFO:teuthology.orchestra.run.smithi070.stdout:3220 write 0xeac69b5 thru 0xeaceb56 (0x81a2 bytes) 2024-09-11T06:18:38.841 INFO:teuthology.orchestra.run.smithi070.stdout:3221 trunc from 0xeaceb57 to 0x7d5d29b 2024-09-11T06:18:38.851 INFO:teuthology.orchestra.run.smithi070.stdout:3222 punch from 0x5265cb1 to 0x5273025, (0xd374 bytes) 2024-09-11T06:18:38.851 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:38.851 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:38.851 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:38.855 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:38.855 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:38.855 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:38.864 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:38.865 INFO:teuthology.orchestra.run.smithi070.stdout:3228 writesame 0xdda06c1 thru 0xddad83f data_size 0x65(0xd17f bytes) 2024-09-11T06:18:38.865 INFO:teuthology.orchestra.run.smithi070.stdout:3230 write 0x50c4493 thru 0x50c4e65 (0x9d3 bytes) 2024-09-11T06:18:38.867 INFO:teuthology.orchestra.run.smithi070.stdout:3231 read 0x7592a07 thru 0x75989f4 (0x5fee bytes) 2024-09-11T06:18:38.867 INFO:teuthology.orchestra.run.smithi070.stdout:3232 writesame 0x4cc9647 thru 0x4cd3808 data_size 0x29(0xa1c2 bytes) 2024-09-11T06:18:38.870 INFO:teuthology.orchestra.run.smithi070.stdout:3233 clone 24 order 22 su 65536 sc 9 2024-09-11T06:18:38.907 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:38.906+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:39.006 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:39.007 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:39.007 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:39.008 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:39.008+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:39.015 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:39.109 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:39.108+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:39.118 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:39.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877171023000002, 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:18:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:18:39.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877158285, 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:18:39.123 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:18:39.127 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877147151999999, 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:18:39.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:18:39.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:39.132 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877136563999997, 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:39.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:18:39.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:18:39.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877126068999999, 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:18:39.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.141 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877115756000002, 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:39.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:18:39.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877105213999997, 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:18:39.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:18:39.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877094907999997, 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:39.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877079330000001, 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.155 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:39.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.877060325000002, 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:18:39.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817530951999998, 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.164 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:18:39.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817512481000001, 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817493990999999, 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:18:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:18:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:18:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817476923000001, 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817458891999998, 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:18:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:18:39.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817436708000002, 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:18:39.185 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.189 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817418715999999, 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:18:39.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:18:39.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.194 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.194 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:39.194 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817401062000002, 2024-09-11T06:18:39.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:18:39.194 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.194 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.194 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817378146000003, 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:18:39.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:18:39.202 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.817359758000002, 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:18:39.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:39.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:39.207 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:39.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:39.210 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:39.209+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:39.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:39.309+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:39.314 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:39.314 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:39.314 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:39.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:39.353 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:39.411 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:39.410+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:39.426 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:39.427 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:39.427 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:39.433 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:18:39.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:39.494 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:39.494 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:39.512 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:39.512 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:39.512 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:39.513 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:39.511+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:39.528 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:39.528 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:39.545 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:39.545 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:39.562 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:39.562 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:39.578 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:39.578 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:39.591 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:39.591 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:39.595 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:39.598 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:39.599 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:39.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:39.642 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:39.641+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:39.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:39.713+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:39.745 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:39.745 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:39.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:39.814 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:39.813+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:39.855 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:39.856 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:39.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:39.916 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:39.915+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:39.968 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:39.968 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:39.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:40.016 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:40.015+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:40.080 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:40.080 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:40.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:40.133 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:40.132+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:40.196 INFO:teuthology.orchestra.run.smithi070.stderr:Exporting 3.3 info 3.3( v 108'486 (0'0,108'486] local-lis/les=24/25 n=31 ec=24/24 lis/c=24/24 les/c/f=25/25/0 sis=24) 2024-09-11T06:18:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c0acd335:::rbd_object_map.116d4d1f1cd7:head# 2024-09-11T06:18:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c0b121e8:::rbd_data.116dccfba5d9.000000000000015c:head# 2024-09-11T06:18:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head# 2024-09-11T06:18:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:head# 2024-09-11T06:18:40.214 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:40.214 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:40.214 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c16cc7b4:::rbd_data.116da678facf.0000000000000068:head# 2024-09-11T06:18:40.216 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c1c646d0:::rbd_data.116dccfba5d9.000000000000004f:head# 2024-09-11T06:18:40.216 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c231e28a:::rbd_data.116d3c8aaf0c.000000000000000a:head# 2024-09-11T06:18:40.217 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c2b1dd9b:::rbd_data.116da678facf.0000000000000004:head# 2024-09-11T06:18:40.218 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:40.217+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:40.219 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c30b80c9:::rbd_data.116d2cbdd9a2.0000000000000008:head# 2024-09-11T06:18:40.220 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c36bd5dc:::rbd_data.116d55772b3c.0000000000000001:head# 2024-09-11T06:18:40.222 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c37f48c3:::rbd_data.116dccfba5d9.0000000000000077:head# 2024-09-11T06:18:40.223 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:40.224 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c3d4448e:::rbd_object_map.116d770b822.0000000000000013:head# 2024-09-11T06:18:40.224 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c41dfaaf:::rbd_data.116d3c8aaf0c.00000000000000a3:head# 2024-09-11T06:18:40.225 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c4378e7e:::rbd_header.116d3c8aaf0c:head# 2024-09-11T06:18:40.225 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c47604ed:::rbd_data.116d51ead02d.0000000000000000:head# 2024-09-11T06:18:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c4a301d3:::rbd_data.116d419b7418.0000000000000032:head# 2024-09-11T06:18:40.229 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c4d1128f:::rbd_object_map.116df69fa911.0000000000000007:head# 2024-09-11T06:18:40.229 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c5337e78:::rbd_data.116dc3b5629f.000000000000003e:head# 2024-09-11T06:18:40.229 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c547be65:::rbd_data.116dccfba5d9.00000000000000c7:head# 2024-09-11T06:18:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c54891f8:::rbd_object_map.116de94696bd.0000000000000017:head# 2024-09-11T06:18:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c5509ed4:::rbd_data.116dccfba5d9.000000000000001c:head# 2024-09-11T06:18:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c5565208:::rbd_header.116dc3b5629f:head# 2024-09-11T06:18:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c5e72ce8:::rbd_data.116d8d2c13b4.0000000000000006:head# 2024-09-11T06:18:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c60bde37:::rbd_data.116dccfba5d9.0000000000000016:head# 2024-09-11T06:18:40.232 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c62e96d7:::rbd_data.116d5f814563.0000000000000009:head# 2024-09-11T06:18:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c669dfc1:::rbd_data.116dccfba5d9.000000000000005a:head# 2024-09-11T06:18:40.235 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c7126400:::rbd_data.116d419b7418.0000000000000021:head# 2024-09-11T06:18:40.235 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c73ff7b1:::rbd_data.116d6ab4d031.000000000000000a:head# 2024-09-11T06:18:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c79742d7:::rbd_data.116d4d1f1cd7.0000000000000032:head# 2024-09-11T06:18:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c7b936d1:::rbd_data.116dccfba5d9.000000000000000a:head# 2024-09-11T06:18:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:Read #3:c7d8e3f0:::rbd_header.116d94c57ffc:head# 2024-09-11T06:18:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:Export successful 2024-09-11T06:18:40.318 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:40.317+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:40.327 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:40.327 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:40.336 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:40.420 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:40.418+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:40.443 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:40.443 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:40.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:40.540 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:40.538+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:40.600 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:40.600 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:40.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:40.650 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:40.649+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:40.722 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:40.722+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:40.753 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:40.753 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:40.762 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:40.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --force --op remove --pgid 3.3 2024-09-11T06:18:40.848 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:40.847+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:40.866 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:40.866 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:40.876 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:40.924 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:40.923+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:40.977 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:40.978 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:40.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:41.029 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:41.028+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:41.089 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:41.089 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:41.097 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:41.125 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:41.124+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:41.226 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:41.225+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:41.242 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:41.242 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:41.249 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-11T06:18:41.253 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:41.326 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:41.326+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:41.357 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:41.357 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:41.365 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:41.427 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:41.426+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:41.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:18:41.458 INFO:teuthology.orchestra.run.smithi070.stdout:3235 write 0x8f10fe3 thru 0x8f13f54 (0x2f72 bytes) 2024-09-11T06:18:41.464 INFO:teuthology.orchestra.run.smithi070.stdout:3236 write 0x43532ab thru 0x4355e75 (0x2bcb bytes) 2024-09-11T06:18:41.469 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:41.470 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:41.479 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:3237 trunc from 0xddad840 to 0x15bd602 2024-09-11T06:18:41.496 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:41.506 INFO:teuthology.orchestra.run.smithi070.stdout:3241 trunc from 0x15bd602 to 0x9b55f30 2024-09-11T06:18:41.511 INFO:teuthology.orchestra.run.smithi070.stdout:3242 read 0x5eabdeb thru 0x5ebaff9 (0xf20f bytes) 2024-09-11T06:18:41.511 INFO:teuthology.orchestra.run.smithi070.stdout:3246 write 0x1aadcfa thru 0x1ab4810 (0x6b17 bytes) 2024-09-11T06:18:41.513 INFO:teuthology.orchestra.run.smithi070.stdout:3247 read 0x3b44e6a thru 0x3b54706 (0xf89d bytes) 2024-09-11T06:18:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:3248 write 0xdc3eeca thru 0xdc4c1a2 (0xd2d9 bytes) 2024-09-11T06:18:41.526 INFO:teuthology.orchestra.run.smithi070.stdout:3251 write 0x373d3c5 thru 0x3742d12 (0x594e bytes) 2024-09-11T06:18:41.527 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:41.527+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:41.535 INFO:teuthology.orchestra.run.smithi070.stdout:3252 write 0xec38e26 thru 0xec3defe (0x50d9 bytes) 2024-09-11T06:18:41.552 INFO:teuthology.orchestra.run.smithi070.stdout:3253 trunc from 0xec3deff to 0x21144b0 2024-09-11T06:18:41.575 INFO:teuthology.orchestra.run.smithi070.stdout:3254 write 0x730d1d5 thru 0x730e4fa (0x1326 bytes) 2024-09-11T06:18:41.578 INFO:teuthology.orchestra.run.smithi070.stdout:3256 punch from 0x494739c to 0x494e6c0, (0x7324 bytes) 2024-09-11T06:18:41.578 INFO:teuthology.orchestra.run.smithi070.stdout:3258 read 0x32d1679 thru 0x32db4a9 (0x9e31 bytes) 2024-09-11T06:18:41.583 INFO:teuthology.orchestra.run.smithi070.stdout:3259 write 0x79255d0 thru 0x792bd09 (0x673a bytes) 2024-09-11T06:18:41.588 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:41.589 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:41.589 INFO:teuthology.orchestra.run.smithi070.stdout:3260 read 0x2f20826 thru 0x2f3019b (0xf976 bytes) 2024-09-11T06:18:41.592 INFO:teuthology.orchestra.run.smithi070.stdout:3261 write 0x9200664 thru 0x92068e0 (0x627d bytes) 2024-09-11T06:18:41.595 INFO:teuthology.orchestra.run.smithi070.stdout:3263 write 0x37a586d thru 0x37adaa5 (0x8239 bytes) 2024-09-11T06:18:41.597 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:41.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:41.609 INFO:teuthology.orchestra.run.smithi070.stdout:3265 writesame 0xedc3211 thru 0xedd2d89 data_size 0x45(0xfb79 bytes) 2024-09-11T06:18:41.609 INFO:teuthology.orchestra.run.smithi070.stdout:3267 punch from 0x742c399 to 0x74368f6, (0xa55d bytes) 2024-09-11T06:18:41.609 INFO:teuthology.orchestra.run.smithi070.stdout:3268 read 0x870519 thru 0x879afa (0x95e2 bytes) 2024-09-11T06:18:41.610 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:41.610 INFO:teuthology.orchestra.run.smithi070.stdout:3270 write 0xc5841cb thru 0xc593cc4 (0xfafa bytes) 2024-09-11T06:18:41.613 INFO:teuthology.orchestra.run.smithi070.stdout:3271 writesame 0x67a3843 thru 0x67b0bde data_size 0x2(0xd39c bytes) 2024-09-11T06:18:41.624 INFO:teuthology.orchestra.run.smithi070.stdout:3272 writesame 0x3610a03 thru 0x3613e9e data_size 0x34(0x349c bytes) 2024-09-11T06:18:41.628 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:41.632 INFO:teuthology.orchestra.run.smithi070.stdout:3274 trunc from 0xedd2d8a to 0xbe32562 2024-09-11T06:18:41.638 INFO:teuthology.orchestra.run.smithi070.stdout:3275 write 0x2086c1b thru 0x2087acb (0xeb1 bytes) 2024-09-11T06:18:41.641 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:41.639+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:41.653 INFO:teuthology.orchestra.run.smithi070.stdout:3276 trunc from 0xbe32562 to 0xd65245 2024-09-11T06:18:41.666 INFO:teuthology.orchestra.run.smithi070.stdout:3279 read 0xca8cca thru 0xcb7dee (0xf125 bytes) 2024-09-11T06:18:41.689 INFO:teuthology.orchestra.run.smithi070.stdout:3280 writesame 0xcfb4a79 thru 0xcfb9c91 data_size 0x1(0x5219 bytes) 2024-09-11T06:18:41.689 INFO:teuthology.orchestra.run.smithi070.stdout:3282 writesame 0xc422387 thru 0xc424e33 data_size 0x19(0x2aad bytes) 2024-09-11T06:18:41.693 INFO:teuthology.orchestra.run.smithi070.stdout:3283 read 0xc32fa33 thru 0xc32fdc0 (0x38e bytes) 2024-09-11T06:18:41.693 INFO:teuthology.orchestra.run.smithi070.stdout:3284 read 0xbabef99 thru 0xbacbe78 (0xcee0 bytes) 2024-09-11T06:18:41.693 INFO:teuthology.orchestra.run.smithi070.stdout:3285 write 0x83d0e78 thru 0x83e05b5 (0xf73e bytes) 2024-09-11T06:18:41.696 INFO:teuthology.orchestra.run.smithi070.stdout:3287 write 0xb20d838 thru 0xb21a5e6 (0xcdaf bytes) 2024-09-11T06:18:41.699 INFO:teuthology.orchestra.run.smithi070.stdout:3288 read 0x3a3457 thru 0x3a781c (0x43c6 bytes) 2024-09-11T06:18:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:3289 read 0x4ae590a thru 0x4aea68f (0x4d86 bytes) 2024-09-11T06:18:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:3291 punch from 0x4dbc14f to 0x4dbd3a5, (0x1256 bytes) 2024-09-11T06:18:41.703 INFO:teuthology.orchestra.run.smithi070.stdout:3292 trunc from 0xcfb9c92 to 0xa766eb4 2024-09-11T06:18:41.704 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:41.704 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:41.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:41.715 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:41.715 INFO:teuthology.orchestra.run.smithi070.stdout:3294 write 0x5843730 thru 0x58455a6 (0x1e77 bytes) 2024-09-11T06:18:41.717 INFO:teuthology.orchestra.run.smithi070.stdout:3295 punch from 0x8764a11 to 0x87714d7, (0xcac6 bytes) 2024-09-11T06:18:41.717 INFO:teuthology.orchestra.run.smithi070.stdout:3297 punch from 0x31f4a3 to 0x321aca, (0x2627 bytes) 2024-09-11T06:18:41.717 INFO:teuthology.orchestra.run.smithi070.stdout:3299 punch from 0x89ea858 to 0x89ee115, (0x38bd bytes) 2024-09-11T06:18:41.717 INFO:teuthology.orchestra.run.smithi070.stdout:3300 read 0x79cfc7a thru 0x79d3bfe (0x3f85 bytes) 2024-09-11T06:18:41.729 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:41.729+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:41.730 INFO:teuthology.orchestra.run.smithi070.stdout:3301 trunc from 0xa766eb4 to 0xbf96c3 2024-09-11T06:18:41.755 INFO:teuthology.orchestra.run.smithi070.stdout:3303 writesame 0x4e298d1 thru 0x4e3223f data_size 0x1(0x896f bytes) 2024-09-11T06:18:41.763 INFO:teuthology.orchestra.run.smithi070.stdout:3304 trunc from 0x4e32240 to 0xc2fade5 2024-09-11T06:18:41.770 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:41.770 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:41.770 INFO:teuthology.orchestra.run.smithi070.stdout:3305 read 0x7590c90 thru 0x75a0b6e (0xfedf bytes) 2024-09-11T06:18:41.770 INFO:teuthology.orchestra.run.smithi070.stdout:3307 write 0xb11c3e9 thru 0xb12643a (0xa052 bytes) 2024-09-11T06:18:41.774 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:41.774 INFO:teuthology.orchestra.run.smithi070.stdout:3309 clone 25 order 24 su 65536 sc 4 2024-09-11T06:18:41.789 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:41.789 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:41.789 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:41.813 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:41.813 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:41.829 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:41.830 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:41.830 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:41.829+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:41.846 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:41.846 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:41.859 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:41.859 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:41.863 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:41.864 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:41.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:41.880 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:41.883 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:41.883 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:41.933 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:41.932+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:41.972 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:41.972 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:41.972 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:41.972 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:41.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:42.034 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:42.033+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:42.082 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:42.083 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:42.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:42.137 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:42.136+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65211 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 290816~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.927388389000001, 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011362828, 2024-09-11T06:18:42.237 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65211 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9299999999999999e-07 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307760+0000", 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0779999999999998e-06 2024-09-11T06:18:42.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307768+0000", 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307773+0000", 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.87e-06 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.317997+0000", 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010223922 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318245+0000", 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024794699999999999 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.319120+0000", 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087475300000000003 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65358 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 196608~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.916430886000001, 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01178332, 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65358 2024-09-11T06:18:42.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318717+0000", 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1739999999999999e-06 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318726+0000", 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2089999999999994e-06 2024-09-11T06:18:42.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318731+0000", 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9690000000000002e-06 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.329832+0000", 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011100376 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330093+0000", 2024-09-11T06:18:42.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026168699999999998 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330498+0000", 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040453100000000002 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65359 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.916406548000001, 2024-09-11T06:18:42.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012518262, 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65359 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4200000000000001e-07 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318741+0000", 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0439999999999998e-06 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318750+0000", 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7239999999999998e-06 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318755+0000", 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8080000000000004e-06 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330616+0000", 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011861349 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330867+0000", 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025063199999999998 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331257+0000", 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039026300000000001 2024-09-11T06:18:42.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65360 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 266240~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.916384071, 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013368422, 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65360 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:42.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318762+0000", 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318764+0000", 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318772+0000", 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1519999999999992e-06 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318783+0000", 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0956e-05 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331395+0000", 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012611938 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331643+0000", 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000248244 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332130+0000", 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048681400000000002 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65382 3.10 3:0bf53440:::rbd_data.116dccfba5d9.0000000000000049:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.255 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.916356790999998, 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013819148, 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65382 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318791+0000", 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9750000000000001e-06 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318799+0000", 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5989999999999996e-06 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318803+0000", 2024-09-11T06:18:42.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5090000000000004e-06 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332201+0000", 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013397714 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332295+0000", 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4426999999999996e-05 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332608+0000", 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031258700000000002 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65418 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.911826096999999, 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011186454, 2024-09-11T06:18:42.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65418 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323320+0000", 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0900000000000001e-07 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323323+0000", 2024-09-11T06:18:42.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.021e-06 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323333+0000", 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0343000000000001e-05 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323339+0000", 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1109999999999996e-06 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334123+0000", 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010783789 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334216+0000", 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2458000000000001e-05 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334506+0000", 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029012299999999999 2024-09-11T06:18:42.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65455 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 159744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.910378937000001, 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010864807000000001, 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65455 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324769+0000", 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1160000000000002e-06 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324775+0000", 2024-09-11T06:18:42.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7969999999999997e-06 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324779+0000", 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9430000000000002e-06 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335383+0000", 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604001 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335467+0000", 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4214000000000004e-05 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335631+0000", 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164334 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.269 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65456 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.910361264999999, 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011134408, 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65456 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:42.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8599999999999999e-07 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324786+0000", 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.629e-06 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324791+0000", 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3299999999999998e-06 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324795+0000", 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8e-06 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335661+0000", 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010865718 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335745+0000", 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3776999999999994e-05 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335919+0000", 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017386800000000001 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65457 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.910344678000001, 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011510302, 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65457 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324803+0000", 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7910000000000001e-06 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324808+0000", 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2979999999999999e-06 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324812+0000", 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9430000000000002e-06 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335955+0000", 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011142987 2024-09-11T06:18:42.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.336053+0000", 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7985000000000005e-05 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.336311+0000", 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025792799999999999 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106380 3.1c 3:3eaf6144:::rbd_data.116d419b7418.000000000000027b:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5137344850000005, 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010923146999999999, 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106380 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:18:42.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721413+0000", 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8360000000000001e-06 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721419+0000", 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4269999999999999e-06 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721423+0000", 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.374e-06 2024-09-11T06:18:42.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732252+0000", 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010829099999999999 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732334+0000", 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2008000000000005e-05 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.282 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106382 3.1c 3:3d8acb81:::rbd_data.116d419b7418.000000000000027d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5136907560000008, 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010982667999999999, 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106382 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9900000000000001e-07 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721458+0000", 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.345e-06 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721464+0000", 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4679999999999997e-06 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721470+0000", 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732362+0000", 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010892456999999999 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732437+0000", 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4871999999999997e-05 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106383 3.1c 3:3d5051d7:::rbd_data.116d419b7418.000000000000027e:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5136685169999993, 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011059616, 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106383 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:18:42.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7199999999999999e-07 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721482+0000", 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9960000000000001e-06 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721489+0000", 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721494+0000", 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1100000000000002e-06 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732464+0000", 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010969845000000001 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732537+0000", 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3026000000000002e-05 2024-09-11T06:18:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106426 3.1c 3:3b52f154:::rbd_data.116d419b7418.00000000000002b5:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5135961850000008, 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011086477000000001, 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106426 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721550+0000", 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000005e-07 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721551+0000", 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4759999999999999e-06 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721556+0000", 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9309999999999999e-06 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721560+0000", 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732563+0000", 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011003590000000001 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732636+0000", 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2311999999999995e-05 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106442 3.1c 3:3847cd45:::rbd_data.116d419b7418.00000000000002c5:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5135474819999999, 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011139990000000001, 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106442 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721600+0000", 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:18:42.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721604+0000", 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8260000000000003e-06 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721606+0000", 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732662+0000", 2024-09-11T06:18:42.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011056112999999999 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732738+0000", 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5726e-05 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106464 3.1c 3:3dce2b45:::rbd_data.116d419b7418.00000000000002e1:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:18:42.299 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5135243000000003, 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011200432999999999, 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106464 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1400000000000001e-07 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721622+0000", 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-07 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721626+0000", 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5880000000000002e-06 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721629+0000", 2024-09-11T06:18:42.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3079999999999999e-06 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732765+0000", 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011135369000000001 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732822+0000", 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6974e-05 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106491 3.1c 3:3b1800f8:::rbd_data.116d419b7418.00000000000002fc:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5134819710000009, 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011247679999999999, 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106491 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721664+0000", 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721677+0000", 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2967e-05 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721681+0000", 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9519999999999996e-06 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721683+0000", 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7779999999999999e-06 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732849+0000", 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011165542000000001 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732911+0000", 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2199999999999994e-05 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106493 3.1c 3:3f1dc0e6:::rbd_data.116d419b7418.00000000000002fe:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5134512339999997, 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011331447, 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106493 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721695+0000", 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721696+0000", 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4360000000000001e-06 2024-09-11T06:18:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721700+0000", 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7639999999999999e-06 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721702+0000", 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6400000000000001e-06 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732935+0000", 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011232328 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733026+0000", 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0859999999999994e-05 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106496 3.1c 3:3f844c73:::rbd_data.116d419b7418.0000000000000307:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5134295089999998, 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011423630000000001, 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106496 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:42.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721717+0000", 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5199999999999995e-07 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721720+0000", 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1480000000000002e-06 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721723+0000", 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.39e-06 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733056+0000", 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011332844999999999 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733140+0000", 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3959e-05 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106536 3.1c 3:3b36f16b:::rbd_data.116d419b7418.0000000000000335:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.513400657, 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011515332, 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106536 2024-09-11T06:18:42.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721746+0000", 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2200000000000002e-07 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721749+0000", 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.523e-06 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721752+0000", 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5770000000000001e-06 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733168+0000", 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011415483000000001 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733260+0000", 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2612e-05 2024-09-11T06:18:42.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106560 3.1c 3:3f30db2e:::rbd_data.116d419b7418.000000000000034d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.513390566, 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011596255999999999, 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.321 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106560 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2100000000000001e-07 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721756+0000", 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8400000000000002e-07 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721760+0000", 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7809999999999999e-06 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721763+0000", 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.644e-06 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733290+0000", 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011527953000000001 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733351+0000", 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0673e-05 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.324 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.325 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:42.326 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:42.326+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:42.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:42.426 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:42.426+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:18:42.457 INFO:teuthology.orchestra.run.smithi070.stdout: marking collection for removal 2024-09-11T06:18:42.458 INFO:teuthology.orchestra.run.smithi070.stdout:setting '_remove' omap key 2024-09-11T06:18:42.458 INFO:teuthology.orchestra.run.smithi070.stdout:finish_remove_pgs 3.3_head removing 3.3 2024-09-11T06:18:42.468 INFO:teuthology.orchestra.run.smithi070.stdout:Remove successful 2024-09-11T06:18:42.483 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:42.483 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:42.483 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:42.483 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:42.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:42.527 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:42.526+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:42.629 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:42.628+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:42.634 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:42.635 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:42.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:42.730 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:42.729+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:42.788 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.983630047000005, 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.64727611, 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.64725677, 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:18:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.647238421000001, 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:18:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:18:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.647220236999999, 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:18:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.647201451000001, 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:18:42.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.819 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.647182451999999, 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:18:42.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.647153863, 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:18:42.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.646940737, 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:18:42.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:18:42.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644385850000001, 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:18:42.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:18:42.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644362159, 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:18:42.838 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:18:42.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.842 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644342133, 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.843 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:18:42.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:18:42.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:18:42.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:18:42.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:18:42.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:18:42.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.849 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.849 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:42.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644300577999999, 2024-09-11T06:18:42.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:18:42.850 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:18:42.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:42.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:42.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:18:42.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:18:42.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:18:42.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:42.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.857 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644276635000001, 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:18:42.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:18:42.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:18:42.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:18:42.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:18:42.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644255227, 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:18:42.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644234439, 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:18:42.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:18:42.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.873 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:42.873 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644214404, 2024-09-11T06:18:42.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:18:42.873 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:18:42.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:18:42.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:42.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644194267, 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:18:42.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:18:42.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.64417227, 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:18:42.884 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.644152204999999, 2024-09-11T06:18:42.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:42.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:42.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:18:42.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.894 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:42.894 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:42.894 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:42.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:42.896 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:42.894+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:42.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.3.2 2024-09-11T06:18:42.996 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:42.995+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:43.043 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:43.043 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:43.044 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:43.044 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:43.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:43.097 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:43.096+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:43.157 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:43.157 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:43.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:43.197 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:43.196+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:43.271 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.64988277800001, 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.3554472, 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.088884006000001, 2024-09-11T06:18:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:18:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:18:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:18:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:18:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:18:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:18:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63576 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.086670241, 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053575987999999998, 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63576 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182844+0000", 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182850+0000", 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9970000000000004e-06 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182854+0000", 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1829999999999996e-06 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235811+0000", 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052956403999999999 2024-09-11T06:18:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235933+0000", 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012229799999999999 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236418+0000", 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048509399999999999 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63577 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.086651321000002, 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053525649000000002, 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63577 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.22e-07 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182863+0000", 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9e-06 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182876+0000", 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.311e-05 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182887+0000", 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1109e-05 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236375+0000", 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053487499000000001 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236387+0000", 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1708999999999999e-05 2024-09-11T06:18:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63578 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.086607814000001, 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053516941999999998, 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63578 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182905+0000", 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182908+0000", 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6249999999999999e-06 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182915+0000", 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.525e-06 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182921+0000", 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.48e-06 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236412+0000", 2024-09-11T06:18:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053491483999999999 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236421+0000", 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63579 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.086535282, 2024-09-11T06:18:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053483819000000002, 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63579 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182978+0000", 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.99e-07 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182980+0000", 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182988+0000", 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182995+0000", 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0129999999999996e-06 2024-09-11T06:18:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236448+0000", 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053452983000000003 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236461+0000", 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2865e-05 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63580 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.086508804000001, 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053488579000000001, 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63580 2024-09-11T06:18:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183004+0000", 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183006+0000", 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0650000000000001e-06 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183013+0000", 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183018+0000", 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236482+0000", 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053463869999999997 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236492+0000", 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0471e-05 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90636 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 145408~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125366055000001, 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053568440000000002, 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90636 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144147+0000", 2024-09-11T06:18:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144148+0000", 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144154+0000", 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4990000000000002e-06 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144158+0000", 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3680000000000004e-06 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197315+0000", 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05315698 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197352+0000", 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6510000000000001e-05 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197715+0000", 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036306199999999999 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90637 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125349081, 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053721428000000002, 2024-09-11T06:18:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90637 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144165+0000", 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144171+0000", 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2909999999999998e-06 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144175+0000", 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0029999999999996e-06 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197740+0000", 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053565861999999999 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197779+0000", 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8339e-05 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197885+0000", 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105807 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90638 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125331951, 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053925155000000002, 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90638 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144181+0000", 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144183+0000", 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9479999999999998e-06 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144188+0000", 2024-09-11T06:18:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4709999999999998e-06 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144193+0000", 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7040000000000002e-06 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197927+0000", 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053734188000000002 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197993+0000", 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5839000000000004e-05 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198105+0000", 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011268 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90639 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125313542000001, 2024-09-11T06:18:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054132671, 2024-09-11T06:18:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90639 2024-09-11T06:18:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144201+0000", 2024-09-11T06:18:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T06:18:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144207+0000", 2024-09-11T06:18:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0510000000000002e-06 2024-09-11T06:18:43.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144212+0000", 2024-09-11T06:18:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198160+0000", 2024-09-11T06:18:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053948788999999997 2024-09-11T06:18:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198221+0000", 2024-09-11T06:18:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0395e-05 2024-09-11T06:18:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198331+0000", 2024-09-11T06:18:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110541 2024-09-11T06:18:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90640 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:43.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125295184000001, 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054316443999999998, 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90640 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3099999999999999e-07 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144219+0000", 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7549999999999999e-06 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144224+0000", 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2839999999999997e-06 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144229+0000", 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4549999999999997e-06 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198363+0000", 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054134045999999998 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198417+0000", 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-11T06:18:43.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198534+0000", 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116767 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90641 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125278284, 2024-09-11T06:18:43.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534245000000002, 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90641 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0499999999999999e-07 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144236+0000", 2024-09-11T06:18:43.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144242+0000", 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5210000000000002e-06 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144253+0000", 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1297e-05 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198574+0000", 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054321665999999998 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198647+0000", 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2031000000000002e-05 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198768+0000", 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121703 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.345 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90642 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125253603999999, 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054727525999999999, 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90642 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144261+0000", 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144267+0000", 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7749999999999998e-06 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144271+0000", 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5399999999999997e-06 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198806+0000", 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534816999999999 2024-09-11T06:18:43.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198867+0000", 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0776999999999998e-05 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198986+0000", 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119203 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90643 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125235575, 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054909368, 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90643 2024-09-11T06:18:43.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144279+0000", 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.801e-06 2024-09-11T06:18:43.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144284+0000", 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.451e-06 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144289+0000", 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199018+0000", 2024-09-11T06:18:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054728994000000003 2024-09-11T06:18:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199072+0000", 2024-09-11T06:18:43.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3705999999999997e-05 2024-09-11T06:18:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199186+0000", 2024-09-11T06:18:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114521 2024-09-11T06:18:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.356 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90644 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125218388, 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055086361, 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90644 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144296+0000", 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.728e-06 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144301+0000", 2024-09-11T06:18:43.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4009999999999996e-06 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144306+0000", 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4159999999999997e-06 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199216+0000", 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054910051000000001 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199269+0000", 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3341000000000003e-05 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199380+0000", 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111103 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.361 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125201414999999, 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:18:43.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:18:43.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125183989, 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:18:43.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:18:43.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125166733, 2024-09-11T06:18:43.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:43.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:43.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:18:43.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:43.377 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:43.379 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:43.379 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:43.378+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:43.480 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:43.478+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:43.505 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:43.506 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:43.506 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:43.506 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:43.514 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:43.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:43.580+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:43.617 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:43.617 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:43.617 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:43.626 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:43.682 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:43.680+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:43.770 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:43.770 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:43.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:43.770 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:43.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 84.452577276, 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:43.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:43.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 78.140004058000002, 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.777 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:43.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:43.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:43.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:43.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:43.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:43.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:43.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:43.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:43.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:43.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68256 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.307174102000001, 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018100349000000002, 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68256 2024-09-11T06:18:43.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461407+0000", 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6800000000000001e-07 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461416+0000", 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8409999999999995e-06 2024-09-11T06:18:43.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461422+0000", 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.806e-06 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461427+0000", 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5040000000000004e-06 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479297+0000", 2024-09-11T06:18:43.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017870381000000001 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479385+0000", 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7690999999999998e-05 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479506+0000", 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012165800000000001 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68257 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.307145634000001, 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018398100000000001, 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68257 2024-09-11T06:18:43.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999995e-07 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461437+0000", 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2740000000000002e-06 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461444+0000", 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6769999999999998e-06 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461450+0000", 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7810000000000002e-06 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479581+0000", 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018131278000000001 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479687+0000", 2024-09-11T06:18:43.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105931 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479833+0000", 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014557200000000001 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68258 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 311296~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:43.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.307124576, 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01871913, 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68258 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.32e-07 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461464+0000", 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461470+0000", 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1120000000000001e-06 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461475+0000", 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7199999999999997e-06 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479865+0000", 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018390118 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480028+0000", 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016266800000000001 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480175+0000", 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147236 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68259 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 339968~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.307100115000001, 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018993309999999999, 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.798 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68259 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461481+0000", 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6499999999999999e-07 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461483+0000", 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461488+0000", 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5319999999999997e-06 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461493+0000", 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.634e-06 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480206+0000", 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018713032000000001 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480367+0000", 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016139799999999999 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480473+0000", 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106346 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68260 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 380928~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.307081916000001, 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019218077, 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68260 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461499+0000", 2024-09-11T06:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461501+0000", 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7600000000000001e-06 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461506+0000", 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7989999999999999e-06 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461511+0000", 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480510+0000", 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018999095000000001 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480604+0000", 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3795000000000006e-05 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480716+0000", 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112389 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68326 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.306647269999999, 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019001186999999999, 2024-09-11T06:18:43.807 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68326 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9299999999999998e-07 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461935+0000", 2024-09-11T06:18:43.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461941+0000", 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461947+0000", 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9519999999999999e-06 2024-09-11T06:18:43.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480755+0000", 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018807739 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480838+0000", 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3145000000000004e-05 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480934+0000", 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6009999999999997e-05 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68343 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.306609984000001, 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019314591999999998, 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.812 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68343 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461971+0000", 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461977+0000", 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0950000000000001e-06 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461982+0000", 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2950000000000001e-06 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461986+0000", 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9779999999999999e-06 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480964+0000", 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01897832 2024-09-11T06:18:43.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481041+0000", 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6755000000000006e-05 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481285+0000", 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000243804 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68352 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.306548637999999, 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019458092, 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68352 2024-09-11T06:18:43.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:43.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4099999999999999e-07 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462034+0000", 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.725e-06 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462040+0000", 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462044+0000", 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4619999999999998e-06 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481326+0000", 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281586999999999 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481420+0000", 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3727000000000006e-05 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481490+0000", 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0174999999999998e-05 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68369 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.306508855000001, 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019575028000000001, 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.822 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68369 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462072+0000", 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9399999999999995e-07 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462074+0000", 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.711e-06 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462080+0000", 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-06 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462084+0000", 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5279999999999997e-06 2024-09-11T06:18:43.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481519+0000", 2024-09-11T06:18:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019434165 2024-09-11T06:18:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481575+0000", 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6489000000000001e-05 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481646+0000", 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1271000000000003e-05 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.827 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.828 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:110494 3.1b 3:db2012be:::rbd_data.116d6837dfb5.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-11T06:18:43.828 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:43.828 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.0797618520000007, 2024-09-11T06:18:43.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026675217000000001, 2024-09-11T06:18:43.828 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.828 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 110494 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688819+0000", 2024-09-11T06:18:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4399999999999999e-07 2024-09-11T06:18:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688823+0000", 2024-09-11T06:18:43.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7699999999999999e-06 2024-09-11T06:18:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688831+0000", 2024-09-11T06:18:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6820000000000003e-06 2024-09-11T06:18:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688835+0000", 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1980000000000003e-06 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688876+0000", 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1313999999999998e-05 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688932+0000", 2024-09-11T06:18:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5559000000000001e-05 2024-09-11T06:18:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.693699+0000", 2024-09-11T06:18:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004767238 2024-09-11T06:18:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715356+0000", 2024-09-11T06:18:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021657342 2024-09-11T06:18:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715375+0000", 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9241000000000001e-05 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715435+0000", 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9509000000000002e-05 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715494+0000", 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8619999999999998e-05 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.837 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111656 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 1900544~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3314865039999999, 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017837603, 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.839 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111656 2024-09-11T06:18:43.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.839 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:43.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:43.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437096+0000", 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437103+0000", 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3860000000000004e-06 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437108+0000", 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2750000000000003e-06 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454788+0000", 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017679812999999999 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454836+0000", 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7882e-05 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454931+0000", 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5673000000000004e-05 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111657 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.331452359, 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018066136, 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111657 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437132+0000", 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2310000000000001e-06 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437141+0000", 2024-09-11T06:18:43.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2539999999999998e-06 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437147+0000", 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.19e-06 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454968+0000", 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017820722000000001 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455050+0000", 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1954999999999997e-05 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455194+0000", 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014418499999999999 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.847 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111658 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2555904~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3314236770000001, 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018208022000000001, 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111658 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437160+0000", 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7250000000000002e-06 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437167+0000", 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7669999999999998e-06 2024-09-11T06:18:43.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437172+0000", 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2830000000000001e-06 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455224+0000", 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018051851000000001 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455271+0000", 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7277999999999997e-05 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455365+0000", 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3572000000000005e-05 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111659 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2752512~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3314019239999997, 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018392750999999999, 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111659 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437179+0000", 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437181+0000", 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437187+0000", 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437192+0000", 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455406+0000", 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018214088 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455460+0000", 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3782000000000001e-05 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455571+0000", 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011140499999999999 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111665 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 1769472~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3313822279999998, 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018690556000000001, 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111665 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.858 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:43.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437200+0000", 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437207+0000", 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3759999999999996e-06 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437212+0000", 2024-09-11T06:18:43.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1410000000000004e-06 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455621+0000", 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018408620000000001 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455715+0000", 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4238000000000001e-05 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455889+0000", 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173769 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111666 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 1966080~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3313621189999996, 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018930618, 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111666 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437219+0000", 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437221+0000", 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9709999999999998e-06 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437227+0000", 2024-09-11T06:18:43.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.268e-06 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437232+0000", 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1490000000000002e-06 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455924+0000", 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018692200999999999 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456003+0000", 2024-09-11T06:18:43.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8368999999999995e-05 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456149+0000", 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014622999999999999 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111667 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3313423159999997, 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019219610000000002, 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111667 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:43.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437245+0000", 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1049999999999997e-06 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437252+0000", 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9399999999999996e-06 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437258+0000", 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3639999999999998e-06 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456202+0000", 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018944427999999999 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456295+0000", 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3268000000000002e-05 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456458+0000", 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016213100000000001 2024-09-11T06:18:43.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111668 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 2621440~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 6.3313160389999998, 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019372776000000001, 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:43.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111668 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:43.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437265+0000", 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437267+0000", 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.069e-06 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437273+0000", 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3690000000000003e-06 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437278+0000", 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.169e-06 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456496+0000", 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019217304000000001 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456547+0000", 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1004000000000002e-05 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456637+0000", 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0402000000000006e-05 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:43.875 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:43.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:43.878 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:43.876+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:43.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:43.978 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:43.977+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:44.003 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:44.020 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:44.020 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:44.020 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:44.021 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:44.022 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:44.022 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:44.022 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:44.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:44.036 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:44.036 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:44.052 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:44.068 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:44.085 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:44.085 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:44.101 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:44.101 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:44.105 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:44.105 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:44.114 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:44.114+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:44.174 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:44.174 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:44.179 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:44.178+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:44.184 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:44.279 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:44.278+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:44.328 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:44.328 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:44.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:44.381 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:44.380+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:44.390 INFO:teuthology.orchestra.run.smithi070.stdout:get_pg_num_history pg_num_history pg_num_history(e109 pg_nums {1={16=1},2={19=8},3={24=32}} deleted_pools ) 2024-09-11T06:18:44.391 INFO:teuthology.orchestra.run.smithi070.stdout:Importing pgid 3.3 2024-09-11T06:18:44.396 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c0acd335:::rbd_object_map.116d4d1f1cd7:head# 2024-09-11T06:18:44.397 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.397 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c0b121e8:::rbd_data.116dccfba5d9.000000000000015c:head# 2024-09-11T06:18:44.397 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.398 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c12bc6a8:::rbd_data.116dc3b5629f.0000000000000039:head# 2024-09-11T06:18:44.398 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.399 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c14b545c:::rbd_data.116d2df99cf8.0000000000000002:head# 2024-09-11T06:18:44.405 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.411 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c16cc7b4:::rbd_data.116da678facf.0000000000000068:head# 2024-09-11T06:18:44.412 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.413 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c1c646d0:::rbd_data.116dccfba5d9.000000000000004f:head# 2024-09-11T06:18:44.414 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.414 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c231e28a:::rbd_data.116d3c8aaf0c.000000000000000a:head# 2024-09-11T06:18:44.415 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.415 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c2b1dd9b:::rbd_data.116da678facf.0000000000000004:head# 2024-09-11T06:18:44.415 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.416 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c30b80c9:::rbd_data.116d2cbdd9a2.0000000000000008:head# 2024-09-11T06:18:44.416 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.417 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c36bd5dc:::rbd_data.116d55772b3c.0000000000000001:head# 2024-09-11T06:18:44.417 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.419 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c37f48c3:::rbd_data.116dccfba5d9.0000000000000077:head# 2024-09-11T06:18:44.419 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.419 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c3d4448e:::rbd_object_map.116d770b822.0000000000000013:head# 2024-09-11T06:18:44.419 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.420 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c41dfaaf:::rbd_data.116d3c8aaf0c.00000000000000a3:head# 2024-09-11T06:18:44.420 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.420 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c4378e7e:::rbd_header.116d3c8aaf0c:head# 2024-09-11T06:18:44.421 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.421 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c47604ed:::rbd_data.116d51ead02d.0000000000000000:head# 2024-09-11T06:18:44.421 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.425 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c4a301d3:::rbd_data.116d419b7418.0000000000000032:head# 2024-09-11T06:18:44.425 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.425 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c4d1128f:::rbd_object_map.116df69fa911.0000000000000007:head# 2024-09-11T06:18:44.425 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.425 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c5337e78:::rbd_data.116dc3b5629f.000000000000003e:head# 2024-09-11T06:18:44.425 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.426 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c547be65:::rbd_data.116dccfba5d9.00000000000000c7:head# 2024-09-11T06:18:44.426 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.426 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c54891f8:::rbd_object_map.116de94696bd.0000000000000017:head# 2024-09-11T06:18:44.427 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.427 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c5509ed4:::rbd_data.116dccfba5d9.000000000000001c:head# 2024-09-11T06:18:44.427 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.427 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c5565208:::rbd_header.116dc3b5629f:head# 2024-09-11T06:18:44.427 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.428 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c5e72ce8:::rbd_data.116d8d2c13b4.0000000000000006:head# 2024-09-11T06:18:44.428 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.428 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c60bde37:::rbd_data.116dccfba5d9.0000000000000016:head# 2024-09-11T06:18:44.428 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.429 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c62e96d7:::rbd_data.116d5f814563.0000000000000009:head# 2024-09-11T06:18:44.429 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.430 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c669dfc1:::rbd_data.116dccfba5d9.000000000000005a:head# 2024-09-11T06:18:44.431 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.431 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c7126400:::rbd_data.116d419b7418.0000000000000021:head# 2024-09-11T06:18:44.431 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.432 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c73ff7b1:::rbd_data.116d6ab4d031.000000000000000a:head# 2024-09-11T06:18:44.432 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.433 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c79742d7:::rbd_data.116d4d1f1cd7.0000000000000032:head# 2024-09-11T06:18:44.433 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.435 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c7b936d1:::rbd_data.116dccfba5d9.000000000000000a:head# 2024-09-11T06:18:44.435 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.435 INFO:teuthology.orchestra.run.smithi070.stdout:Write #3:c7d8e3f0:::rbd_header.116d94c57ffc:head# 2024-09-11T06:18:44.435 INFO:teuthology.orchestra.run.smithi070.stdout:snapset 0=[]:{} 2024-09-11T06:18:44.436 INFO:teuthology.orchestra.run.smithi070.stdout:write_pg epoch 108 info 3.3( v 108'486 (0'0,108'486] local-lis/les=24/25 n=31 ec=24/24 lis/c=24/24 les/c/f=25/25/0 sis=24) 2024-09-11T06:18:44.438 INFO:teuthology.orchestra.run.smithi070.stdout:Import successful 2024-09-11T06:18:44.442 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:44.443 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:44.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:44.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:18:44.493 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:44.492+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:44.574 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-11T06:18:44.583 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:44.582+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:44.598 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:44.598 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:44.607 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:44.691 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:44.690+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:44.749 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:44.750 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:44.758 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:44.800 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:44.799+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:44.817 INFO:teuthology.orchestra.run.smithi070.stdout:3312 trunc from 0xc2fade5 to 0xd96ed26 2024-09-11T06:18:44.824 INFO:teuthology.orchestra.run.smithi070.stdout:3313 read 0x63c8e9e thru 0x63d8c37 (0xfd9a bytes) 2024-09-11T06:18:44.824 INFO:teuthology.orchestra.run.smithi070.stdout:3314 write 0x14df9ae thru 0x14e6fb7 (0x760a bytes) 2024-09-11T06:18:44.826 INFO:teuthology.orchestra.run.smithi070.stdout:3315 write 0x7755572 thru 0x7759b1e (0x45ad bytes) 2024-09-11T06:18:44.829 INFO:teuthology.orchestra.run.smithi070.stdout:3317 writesame 0x29eef64 thru 0x29f0a5a data_size 0xd(0x1af7 bytes) 2024-09-11T06:18:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:3319 punch from 0x61df678 to 0x61ed4df, (0xde67 bytes) 2024-09-11T06:18:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:3320 read 0x353073b thru 0x3534eb0 (0x4776 bytes) 2024-09-11T06:18:44.842 INFO:teuthology.orchestra.run.smithi070.stdout:3321 trunc from 0xd96ed26 to 0x4072eea 2024-09-11T06:18:44.852 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:44.852 INFO:teuthology.orchestra.run.smithi070.stdout:3325 punch from 0x27cad45 to 0x27ce565, (0x3820 bytes) 2024-09-11T06:18:44.871 INFO:teuthology.orchestra.run.smithi070.stdout:3326 write 0xdee8d8c thru 0xdef444b (0xb6c0 bytes) 2024-09-11T06:18:44.874 INFO:teuthology.orchestra.run.smithi070.stdout:3327 write 0x48995fd thru 0x48a087b (0x727f bytes) 2024-09-11T06:18:44.877 INFO:teuthology.orchestra.run.smithi070.stdout:3328 read 0x5aabb7a thru 0x5ab7ba8 (0xc02f bytes) 2024-09-11T06:18:44.884 INFO:teuthology.orchestra.run.smithi070.stdout:3329 trunc from 0xdef444c to 0x86b8626 2024-09-11T06:18:44.885 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:44.883+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:44.893 INFO:teuthology.orchestra.run.smithi070.stdout:3330 writesame 0x4e53685 thru 0x4e5fa7e data_size 0x3a(0xc3fa bytes) 2024-09-11T06:18:44.894 INFO:teuthology.orchestra.run.smithi070.stdout:3331 write 0x3776855 thru 0x3777046 (0x7f2 bytes) 2024-09-11T06:18:44.896 INFO:teuthology.orchestra.run.smithi070.stdout:3332 punch from 0x73321f9 to 0x733539f, (0x31a6 bytes) 2024-09-11T06:18:44.896 INFO:teuthology.orchestra.run.smithi070.stdout:3334 read 0x61ccd6a thru 0x61d8448 (0xb6df bytes) 2024-09-11T06:18:44.902 INFO:teuthology.orchestra.run.smithi070.stdout:3335 trunc from 0x86b8626 to 0x3cd1ee1 2024-09-11T06:18:44.905 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:44.905 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:44.912 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:44.912 INFO:teuthology.orchestra.run.smithi070.stdout:3337 read 0x1203d4f thru 0x1206164 (0x2416 bytes) 2024-09-11T06:18:44.912 INFO:teuthology.orchestra.run.smithi070.stdout:3338 read 0x1c9ca7b thru 0x1ca0c68 (0x41ee bytes) 2024-09-11T06:18:44.912 INFO:teuthology.orchestra.run.smithi070.stdout:3339 punch from 0x9001e9 to 0x90d36c, (0xd183 bytes) 2024-09-11T06:18:44.913 INFO:teuthology.orchestra.run.smithi070.stdout:3340 clone 26 order 25 su 4194304 sc 4 2024-09-11T06:18:44.914 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:44.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /var/log/ceph/exp.3.3.2 2024-09-11T06:18:44.985 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:44.985+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:45.016 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:45.016 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:45.025 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:45.104 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:18:45.110 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:45.109+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:45.174 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:45.174 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:45.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:45.224 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:45.223+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:45.286 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:45.286 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:45.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:45.286+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:45.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:45.388 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:45.386+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:45.397 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:45.397 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:45.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:45.488 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:45.488+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:45.548 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:45.548 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:45.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:45.601 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:45.599+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:45.661 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:45.661 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:45.669 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:45.690 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:45.689+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:45.791 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:45.789+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:45.813 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:45.814 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:45.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:45.910 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:45.908+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:45.968 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:45.968 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:45.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:46.018 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:46.016+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:46.093 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:46.092+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:46.106 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:46.126 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:46.126 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:46.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:46.195 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:46.194+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:46.236 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:46.236 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:46.251 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:46.251 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:46.252 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:46.268 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:46.268 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:46.284 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:46.284 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:46.284 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:46.285 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:46.285 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:46.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:46.294 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:46.293+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:46.302 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:46.302 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:46.319 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:46.320 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:46.336 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:46.337 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:46.340 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:46.340 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:46.395 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:46.395+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:46.399 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 106.778470766, 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 106.48403518800001, 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.217471994, 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:18:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:18:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63576 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.215258229, 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053575987999999998, 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63576 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182844+0000", 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182850+0000", 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9970000000000004e-06 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182854+0000", 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1829999999999996e-06 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235811+0000", 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052956403999999999 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235933+0000", 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012229799999999999 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236418+0000", 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048509399999999999 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63577 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.215239309000001, 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053525649000000002, 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63577 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.22e-07 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182863+0000", 2024-09-11T06:18:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9e-06 2024-09-11T06:18:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182876+0000", 2024-09-11T06:18:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.311e-05 2024-09-11T06:18:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182887+0000", 2024-09-11T06:18:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1109e-05 2024-09-11T06:18:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236375+0000", 2024-09-11T06:18:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053487499000000001 2024-09-11T06:18:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236387+0000", 2024-09-11T06:18:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1708999999999999e-05 2024-09-11T06:18:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63578 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.215195802, 2024-09-11T06:18:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053516941999999998, 2024-09-11T06:18:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63578 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182905+0000", 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182908+0000", 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6249999999999999e-06 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182915+0000", 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.525e-06 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182921+0000", 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.48e-06 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236412+0000", 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053491483999999999 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236421+0000", 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63579 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.215123269999999, 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053483819000000002, 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63579 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182978+0000", 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.99e-07 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182980+0000", 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182988+0000", 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182995+0000", 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0129999999999996e-06 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236448+0000", 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053452983000000003 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236461+0000", 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2865e-05 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63580 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.215096792000001, 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053488579000000001, 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63580 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183004+0000", 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183006+0000", 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0650000000000001e-06 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183013+0000", 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183018+0000", 2024-09-11T06:18:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236482+0000", 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053463869999999997 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236492+0000", 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0471e-05 2024-09-11T06:18:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90636 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 145408~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253954043, 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053568440000000002, 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90636 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144147+0000", 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144148+0000", 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144154+0000", 2024-09-11T06:18:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4990000000000002e-06 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144158+0000", 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3680000000000004e-06 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197315+0000", 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05315698 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197352+0000", 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6510000000000001e-05 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197715+0000", 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036306199999999999 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90637 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253937068999999, 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053721428000000002, 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90637 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144165+0000", 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144171+0000", 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2909999999999998e-06 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144175+0000", 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0029999999999996e-06 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197740+0000", 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053565861999999999 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197779+0000", 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8339e-05 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197885+0000", 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105807 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90638 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253919938999999, 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053925155000000002, 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90638 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144181+0000", 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144183+0000", 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9479999999999998e-06 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144188+0000", 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4709999999999998e-06 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144193+0000", 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7040000000000002e-06 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197927+0000", 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053734188000000002 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197993+0000", 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5839000000000004e-05 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198105+0000", 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011268 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90639 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.25390153, 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054132671, 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90639 2024-09-11T06:18:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144201+0000", 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144207+0000", 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0510000000000002e-06 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144212+0000", 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198160+0000", 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053948788999999997 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198221+0000", 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0395e-05 2024-09-11T06:18:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198331+0000", 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110541 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90640 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253883171999998, 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054316443999999998, 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90640 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3099999999999999e-07 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144219+0000", 2024-09-11T06:18:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7549999999999999e-06 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144224+0000", 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2839999999999997e-06 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144229+0000", 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4549999999999997e-06 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198363+0000", 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054134045999999998 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198417+0000", 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198534+0000", 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116767 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90641 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253866272, 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534245000000002, 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90641 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0499999999999999e-07 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144236+0000", 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144242+0000", 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5210000000000002e-06 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144253+0000", 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1297e-05 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198574+0000", 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054321665999999998 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198647+0000", 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2031000000000002e-05 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198768+0000", 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121703 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90642 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253841592000001, 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054727525999999999, 2024-09-11T06:18:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90642 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144261+0000", 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T06:18:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144267+0000", 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7749999999999998e-06 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144271+0000", 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5399999999999997e-06 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198806+0000", 2024-09-11T06:18:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534816999999999 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198867+0000", 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0776999999999998e-05 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198986+0000", 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119203 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90643 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253823563000001, 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054909368, 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90643 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144279+0000", 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.801e-06 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144284+0000", 2024-09-11T06:18:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.451e-06 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144289+0000", 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199018+0000", 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054728994000000003 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199072+0000", 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3705999999999997e-05 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199186+0000", 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114521 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90644 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253806376, 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055086361, 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90644 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144296+0000", 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.728e-06 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144301+0000", 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4009999999999996e-06 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144306+0000", 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4159999999999997e-06 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199216+0000", 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054910051000000001 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199269+0000", 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3341000000000003e-05 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199380+0000", 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111103 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253789402999999, 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:18:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:18:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253771977, 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:18:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:18:46.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.494 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.253754721, 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:46.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:46.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:46.499 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:46.500 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:46.500 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:46.499+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:46.601 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:46.600+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:46.616 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:46.616 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:46.616 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:46.616 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:46.625 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:46.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:46.709+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:46.768 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:46.768 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:46.769 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:46.769 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:46.769 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:46.777 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:46.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:46.817+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:46.905 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:46.905+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:46.921 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 87.604081172999997, 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:46.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 81.291507955, 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.928 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:46.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:46.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:46.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68256 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458677998999999, 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018100349000000002, 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68256 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.934 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461407+0000", 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6800000000000001e-07 2024-09-11T06:18:46.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461416+0000", 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8409999999999995e-06 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461422+0000", 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.806e-06 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461427+0000", 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5040000000000004e-06 2024-09-11T06:18:46.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479297+0000", 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017870381000000001 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479385+0000", 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7690999999999998e-05 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479506+0000", 2024-09-11T06:18:46.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012165800000000001 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68257 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458649530999999, 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018398100000000001, 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68257 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999995e-07 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461437+0000", 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2740000000000002e-06 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461444+0000", 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6769999999999998e-06 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461450+0000", 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7810000000000002e-06 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479581+0000", 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018131278000000001 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479687+0000", 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105931 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479833+0000", 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014557200000000001 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68258 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 311296~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.942 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458628473000001, 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01871913, 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68258 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:46.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.32e-07 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461464+0000", 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461470+0000", 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1120000000000001e-06 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461475+0000", 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7199999999999997e-06 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479865+0000", 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018390118 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480028+0000", 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016266800000000001 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480175+0000", 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147236 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68259 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 339968~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458604011999999, 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018993309999999999, 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.947 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68259 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461481+0000", 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6499999999999999e-07 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461483+0000", 2024-09-11T06:18:46.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461488+0000", 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5319999999999997e-06 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461493+0000", 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.634e-06 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480206+0000", 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018713032000000001 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480367+0000", 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016139799999999999 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480473+0000", 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106346 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68260 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 380928~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458585812999999, 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019218077, 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68260 2024-09-11T06:18:46.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461499+0000", 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461501+0000", 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7600000000000001e-06 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461506+0000", 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7989999999999999e-06 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461511+0000", 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480510+0000", 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018999095000000001 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480604+0000", 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3795000000000006e-05 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480716+0000", 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112389 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68326 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458151167, 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019001186999999999, 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.956 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68326 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9299999999999998e-07 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461935+0000", 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461941+0000", 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461947+0000", 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9519999999999999e-06 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480755+0000", 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018807739 2024-09-11T06:18:46.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480838+0000", 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3145000000000004e-05 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480934+0000", 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6009999999999997e-05 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68343 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458113880999999, 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019314591999999998, 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68343 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.961 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461971+0000", 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:46.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461977+0000", 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0950000000000001e-06 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461982+0000", 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2950000000000001e-06 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461986+0000", 2024-09-11T06:18:46.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9779999999999999e-06 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480964+0000", 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01897832 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481041+0000", 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6755000000000006e-05 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481285+0000", 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000243804 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68352 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458052535, 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019458092, 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.965 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68352 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4099999999999999e-07 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462034+0000", 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.725e-06 2024-09-11T06:18:46.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462040+0000", 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462044+0000", 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4619999999999998e-06 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481326+0000", 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281586999999999 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481420+0000", 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3727000000000006e-05 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481490+0000", 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0174999999999998e-05 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68369 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.458012751999998, 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019575028000000001, 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68369 2024-09-11T06:18:46.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462072+0000", 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9399999999999995e-07 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462074+0000", 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.711e-06 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462080+0000", 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-06 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462084+0000", 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5279999999999997e-06 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481519+0000", 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019434165 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481575+0000", 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6489000000000001e-05 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481646+0000", 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1271000000000003e-05 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:110494 3.1b 3:db2012be:::rbd_data.116d6837dfb5.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 12.231265749, 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026675217000000001, 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.974 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 110494 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688819+0000", 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4399999999999999e-07 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688823+0000", 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7699999999999999e-06 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688831+0000", 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6820000000000003e-06 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688835+0000", 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1980000000000003e-06 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688876+0000", 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1313999999999998e-05 2024-09-11T06:18:46.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688932+0000", 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5559000000000001e-05 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.693699+0000", 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004767238 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715356+0000", 2024-09-11T06:18:46.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021657342 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715375+0000", 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9241000000000001e-05 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715435+0000", 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9509000000000002e-05 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715494+0000", 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8619999999999998e-05 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111656 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 1900544~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4829904010000003, 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017837603, 2024-09-11T06:18:46.980 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111656 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:46.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437096+0000", 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437103+0000", 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3860000000000004e-06 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437108+0000", 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2750000000000003e-06 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454788+0000", 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017679812999999999 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454836+0000", 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7882e-05 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454931+0000", 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5673000000000004e-05 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111657 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4829562559999996, 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018066136, 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.985 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111657 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437132+0000", 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2310000000000001e-06 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437141+0000", 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2539999999999998e-06 2024-09-11T06:18:46.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437147+0000", 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.19e-06 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454968+0000", 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017820722000000001 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455050+0000", 2024-09-11T06:18:46.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1954999999999997e-05 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455194+0000", 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014418499999999999 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111658 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2555904~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:46.989 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4829275739999996, 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018208022000000001, 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111658 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437160+0000", 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7250000000000002e-06 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437167+0000", 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7669999999999998e-06 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437172+0000", 2024-09-11T06:18:46.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2830000000000001e-06 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455224+0000", 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018051851000000001 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455271+0000", 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7277999999999997e-05 2024-09-11T06:18:46.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455365+0000", 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3572000000000005e-05 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111659 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2752512~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4829058209999992, 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018392750999999999, 2024-09-11T06:18:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111659 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437179+0000", 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437181+0000", 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437187+0000", 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437192+0000", 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455406+0000", 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018214088 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455460+0000", 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3782000000000001e-05 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:46.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455571+0000", 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011140499999999999 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111665 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 1769472~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4828861250000003, 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018690556000000001, 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:46.999 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111665 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437200+0000", 2024-09-11T06:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437207+0000", 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3759999999999996e-06 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437212+0000", 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1410000000000004e-06 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455621+0000", 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018408620000000001 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455715+0000", 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4238000000000001e-05 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455889+0000", 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173769 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111666 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 1966080~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4828660159999991, 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018930618, 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.004 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111666 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437219+0000", 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437221+0000", 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9709999999999998e-06 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437227+0000", 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.268e-06 2024-09-11T06:18:47.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437232+0000", 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1490000000000002e-06 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455924+0000", 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018692200999999999 2024-09-11T06:18:47.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456003+0000", 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8368999999999995e-05 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456149+0000", 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014622999999999999 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.008 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111667 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4828462130000002, 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019219610000000002, 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.009 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111667 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437245+0000", 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1049999999999997e-06 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437252+0000", 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9399999999999996e-06 2024-09-11T06:18:47.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437258+0000", 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3639999999999998e-06 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456202+0000", 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018944427999999999 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456295+0000", 2024-09-11T06:18:47.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3268000000000002e-05 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456458+0000", 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016213100000000001 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111668 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 2621440~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:47.013 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.4828199360000003, 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019372776000000001, 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111668 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:47.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437265+0000", 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437267+0000", 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.069e-06 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437273+0000", 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3690000000000003e-06 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437278+0000", 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.169e-06 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456496+0000", 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019217304000000001 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456547+0000", 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1004000000000002e-05 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456637+0000", 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0402000000000006e-05 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.018 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:47.019 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:47.020 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:47.018+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:47.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:18:47.121 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:47.120+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:47.166 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:47.166 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:47.166 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:47.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:47.181 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-11T06:18:47.221 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:47.221+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:47.282 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:47.282 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:47.282 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:47.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:47.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:47.336+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:47.395 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29679 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3260416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957843449000002, 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025777099000000001, 2024-09-11T06:18:47.396 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29679 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:47.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436323+0000", 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0079999999999999e-06 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436326+0000", 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436329+0000", 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461989+0000", 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025660388999999999 2024-09-11T06:18:47.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462029+0000", 2024-09-11T06:18:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9854000000000002e-05 2024-09-11T06:18:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462099+0000", 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0167999999999996e-05 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29680 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3473408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957833931000003, 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025900241000000001, 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.402 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29680 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:47.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436332+0000", 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1899999999999999e-07 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436333+0000", 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.049e-06 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436336+0000", 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8830000000000002e-06 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436338+0000", 2024-09-11T06:18:47.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4700000000000001e-06 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462122+0000", 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025784081 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462162+0000", 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9774999999999998e-05 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462232+0000", 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9764000000000005e-05 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29681 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3588096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:47.407 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957822372999999, 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026043075999999998, 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29681 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436344+0000", 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436348+0000", 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-06 2024-09-11T06:18:47.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436350+0000", 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462257+0000", 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025906966999999999 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462304+0000", 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7448999999999999e-05 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462386+0000", 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.174e-05 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.412 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29682 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957812363999999, 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026216950999999999, 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.413 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29682 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436354+0000", 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436357+0000", 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436360+0000", 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.464e-06 2024-09-11T06:18:47.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462412+0000", 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026052230999999999 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462459+0000", 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7207999999999999e-05 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462570+0000", 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110968 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29683 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957802928, 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026370945, 2024-09-11T06:18:47.418 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29683 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436363+0000", 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436364+0000", 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436367+0000", 2024-09-11T06:18:47.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436369+0000", 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5059999999999998e-06 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462606+0000", 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026237114999999998 2024-09-11T06:18:47.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462653+0000", 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462733+0000", 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0605999999999994e-05 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.423 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29684 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957793322000001, 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026632194000000001, 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29684 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436373+0000", 2024-09-11T06:18:47.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6899999999999996e-07 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436376+0000", 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9699999999999999e-06 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436379+0000", 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:18:47.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462758+0000", 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026378990000000001 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462846+0000", 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8641999999999996e-05 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463004+0000", 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015788 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29685 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.429 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957783808000002, 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026764263, 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29685 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.430 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436383+0000", 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436386+0000", 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436388+0000", 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6570000000000001e-06 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463023+0000", 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026634722 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463068+0000", 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5025999999999999e-05 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463146+0000", 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7729000000000001e-05 2024-09-11T06:18:47.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29686 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957773819000003, 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026966905999999999, 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.435 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29686 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436393+0000", 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436396+0000", 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.915e-06 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436398+0000", 2024-09-11T06:18:47.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463173+0000", 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026774703 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463242+0000", 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9770000000000005e-05 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463358+0000", 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116038 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29687 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.440 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957764591, 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027120658999999998, 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29687 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.441 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436402+0000", 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436405+0000", 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8899999999999999e-06 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436407+0000", 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463391+0000", 2024-09-11T06:18:47.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026983285999999999 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463433+0000", 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2481999999999997e-05 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463521+0000", 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8373000000000002e-05 2024-09-11T06:18:47.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29688 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.95775519, 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027291494999999999, 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29688 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436411+0000", 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-06 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436414+0000", 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8940000000000002e-06 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436417+0000", 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5069999999999999e-06 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463562+0000", 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027144622 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463621+0000", 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9108999999999999e-05 2024-09-11T06:18:47.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463702+0000", 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29689 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.451 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957745662999997, 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027435349000000001, 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29689 2024-09-11T06:18:47.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436423+0000", 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436426+0000", 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0010000000000002e-06 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436429+0000", 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4739999999999999e-06 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463726+0000", 2024-09-11T06:18:47.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027297482000000001 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463780+0000", 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3714000000000001e-05 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463855+0000", 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5278000000000007e-05 2024-09-11T06:18:47.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29690 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957733849999997, 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027575023000000001, 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29690 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436433+0000", 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436436+0000", 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8959999999999999e-06 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436438+0000", 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.514e-06 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463880+0000", 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027442151000000001 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463924+0000", 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3983000000000002e-05 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464007+0000", 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2274000000000005e-05 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29691 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957723753000003, 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027733827999999999, 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29691 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436443+0000", 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.279e-06 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436446+0000", 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436449+0000", 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:18:47.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464034+0000", 2024-09-11T06:18:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027585492 2024-09-11T06:18:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464082+0000", 2024-09-11T06:18:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7444999999999997e-05 2024-09-11T06:18:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464175+0000", 2024-09-11T06:18:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3954000000000002e-05 2024-09-11T06:18:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.468 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29692 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5439488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957713923, 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027927924, 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.469 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29692 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:47.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436452+0000", 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436453+0000", 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1179999999999999e-06 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436456+0000", 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436458+0000", 2024-09-11T06:18:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464214+0000", 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027755618999999999 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464266+0000", 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2354000000000001e-05 2024-09-11T06:18:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464379+0000", 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011328900000000001 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29693 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5554176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957704520999997, 2024-09-11T06:18:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028112022, 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29693 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436462+0000", 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.031e-06 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436465+0000", 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3230000000000002e-06 2024-09-11T06:18:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436468+0000", 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4870000000000001e-06 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464414+0000", 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027946104999999999 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464468+0000", 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3637999999999997e-05 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464573+0000", 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105232 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29694 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5767168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957694580000002, 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028256073999999999, 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29694 2024-09-11T06:18:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436472+0000", 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436475+0000", 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8870000000000001e-06 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436478+0000", 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464591+0000", 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028113171999999999 2024-09-11T06:18:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464643+0000", 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950999999999998e-05 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464727+0000", 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4133000000000002e-05 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29695 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5881856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957684882000002, 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02845924, 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29695 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436482+0000", 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.111e-06 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436485+0000", 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436487+0000", 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5859999999999999e-06 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464762+0000", 2024-09-11T06:18:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028274773 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464848+0000", 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6269999999999999e-05 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464940+0000", 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1345e-05 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29696 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6094848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957675152, 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028603799999999999, 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29696 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436491+0000", 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.879999999999999e-07 2024-09-11T06:18:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436494+0000", 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8339999999999999e-06 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436497+0000", 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.328e-06 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464970+0000", 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028473196999999999 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465017+0000", 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465094+0000", 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6606999999999993e-05 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29697 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6209536~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 58.957662536999997, 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028751832000000001, 2024-09-11T06:18:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29697 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436504+0000", 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.319e-06 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436508+0000", 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2729999999999998e-06 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436510+0000", 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465125+0000", 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028614537999999998 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465174+0000", 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8965000000000003e-05 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465255+0000", 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0798999999999997e-05 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.050926053000001, 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:18:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:18:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:18:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.506 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:47.509 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3341 write 0x1f4b93f thru 0x1f5a880 (0xef42 bytes) 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3342 trunc from 0x3cd1ee1 to 0xdb682df 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3343 read 0x8b08a35 thru 0x8b09683 (0xc4f bytes) 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3344 writesame 0x5b0d72d thru 0x5b1554a data_size 0x3(0x7e1e bytes) 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3347 read 0x97fcd9a thru 0x9802342 (0x55a9 bytes) 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3348 read 0x293c358 thru 0x2940003 (0x3cac bytes) 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3349 punch from 0x31c65d to 0x31f1bc, (0x2b5f bytes) 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3350 trunc from 0xdb682df to 0x84334c8 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3351 read 0x2712f3a thru 0x2721a24 (0xeaeb bytes) 2024-09-11T06:18:47.510 INFO:teuthology.orchestra.run.smithi070.stdout:3352 write 0x18c8bdc thru 0x18c8c2a (0x4f bytes) 2024-09-11T06:18:47.511 INFO:teuthology.orchestra.run.smithi070.stdout:3353 write 0xcdccdf thru 0xcdeeac (0x21ce bytes) 2024-09-11T06:18:47.511 INFO:teuthology.orchestra.run.smithi070.stdout:3354 clone 27 order 25 su 4194304 sc 5 2024-09-11T06:18:47.511 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:47.507+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:47.609 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:47.608+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:47.653 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:47.653 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:47.653 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:47.662 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:47.745 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:47.745+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:47.805 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:47.805 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:47.805 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:47.810 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:47.810+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:47.813 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:47.912 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:47.911+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:47.958 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430823080000003, 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:18:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430804631000001, 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:18:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430773834, 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:18:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430754825999998, 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:18:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:18:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430736158000002, 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:18:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:18:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430714098999999, 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:18:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430695235000002, 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430675454000003, 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430656526, 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.994 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:18:47.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:47.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:47.998 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430616045999997, 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:47.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:18:48.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.430585936999996, 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:18:48.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:18:48.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.428494741000002, 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.007 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.42841782, 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.011 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:48.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.015 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.42839352, 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:18:48.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.428358101000001, 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:48.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.428340896999998, 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.024 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:48.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:48.028 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.428324633999999, 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:18:48.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.428307656999998, 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:18:48.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:18:48.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:18:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.428291672, 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:18:48.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.428273703000002, 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.041 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:18:48.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.045 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:48.047 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:48.047 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:48.046+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:48.119 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:18:48.147 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:48.146+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:48.153 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:48.153 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:48.153 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:48.162 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:48.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:48.247+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:48.304 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:48.304 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:48.304 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:48.304 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:48.304 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:48.313 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:48.341 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:48.355 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:48.354+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:48.448 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:48.448+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:48.458 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.21741488, 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.459 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:18:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217402141999997, 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.464 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:18:48.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.468 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217391009000004, 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:18:48.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217380421000001, 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:18:48.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.477 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217369926000003, 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217359612999999, 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.483 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:18:48.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217349071000001, 2024-09-11T06:18:48.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:48.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:48.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:18:48.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217338765000001, 2024-09-11T06:18:48.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:48.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:18:48.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:18:48.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217323186999998, 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:48.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:18:48.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.217304181999999, 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:18:48.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:18:48.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.509 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157774809000003, 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:18:48.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:18:48.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157756337999999, 2024-09-11T06:18:48.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:48.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:18:48.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157737847999996, 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.519 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:18:48.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:18:48.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.523 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157720779999998, 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.524 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:18:48.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.528 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157702749000002, 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:18:48.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157680565, 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.533 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:48.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:18:48.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157662573000003, 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.538 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:18:48.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157644918999999, 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.543 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:18:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157622003, 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.548 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:48.552 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.157603614999999, 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:48.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:18:48.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:48.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:18:48.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:18:48.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:48.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:48.557 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:48.558 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:48.558 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:48.559 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:48.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:48.560 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:48.560 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:48.560 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:48.561 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:48.561 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:48.561 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:48.562 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:48.562 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:48.562 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:48.562 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:48.563 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:48.557+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:48.563 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:48.563 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:48.566 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:48.567 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:48.659 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:48.658+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:48.665 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:48.665 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:48.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:48.760 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:48.759+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:48.816 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:48.816 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:48.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:48.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:48.860+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:48.962 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:48.961+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:48.967 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:48.967 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:48.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:49.064 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:49.063+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:49.120 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:49.120 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:49.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:49.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:49.164+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:49.240 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:49.240 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:49.249 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:49.293 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:49.292+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:49.352 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:49.353 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:49.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:49.402 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:49.401+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:49.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:49.467+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:49.503 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:49.503 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:49.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:49.569 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:49.568+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:49.614 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:49.614 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:49.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:49.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:49.669+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:49.725 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:49.725 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:49.734 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:49.770 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:49.769+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:49.850 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:49.851 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:49.859 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:49.871 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:49.870+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:49.962 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:49.963 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:49.971 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:49.972 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:49.970+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:50.029 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [2] live_osds: [0, 3, 4, 5, 6, 7, 1] 2024-09-11T06:18:50.029 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:18:50.030 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-11T06:18:50.030 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T06:18:50.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T06:18:50.033 INFO:tasks.ceph.osd.2:Started 2024-09-11T06:18:50.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:50.072 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:50.071+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:50.076 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:50.076 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:50.084 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:50.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:no valid command found; 10 closest matches: 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:0 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:1 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:2 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:abort 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:assert 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:config diff 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:config diff get 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:config get 2024-09-11T06:18:50.140 INFO:teuthology.orchestra.run.smithi070.stderr:config help [] 2024-09-11T06:18:50.141 INFO:teuthology.orchestra.run.smithi070.stderr:config set ... 2024-09-11T06:18:50.141 INFO:teuthology.orchestra.run.smithi070.stderr:admin_socket: invalid command 2024-09-11T06:18:50.143 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T06:18:50.144 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-11T06:18:50.185 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:50.184+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:50.228 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-11T06:18:50.230 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:50.230 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:50.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:50.282 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:50.282+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:50.297 INFO:teuthology.orchestra.run.smithi070.stdout:3355 punch from 0x3590bd6 to 0x35955fb, (0x4a25 bytes) 2024-09-11T06:18:50.301 INFO:teuthology.orchestra.run.smithi070.stdout:3356 read 0x20e5c3f thru 0x20e7c5b (0x201d bytes) 2024-09-11T06:18:50.307 INFO:teuthology.orchestra.run.smithi070.stdout:3358 trunc from 0x84334c8 to 0xd19a60b 2024-09-11T06:18:50.317 INFO:teuthology.orchestra.run.smithi070.stdout:3360 trunc from 0xd19a60b to 0x98327c7 2024-09-11T06:18:50.325 INFO:teuthology.orchestra.run.smithi070.stdout:3361 read 0x4676ec7 thru 0x468289b (0xb9d5 bytes) 2024-09-11T06:18:50.326 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:50.331 INFO:teuthology.orchestra.run.smithi070.stdout:3367 trunc from 0x98327c7 to 0xde21ca3 2024-09-11T06:18:50.336 INFO:teuthology.orchestra.run.smithi070.stdout:3368 read 0xc80bf45 thru 0xc815fc6 (0xa082 bytes) 2024-09-11T06:18:50.337 INFO:teuthology.orchestra.run.smithi070.stdout:3369 write 0x5dfd90a thru 0x5e04b54 (0x724b bytes) 2024-09-11T06:18:50.341 INFO:teuthology.orchestra.run.smithi070.stdout:3370 write 0x27db84 thru 0x282922 (0x4d9f bytes) 2024-09-11T06:18:50.341 INFO:teuthology.orchestra.run.smithi070.stdout:3371 read 0x78c65eb thru 0x78d5b78 (0xf58e bytes) 2024-09-11T06:18:50.341 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:50.341 INFO:teuthology.orchestra.run.smithi070.stdout:3375 read 0xcdf1827 thru 0xce003ea (0xebc4 bytes) 2024-09-11T06:18:50.341 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:50.342 INFO:teuthology.orchestra.run.smithi070.stdout:3379 trunc from 0xde21ca3 to 0xc384c72 2024-09-11T06:18:50.344 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:50.345 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:50.348 INFO:teuthology.orchestra.run.smithi070.stdout:3380 read 0xb6da479 thru 0xb6dc51a (0x20a2 bytes) 2024-09-11T06:18:50.349 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:50.349 INFO:teuthology.orchestra.run.smithi070.stdout:3382 read 0x5809fae thru 0x5817730 (0xd783 bytes) 2024-09-11T06:18:50.349 INFO:teuthology.orchestra.run.smithi070.stdout:3383 read 0xa50ef6c thru 0xa516dd8 (0x7e6d bytes) 2024-09-11T06:18:50.349 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:50.349 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:50.349 INFO:teuthology.orchestra.run.smithi070.stdout:3388 writesame 0x53d26fd thru 0x53e17c5 data_size 0x1b(0xf0c9 bytes) 2024-09-11T06:18:50.351 INFO:teuthology.orchestra.run.smithi070.stdout:3389 punch from 0x1d7d82e to 0x1d8b000, (0xd7d2 bytes) 2024-09-11T06:18:50.351 INFO:teuthology.orchestra.run.smithi070.stdout:3390 clone 28 order 25 su 4194304 sc 8 2024-09-11T06:18:50.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:50.375 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:50.374+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:50.475 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:50.475+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:50.498 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:50.498 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:50.507 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:50.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:50.612 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:50.611+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:50.651 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:50.651 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:50.660 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:50.687 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:50.687 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:50.703 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:50.704 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:50.704 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:50.704 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:50.703+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:50.720 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:50.720 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:50.738 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:50.738 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:50.754 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:50.765 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:50.765 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:50.772 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:50.774 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:50.788 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:50.789 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:50.791 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:50.792 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:50.816 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:50.815+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:50.879 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:50.878+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:50.919 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:50.919 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:50.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:50.919 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:50.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.919 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.919 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391701146999999, 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391682697999997, 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:18:50.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391651901000003, 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:50.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:50.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391632893000001, 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:18:50.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391614224999998, 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:50.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:18:50.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:18:50.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391592166000002, 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:18:50.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.946 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391573301999998, 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.947 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:18:50.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391553520999999, 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.951 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391534593000003, 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:50.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:18:50.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:18:50.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391494113, 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.960 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.391464003999999, 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.964 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:18:50.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389372807999997, 2024-09-11T06:18:50.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389295887000003, 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389271587000003, 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389236167999996, 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.980 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389218964000001, 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.984 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389202701000002, 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.988 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:18:50.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389185724000001, 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:18:50.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389169739000003, 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:50.996 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:18:50.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:18:50.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.389151769999998, 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:18:51.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:18:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.004 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.004 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:51.005 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:51.006 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:51.004+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:51.105 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:51.105+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:51.133 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:18:51.151 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:51.151 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:51.162 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:51.206 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:51.206+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:51.264 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:51.264 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:51.264 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:51.264 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:51.264 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:51.273 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:51.307 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:51.306+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:51.408 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:51.408+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:51.419 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:51.419 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:51.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:51.419 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:51.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178139944999998, 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.420 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:18:51.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:51.424 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178127207000003, 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:18:51.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178116074000002, 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.429 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:18:51.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178105486, 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:18:51.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178094991000002, 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.438 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:18:51.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178084677999998, 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:18:51.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:18:51.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178074135999999, 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.451 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178063829999999, 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:18:51.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:18:51.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:18:51.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178048252000004, 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:18:51.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.460 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.178029246999998, 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:18:51.464 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118499874000001, 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.465 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:18:51.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.469 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118481402999997, 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:18:51.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118462913000002, 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:18:51.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.478 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118445844999997, 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:18:51.482 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118427814, 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.483 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:18:51.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118405629999998, 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:18:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:18:51.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:18:51.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.491 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118387638000002, 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:18:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:18:51.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118369983999997, 2024-09-11T06:18:51.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:18:51.500 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118347067999999, 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:18:51.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 63.118328679999998, 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:51.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:18:51.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:18:51.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.509 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.510 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.510 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:51.510 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:51.510 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:51.510 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:51.493+0000 7ff160885640 -1 Falling back to public interface 2024-09-11T06:18:51.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:51.512 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:51.510+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:51.612 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:51.611+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:51.615 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:51.615 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:51.616 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:51.616 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:51.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:51.713 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:51.712+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:51.769 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:51.769 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:51.769 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:51.769 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:51.769 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:51.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:51.814 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:51.813+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65211 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 290816~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.572708537, 2024-09-11T06:18:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011362828, 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65211 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:51.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9299999999999999e-07 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307760+0000", 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0779999999999998e-06 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307768+0000", 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307773+0000", 2024-09-11T06:18:51.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.87e-06 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.317997+0000", 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010223922 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318245+0000", 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024794699999999999 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.319120+0000", 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087475300000000003 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65358 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 196608~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.561751034, 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01178332, 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65358 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318717+0000", 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1739999999999999e-06 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318726+0000", 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2089999999999994e-06 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318731+0000", 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9690000000000002e-06 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.329832+0000", 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011100376 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330093+0000", 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026168699999999998 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330498+0000", 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040453100000000002 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65359 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:51.891 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.561726696000001, 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012518262, 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65359 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4200000000000001e-07 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318741+0000", 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0439999999999998e-06 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318750+0000", 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7239999999999998e-06 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318755+0000", 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8080000000000004e-06 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330616+0000", 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011861349 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330867+0000", 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025063199999999998 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331257+0000", 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039026300000000001 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65360 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 266240~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.561704218999999, 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013368422, 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65360 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318762+0000", 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318764+0000", 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318772+0000", 2024-09-11T06:18:51.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1519999999999992e-06 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318783+0000", 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0956e-05 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331395+0000", 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012611938 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331643+0000", 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000248244 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332130+0000", 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048681400000000002 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65382 3.10 3:0bf53440:::rbd_data.116dccfba5d9.0000000000000049:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:51.900 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.561676939000002, 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013819148, 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65382 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318791+0000", 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9750000000000001e-06 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318799+0000", 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5989999999999996e-06 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318803+0000", 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5090000000000004e-06 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332201+0000", 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013397714 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332295+0000", 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4426999999999996e-05 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332608+0000", 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031258700000000002 2024-09-11T06:18:51.904 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65418 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.557146244999998, 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011186454, 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65418 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323320+0000", 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0900000000000001e-07 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323323+0000", 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.021e-06 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323333+0000", 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0343000000000001e-05 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323339+0000", 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1109999999999996e-06 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334123+0000", 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010783789 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334216+0000", 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2458000000000001e-05 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334506+0000", 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029012299999999999 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65455 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 159744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.555699085000001, 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010864807000000001, 2024-09-11T06:18:51.909 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65455 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324769+0000", 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1160000000000002e-06 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324775+0000", 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7969999999999997e-06 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324779+0000", 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9430000000000002e-06 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335383+0000", 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604001 2024-09-11T06:18:51.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335467+0000", 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4214000000000004e-05 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335631+0000", 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164334 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65456 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.555681412999999, 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011134408, 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65456 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8599999999999999e-07 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324786+0000", 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.629e-06 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324791+0000", 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3299999999999998e-06 2024-09-11T06:18:51.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324795+0000", 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8e-06 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335661+0000", 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010865718 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335745+0000", 2024-09-11T06:18:51.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3776999999999994e-05 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335919+0000", 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017386800000000001 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65457 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:51.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.555664826000001, 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011510302, 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65457 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:51.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324803+0000", 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7910000000000001e-06 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324808+0000", 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2979999999999999e-06 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324812+0000", 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9430000000000002e-06 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335955+0000", 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011142987 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.336053+0000", 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7985000000000005e-05 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.336311+0000", 2024-09-11T06:18:51.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025792799999999999 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106380 3.1c 3:3eaf6144:::rbd_data.116d419b7418.000000000000027b:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.159054633, 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010923146999999999, 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106380 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:18:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721413+0000", 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8360000000000001e-06 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721419+0000", 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4269999999999999e-06 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721423+0000", 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.374e-06 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732252+0000", 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010829099999999999 2024-09-11T06:18:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732334+0000", 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2008000000000005e-05 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106382 3.1c 3:3d8acb81:::rbd_data.116d419b7418.000000000000027d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.159010903999999, 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010982667999999999, 2024-09-11T06:18:51.927 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106382 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:18:51.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9900000000000001e-07 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721458+0000", 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.345e-06 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721464+0000", 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4679999999999997e-06 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721470+0000", 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T06:18:51.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732362+0000", 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010892456999999999 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732437+0000", 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4871999999999997e-05 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106383 3.1c 3:3d5051d7:::rbd_data.116d419b7418.000000000000027e:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.158988664999999, 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011059616, 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106383 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.932 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7199999999999999e-07 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721482+0000", 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9960000000000001e-06 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721489+0000", 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721494+0000", 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1100000000000002e-06 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732464+0000", 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010969845000000001 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732537+0000", 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3026000000000002e-05 2024-09-11T06:18:51.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106426 3.1c 3:3b52f154:::rbd_data.116d419b7418.00000000000002b5:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.158916333000001, 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011086477000000001, 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106426 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:18:51.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721550+0000", 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000005e-07 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721551+0000", 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4759999999999999e-06 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721556+0000", 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9309999999999999e-06 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721560+0000", 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732563+0000", 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011003590000000001 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732636+0000", 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2311999999999995e-05 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106442 3.1c 3:3847cd45:::rbd_data.116d419b7418.00000000000002c5:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.15886763, 2024-09-11T06:18:51.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011139990000000001, 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106442 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:18:51.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721600+0000", 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721604+0000", 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8260000000000003e-06 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721606+0000", 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732662+0000", 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011056112999999999 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732738+0000", 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5726e-05 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106464 3.1c 3:3dce2b45:::rbd_data.116d419b7418.00000000000002e1:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.158844448, 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011200432999999999, 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106464 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1400000000000001e-07 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721622+0000", 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-07 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721626+0000", 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5880000000000002e-06 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721629+0000", 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3079999999999999e-06 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732765+0000", 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011135369000000001 2024-09-11T06:18:51.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732822+0000", 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6974e-05 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106491 3.1c 3:3b1800f8:::rbd_data.116d419b7418.00000000000002fc:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:18:51.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.158802119000001, 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011247679999999999, 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106491 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721664+0000", 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721677+0000", 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2967e-05 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721681+0000", 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9519999999999996e-06 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721683+0000", 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7779999999999999e-06 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732849+0000", 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011165542000000001 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732911+0000", 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2199999999999994e-05 2024-09-11T06:18:51.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106493 3.1c 3:3f1dc0e6:::rbd_data.116d419b7418.00000000000002fe:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.158771382000001, 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011331447, 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106493 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721695+0000", 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721696+0000", 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4360000000000001e-06 2024-09-11T06:18:51.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721700+0000", 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7639999999999999e-06 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721702+0000", 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6400000000000001e-06 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732935+0000", 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011232328 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733026+0000", 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0859999999999994e-05 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.958 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106496 3.1c 3:3f844c73:::rbd_data.116d419b7418.0000000000000307:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.158749657000001, 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011423630000000001, 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106496 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:18:51.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721717+0000", 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5199999999999995e-07 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721720+0000", 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1480000000000002e-06 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721723+0000", 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.39e-06 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733056+0000", 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011332844999999999 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733140+0000", 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3959e-05 2024-09-11T06:18:51.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106536 3.1c 3:3b36f16b:::rbd_data.116d419b7418.0000000000000335:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.158720805000002, 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011515332, 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106536 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721746+0000", 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2200000000000002e-07 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721749+0000", 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.523e-06 2024-09-11T06:18:51.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721752+0000", 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5770000000000001e-06 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733168+0000", 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011415483000000001 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733260+0000", 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2612e-05 2024-09-11T06:18:51.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106560 3.1c 3:3f30db2e:::rbd_data.116d419b7418.000000000000034d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.158710714000001, 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011596255999999999, 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:51.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106560 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2100000000000001e-07 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721756+0000", 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8400000000000002e-07 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721760+0000", 2024-09-11T06:18:51.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7809999999999999e-06 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721763+0000", 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.644e-06 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733290+0000", 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011527953000000001 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:51.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733351+0000", 2024-09-11T06:18:51.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0673e-05 2024-09-11T06:18:51.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:51.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:51.971 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:51.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:51.973 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:51.972+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:52.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:52.073+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:52.078 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:52.079 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:52.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:52.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:52.174+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:52.198 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:52.198 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:52.198 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:52.198 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:52.198 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:52.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:52.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:52.274+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.506027638000006, 2024-09-11T06:18:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.169673701000001, 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:18:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:18:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:18:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:18:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:18:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:18:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:18:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.169654360999999, 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.169636012000002, 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:18:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.169617828, 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:18:52.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:18:52.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.169599042000002, 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.169580043, 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:18:52.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:52.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:52.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:18:52.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.169551454, 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:52.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.352 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.169338327999998, 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.353 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166783441, 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:18:52.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:18:52.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:18:52.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166759750000001, 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:18:52.363 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:52.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166739723999999, 2024-09-11T06:18:52.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.372 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166698169, 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:18:52.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:18:52.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:18:52.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:18:52.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166674226000001, 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:52.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:18:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:18:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:18:52.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:18:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:18:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:18:52.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:18:52.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:18:52.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:18:52.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:18:52.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:18:52.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:18:52.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:18:52.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.386 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.387 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.387 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:52.387 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166652817999999, 2024-09-11T06:18:52.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:18:52.387 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:18:52.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:52.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:52.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:52.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:18:52.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:18:52.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:18:52.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:18:52.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:18:52.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:18:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:18:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:18:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:18:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:18:52.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:18:52.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:18:52.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:18:52.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.397 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:52.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166632029999999, 2024-09-11T06:18:52.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:18:52.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:18:52.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.400 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:52.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:52.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:52.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:18:52.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:18:52.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:18:52.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:18:52.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:18:52.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:18:52.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:18:52.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:18:52.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:18:52.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:18:52.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:18:52.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:18:52.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:18:52.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.408 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.408 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.408 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:52.408 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166611995, 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166591858, 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:18:52.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:18:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166569860999999, 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:52.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:52.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:18:52.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.166549796000002, 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:18:52.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.430 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.430 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:52.431 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:52.432 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:52.430+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:52.531 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:52.531+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:52.535 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:52.535 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:52.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:52.633 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:52.632+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:52.647 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:52.647 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:52.647 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:52.647 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:52.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:52.740 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:52.739+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:52.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:52.801 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 113.179976731, 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 112.88554115300001, 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.618977958999999, 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:18:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63576 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.616764194000002, 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053575987999999998, 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63576 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182844+0000", 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182850+0000", 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9970000000000004e-06 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182854+0000", 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1829999999999996e-06 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235811+0000", 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052956403999999999 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235933+0000", 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012229799999999999 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236418+0000", 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048509399999999999 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63577 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.616745273999999, 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053525649000000002, 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63577 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.22e-07 2024-09-11T06:18:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182863+0000", 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9e-06 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182876+0000", 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.311e-05 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182887+0000", 2024-09-11T06:18:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1109e-05 2024-09-11T06:18:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236375+0000", 2024-09-11T06:18:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053487499000000001 2024-09-11T06:18:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236387+0000", 2024-09-11T06:18:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1708999999999999e-05 2024-09-11T06:18:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63578 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.616701766999999, 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053516941999999998, 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63578 2024-09-11T06:18:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182905+0000", 2024-09-11T06:18:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:18:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182908+0000", 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6249999999999999e-06 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182915+0000", 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.525e-06 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182921+0000", 2024-09-11T06:18:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.48e-06 2024-09-11T06:18:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236412+0000", 2024-09-11T06:18:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053491483999999999 2024-09-11T06:18:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236421+0000", 2024-09-11T06:18:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63579 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.616629235000001, 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053483819000000002, 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63579 2024-09-11T06:18:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182978+0000", 2024-09-11T06:18:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.99e-07 2024-09-11T06:18:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182980+0000", 2024-09-11T06:18:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T06:18:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182988+0000", 2024-09-11T06:18:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:18:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182995+0000", 2024-09-11T06:18:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0129999999999996e-06 2024-09-11T06:18:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236448+0000", 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053452983000000003 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236461+0000", 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2865e-05 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63580 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.616602756999999, 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053488579000000001, 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63580 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183004+0000", 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183006+0000", 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0650000000000001e-06 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183013+0000", 2024-09-11T06:18:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183018+0000", 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236482+0000", 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053463869999999997 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236492+0000", 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0471e-05 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90636 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 145408~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655460007999999, 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053568440000000002, 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90636 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144147+0000", 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144148+0000", 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144154+0000", 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4990000000000002e-06 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144158+0000", 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3680000000000004e-06 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197315+0000", 2024-09-11T06:18:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05315698 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197352+0000", 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6510000000000001e-05 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197715+0000", 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036306199999999999 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90637 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655443034000001, 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053721428000000002, 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90637 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144165+0000", 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144171+0000", 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2909999999999998e-06 2024-09-11T06:18:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144175+0000", 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0029999999999996e-06 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197740+0000", 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053565861999999999 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197779+0000", 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8339e-05 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197885+0000", 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105807 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90638 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655425904000001, 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053925155000000002, 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90638 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144181+0000", 2024-09-11T06:18:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144183+0000", 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9479999999999998e-06 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144188+0000", 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4709999999999998e-06 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144193+0000", 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7040000000000002e-06 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197927+0000", 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053734188000000002 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197993+0000", 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5839000000000004e-05 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198105+0000", 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011268 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90639 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655407494999999, 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054132671, 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90639 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144201+0000", 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144207+0000", 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0510000000000002e-06 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144212+0000", 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198160+0000", 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053948788999999997 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198221+0000", 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0395e-05 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198331+0000", 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110541 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90640 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655389137, 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054316443999999998, 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90640 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3099999999999999e-07 2024-09-11T06:18:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144219+0000", 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7549999999999999e-06 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144224+0000", 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2839999999999997e-06 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144229+0000", 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4549999999999997e-06 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198363+0000", 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054134045999999998 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198417+0000", 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198534+0000", 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116767 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90641 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655372237000002, 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534245000000002, 2024-09-11T06:18:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90641 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0499999999999999e-07 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144236+0000", 2024-09-11T06:18:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144242+0000", 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5210000000000002e-06 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144253+0000", 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1297e-05 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198574+0000", 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054321665999999998 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198647+0000", 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2031000000000002e-05 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198768+0000", 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121703 2024-09-11T06:18:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90642 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655347556999999, 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054727525999999999, 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90642 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144261+0000", 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144267+0000", 2024-09-11T06:18:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7749999999999998e-06 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144271+0000", 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5399999999999997e-06 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198806+0000", 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534816999999999 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198867+0000", 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0776999999999998e-05 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198986+0000", 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119203 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90643 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655329527999999, 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054909368, 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90643 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144279+0000", 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.801e-06 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144284+0000", 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.451e-06 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144289+0000", 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199018+0000", 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054728994000000003 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199072+0000", 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3705999999999997e-05 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199186+0000", 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114521 2024-09-11T06:18:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90644 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655312340999998, 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055086361, 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90644 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144296+0000", 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.728e-06 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144301+0000", 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4009999999999996e-06 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144306+0000", 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4159999999999997e-06 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199216+0000", 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054910051000000001 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199269+0000", 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3341000000000003e-05 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199380+0000", 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111103 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655295368000001, 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:18:52.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655277942000001, 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:18:52.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:18:52.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.655260685999998, 2024-09-11T06:18:52.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:52.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:52.904 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:52.904 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:52.905 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:52.906 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:52.904+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:52.912 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:52.929 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:52.930 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:52.930 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:52.945 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:52.945 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:52.962 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:52.962 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:52.980 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:52.980 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:52.997 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:52.997 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:53.006 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:53.005+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:53.013 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:53.014 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:53.017 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:53.017 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:53.023 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:53.024 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:53.033 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:53.107 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:53.106+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:53.135 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:53.136 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:53.147 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:53.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:18:53.209 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:53.208+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:53.250 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:53.251 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:53.259 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:53.282 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-11T06:18:53.309 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:53.308+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:53.365 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:53.365 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:53.373 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:53.413 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:53.409+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:53.431 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.432 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.432 INFO:teuthology.orchestra.run.smithi070.stdout:3393 write 0x100636a thru 0x100f102 (0x8d99 bytes) 2024-09-11T06:18:53.437 INFO:teuthology.orchestra.run.smithi070.stdout:3394 writesame 0xa9a2d12 thru 0xa9b1d80 data_size 0x15(0xf06f bytes) 2024-09-11T06:18:53.439 INFO:teuthology.orchestra.run.smithi070.stdout:3398 read 0x307be3 thru 0x30c8c1 (0x4cdf bytes) 2024-09-11T06:18:53.439 INFO:teuthology.orchestra.run.smithi070.stdout:3399 writesame 0x52f9366 thru 0x52fe70d data_size 0x4(0x53a8 bytes) 2024-09-11T06:18:53.442 INFO:teuthology.orchestra.run.smithi070.stdout:3400 punch from 0x1d5e5f4 to 0x1d6774a, (0x9156 bytes) 2024-09-11T06:18:53.450 INFO:teuthology.orchestra.run.smithi070.stdout:3401 trunc from 0xc384c72 to 0x51c1c5f 2024-09-11T06:18:53.458 INFO:teuthology.orchestra.run.smithi070.stdout:3403 write 0x259c883 thru 0x25abfd5 (0xf753 bytes) 2024-09-11T06:18:53.459 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.459 INFO:teuthology.orchestra.run.smithi070.stdout:3407 read 0x377a9d6 thru 0x3785041 (0xa66c bytes) 2024-09-11T06:18:53.469 INFO:teuthology.orchestra.run.smithi070.stdout:3408 write 0x84ea2f7 thru 0x84f09e9 (0x66f3 bytes) 2024-09-11T06:18:53.471 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.476 INFO:teuthology.orchestra.run.smithi070.stdout:3410 write 0x87cd034 thru 0x87d9661 (0xc62e bytes) 2024-09-11T06:18:53.480 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:53.480 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:53.483 INFO:teuthology.orchestra.run.smithi070.stdout:3411 trunc from 0x87d9662 to 0x32b6554 2024-09-11T06:18:53.490 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:53.501 INFO:teuthology.orchestra.run.smithi070.stdout:3412 write 0x64f8981 thru 0x6505103 (0xc783 bytes) 2024-09-11T06:18:53.502 INFO:teuthology.orchestra.run.smithi070.stdout:3413 read 0x166754f thru 0x166a312 (0x2dc4 bytes) 2024-09-11T06:18:53.510 INFO:teuthology.orchestra.run.smithi070.stdout:3414 trunc from 0x6505104 to 0x47cd2c 2024-09-11T06:18:53.511 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:53.510+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:53.527 INFO:teuthology.orchestra.run.smithi070.stdout:3415 read 0x33405f thru 0x33c3e2 (0x8384 bytes) 2024-09-11T06:18:53.543 INFO:teuthology.orchestra.run.smithi070.stdout:3416 trunc from 0x47cd2c to 0xced72ae 2024-09-11T06:18:53.549 INFO:teuthology.orchestra.run.smithi070.stdout:3417 read 0xa91fdd6 thru 0xa9290fe (0x9329 bytes) 2024-09-11T06:18:53.549 INFO:teuthology.orchestra.run.smithi070.stdout:3418 read 0xb13d6d2 thru 0xb13ed5a (0x1689 bytes) 2024-09-11T06:18:53.549 INFO:teuthology.orchestra.run.smithi070.stdout:3420 punch from 0x333a486 to 0x333dd62, (0x38dc bytes) 2024-09-11T06:18:53.551 INFO:teuthology.orchestra.run.smithi070.stdout:3421 trunc from 0xced72ae to 0xe5ceb20 2024-09-11T06:18:53.556 INFO:teuthology.orchestra.run.smithi070.stdout:3422 writesame 0xbfe7a11 thru 0xbff358e data_size 0x2(0xbb7e bytes) 2024-09-11T06:18:53.567 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.584 INFO:teuthology.orchestra.run.smithi070.stdout:3424 trunc from 0xe5ceb20 to 0x1d109 2024-09-11T06:18:53.600 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:53.600 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:53.606 INFO:teuthology.orchestra.run.smithi070.stdout:3425 writesame 0x33cf010 thru 0x33db187 data_size 0x97(0xc178 bytes) 2024-09-11T06:18:53.606 INFO:teuthology.orchestra.run.smithi070.stdout:3426 punch from 0x19c892a to 0x19d2a95, (0xa16b bytes) 2024-09-11T06:18:53.606 INFO:teuthology.orchestra.run.smithi070.stdout:3427 read 0x2502c4f thru 0x250fac5 (0xce77 bytes) 2024-09-11T06:18:53.609 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:53.611 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:53.610+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:53.622 INFO:teuthology.orchestra.run.smithi070.stdout:3428 write 0xbd9a062 thru 0xbd9d6fb (0x369a bytes) 2024-09-11T06:18:53.625 INFO:teuthology.orchestra.run.smithi070.stdout:3429 punch from 0x6e772d7 to 0x6e7a6a9, (0x33d2 bytes) 2024-09-11T06:18:53.625 INFO:teuthology.orchestra.run.smithi070.stdout:3430 read 0x78c5c11 thru 0x78d3f8b (0xe37b bytes) 2024-09-11T06:18:53.625 INFO:teuthology.orchestra.run.smithi070.stdout:3431 writesame 0xa913db thru 0xa9ab7b data_size 0x39(0x97a1 bytes) 2024-09-11T06:18:53.628 INFO:teuthology.orchestra.run.smithi070.stdout:3432 writesame 0x82d781e thru 0x82db807 data_size 0x1(0x3fea bytes) 2024-09-11T06:18:53.636 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.637 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.637 INFO:teuthology.orchestra.run.smithi070.stdout:3436 write 0x65d7dff thru 0x65dff9d (0x819f bytes) 2024-09-11T06:18:53.639 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.640 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.640 INFO:teuthology.orchestra.run.smithi070.stdout:3442 read 0x62933f7 thru 0x6298c15 (0x581f bytes) 2024-09-11T06:18:53.640 INFO:teuthology.orchestra.run.smithi070.stdout:3444 read 0xa7f4068 thru 0xa7f68e0 (0x2879 bytes) 2024-09-11T06:18:53.640 INFO:teuthology.orchestra.run.smithi070.stdout:3445 write 0x3757f34 thru 0x375dc09 (0x5cd6 bytes) 2024-09-11T06:18:53.652 INFO:teuthology.orchestra.run.smithi070.stdout:3446 trunc from 0xbd9d6fc to 0x604e24c 2024-09-11T06:18:53.671 INFO:teuthology.orchestra.run.smithi070.stdout:3447 write 0xb617e69 thru 0xb625c70 (0xde08 bytes) 2024-09-11T06:18:53.673 INFO:teuthology.orchestra.run.smithi070.stdout:3448 read 0xe292d5 thru 0xe376cb (0xe3f7 bytes) 2024-09-11T06:18:53.673 INFO:teuthology.orchestra.run.smithi070.stdout:3449 punch from 0x97e00ba to 0x97ef45c, (0xf3a2 bytes) 2024-09-11T06:18:53.673 INFO:teuthology.orchestra.run.smithi070.stdout:3451 write 0x974c81d thru 0x975b0ff (0xe8e3 bytes) 2024-09-11T06:18:53.674 INFO:teuthology.orchestra.run.smithi070.stdout:3452 punch from 0x628c2d1 to 0x628edec, (0x2b1b bytes) 2024-09-11T06:18:53.674 INFO:teuthology.orchestra.run.smithi070.stdout:3453 writesame 0x96d2b87 thru 0x96d4a84 data_size 0x1(0x1efe bytes) 2024-09-11T06:18:53.677 INFO:teuthology.orchestra.run.smithi070.stdout:3454 write 0x64f2f53 thru 0x64ff3cc (0xc47a bytes) 2024-09-11T06:18:53.679 INFO:teuthology.orchestra.run.smithi070.stdout:3455 write 0x42b541d thru 0x42b93cb (0x3faf bytes) 2024-09-11T06:18:53.680 INFO:teuthology.orchestra.run.smithi070.stdout:3456 read 0x90351d7 thru 0x9036d68 (0x1b92 bytes) 2024-09-11T06:18:53.688 INFO:teuthology.orchestra.run.smithi070.stdout:3457 trunc from 0xb625c71 to 0x4b9033d 2024-09-11T06:18:53.697 INFO:teuthology.orchestra.run.smithi070.stdout:3458 read 0x471796c thru 0x471ffac (0x8641 bytes) 2024-09-11T06:18:53.697 INFO:teuthology.orchestra.run.smithi070.stdout:3459 read 0x212b7b thru 0x21378d (0xc13 bytes) 2024-09-11T06:18:53.705 INFO:teuthology.orchestra.run.smithi070.stdout:3460 writesame 0x50a4337 thru 0x50adef7 data_size 0x1(0x9bc1 bytes) 2024-09-11T06:18:53.711 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:53.711+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:53.720 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:53.721 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:53.723 INFO:teuthology.orchestra.run.smithi070.stdout:3461 write 0xedaa506 thru 0xedb2ccf (0x87ca bytes) 2024-09-11T06:18:53.726 INFO:teuthology.orchestra.run.smithi070.stdout:3462 read 0xc83b950 thru 0xc84451a (0x8bcb bytes) 2024-09-11T06:18:53.727 INFO:teuthology.orchestra.run.smithi070.stdout:3464 punch from 0x53e2fae to 0x53ea327, (0x7379 bytes) 2024-09-11T06:18:53.727 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.728 INFO:teuthology.orchestra.run.smithi070.stdout:3466 writesame 0x87c0253 thru 0x87cbae6 data_size 0x2(0xb894 bytes) 2024-09-11T06:18:53.730 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:53.735 INFO:teuthology.orchestra.run.smithi070.stdout:3467 read 0xac32535 thru 0xac40371 (0xde3d bytes) 2024-09-11T06:18:53.737 INFO:teuthology.orchestra.run.smithi070.stdout:3468 read 0x45af46f thru 0x45b6fef (0x7b81 bytes) 2024-09-11T06:18:53.737 INFO:teuthology.orchestra.run.smithi070.stdout:3469 read 0xe4748ac thru 0xe484401 (0xfb56 bytes) 2024-09-11T06:18:53.737 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.737 INFO:teuthology.orchestra.run.smithi070.stdout:3472 write 0xd9d4551 thru 0xd9d9eab (0x595b bytes) 2024-09-11T06:18:53.739 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.739 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.748 INFO:teuthology.orchestra.run.smithi070.stdout:3476 trunc from 0xedb2cd0 to 0x70becaa 2024-09-11T06:18:53.763 INFO:teuthology.orchestra.run.smithi070.stdout:3478 write 0x869ea37 thru 0x86abde3 (0xd3ad bytes) 2024-09-11T06:18:53.764 INFO:teuthology.orchestra.run.smithi070.stdout:3479 read 0x2d73451 thru 0x2d7b2a0 (0x7e50 bytes) 2024-09-11T06:18:53.767 INFO:teuthology.orchestra.run.smithi070.stdout:3481 trunc from 0x86abde4 to 0x61085b2 2024-09-11T06:18:53.784 INFO:teuthology.orchestra.run.smithi070.stdout:3482 writesame 0x8fba3cf thru 0x8fbb6a1 data_size 0x1(0x12d3 bytes) 2024-09-11T06:18:53.793 INFO:teuthology.orchestra.run.smithi070.stdout:3483 trunc from 0x8fbb6a2 to 0x25737fa 2024-09-11T06:18:53.814 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:53.814+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:53.822 INFO:teuthology.orchestra.run.smithi070.stdout:3484 write 0xcad32ad thru 0xcad6bde (0x3932 bytes) 2024-09-11T06:18:53.824 INFO:teuthology.orchestra.run.smithi070.stdout:3485 punch from 0x6f98d31 to 0x6f9a34f, (0x161e bytes) 2024-09-11T06:18:53.824 INFO:teuthology.orchestra.run.smithi070.stdout:3487 punch from 0x81080d6 to 0x8117951, (0xf87b bytes) 2024-09-11T06:18:53.824 INFO:teuthology.orchestra.run.smithi070.stdout:3489 write 0x15f71b5 thru 0x15ff189 (0x7fd5 bytes) 2024-09-11T06:18:53.825 INFO:teuthology.orchestra.run.smithi070.stdout:3490 punch from 0xa24f0cb to 0xa24f548, (0x47d bytes) 2024-09-11T06:18:53.825 INFO:teuthology.orchestra.run.smithi070.stdout:3491 punch from 0x85c4aa1 to 0x85cb4d5, (0x6a34 bytes) 2024-09-11T06:18:53.825 INFO:teuthology.orchestra.run.smithi070.stdout:3492 punch from 0x5e5ca2f to 0x5e6418f, (0x7760 bytes) 2024-09-11T06:18:53.825 INFO:teuthology.orchestra.run.smithi070.stdout:3493 write 0x104963d thru 0x10594d8 (0xfe9c bytes) 2024-09-11T06:18:53.828 INFO:teuthology.orchestra.run.smithi070.stdout:3495 punch from 0x28dceef to 0x28e2ad6, (0x5be7 bytes) 2024-09-11T06:18:53.828 INFO:teuthology.orchestra.run.smithi070.stdout:3497 punch from 0x793fbc9 to 0x794f86f, (0xfca6 bytes) 2024-09-11T06:18:53.828 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.840 INFO:teuthology.orchestra.run.smithi070.stdout:3500 trunc from 0xcad6bdf to 0x2a7ba6d 2024-09-11T06:18:53.860 INFO:teuthology.orchestra.run.smithi070.stdout:3503 write 0x779ddea thru 0x77a2699 (0x48b0 bytes) 2024-09-11T06:18:53.861 INFO:teuthology.orchestra.run.smithi070.stdout:3505 punch from 0x3649bc5 to 0x36521d2, (0x860d bytes) 2024-09-11T06:18:53.869 INFO:teuthology.orchestra.run.smithi070.stdout:3506 trunc from 0x77a269a to 0xe558743 2024-09-11T06:18:53.875 INFO:teuthology.orchestra.run.smithi070.stdout:3507 write 0xb2c3242 thru 0xb2ce0b7 (0xae76 bytes) 2024-09-11T06:18:53.877 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.877 INFO:teuthology.orchestra.run.smithi070.stdout:3510 writesame 0xba84183 thru 0xba91aaf data_size 0x1(0xd92d bytes) 2024-09-11T06:18:53.879 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:53.879 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:53.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:53.898 INFO:teuthology.orchestra.run.smithi070.stdout:3512 trunc from 0xe558743 to 0xb912ce6 2024-09-11T06:18:53.905 INFO:teuthology.orchestra.run.smithi070.stdout:3513 read 0x921da40 thru 0x921f89c (0x1e5d bytes) 2024-09-11T06:18:53.907 INFO:teuthology.orchestra.run.smithi070.stdout:3514 trunc from 0xb912ce6 to 0xa27eb91 2024-09-11T06:18:53.915 INFO:teuthology.orchestra.run.smithi070.stdout:3515 read 0x51066f thru 0x51e85e (0xe1f0 bytes) 2024-09-11T06:18:53.915 INFO:teuthology.orchestra.run.smithi070.stdout:3516 punch from 0x2359dbc to 0x2367797, (0xd9db bytes) 2024-09-11T06:18:53.915 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.916 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.916 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.925 INFO:teuthology.orchestra.run.smithi070.stdout:3523 writesame 0xd45a7b5 thru 0xd462a46 data_size 0x1b(0x8292 bytes) 2024-09-11T06:18:53.926 INFO:teuthology.orchestra.run.smithi070.stdout:3525 write 0x6530193 thru 0x6538d45 (0x8bb3 bytes) 2024-09-11T06:18:53.928 INFO:teuthology.orchestra.run.smithi070.stdout:3526 punch from 0x2fbbef8 to 0x2fc5bb9, (0x9cc1 bytes) 2024-09-11T06:18:53.928 INFO:teuthology.orchestra.run.smithi070.stdout:3527 write 0x6836b72 thru 0x6838a99 (0x1f28 bytes) 2024-09-11T06:18:53.929 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.929 INFO:teuthology.orchestra.run.smithi070.stdout:3529 write 0x30bd473 thru 0x30be742 (0x12d0 bytes) 2024-09-11T06:18:53.930 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:53.928+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:53.930 INFO:teuthology.orchestra.run.smithi070.stdout:3530 write 0xaeb7512 thru 0xaebb7c1 (0x42b0 bytes) 2024-09-11T06:18:53.931 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.931 INFO:teuthology.orchestra.run.smithi070.stdout:3532 read 0x35f5044 thru 0x35fb7a4 (0x6761 bytes) 2024-09-11T06:18:53.932 INFO:teuthology.orchestra.run.smithi070.stdout:3533 write 0x458bc5e thru 0x458caef (0xe92 bytes) 2024-09-11T06:18:53.932 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.932 INFO:teuthology.orchestra.run.smithi070.stdout:3535 writesame 0x1256ec2 thru 0x1265920 data_size 0x1(0xea5f bytes) 2024-09-11T06:18:53.953 INFO:teuthology.orchestra.run.smithi070.stdout:3537 write 0xb3cc32b thru 0xb3d9c48 (0xd91e bytes) 2024-09-11T06:18:53.954 INFO:teuthology.orchestra.run.smithi070.stdout:3538 write 0xab12879 thru 0xab16944 (0x40cc bytes) 2024-09-11T06:18:53.955 INFO:teuthology.orchestra.run.smithi070.stdout:3539 write 0xc1fc971 thru 0xc200496 (0x3b26 bytes) 2024-09-11T06:18:53.957 INFO:teuthology.orchestra.run.smithi070.stdout:3540 read 0xc906ce2 thru 0xc90b945 (0x4c64 bytes) 2024-09-11T06:18:53.957 INFO:teuthology.orchestra.run.smithi070.stdout:3543 writesame 0x4280a4d thru 0x428892d data_size 0x1b(0x7ee1 bytes) 2024-09-11T06:18:53.959 INFO:teuthology.orchestra.run.smithi070.stdout:3544 write 0x6dc8556 thru 0x6dc9d1c (0x17c7 bytes) 2024-09-11T06:18:53.960 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:53.960 INFO:teuthology.orchestra.run.smithi070.stdout:3548 write 0x17ef51d thru 0x17f13c4 (0x1ea8 bytes) 2024-09-11T06:18:53.961 INFO:teuthology.orchestra.run.smithi070.stdout:3549 read 0x64a2c thru 0x67381 (0x2956 bytes) 2024-09-11T06:18:53.962 INFO:teuthology.orchestra.run.smithi070.stdout:3551 read 0x5293f4b thru 0x52a19df (0xda95 bytes) 2024-09-11T06:18:53.962 INFO:teuthology.orchestra.run.smithi070.stdout:3552 write 0x82b734 thru 0x839ca1 (0xe56e bytes) 2024-09-11T06:18:53.963 INFO:teuthology.orchestra.run.smithi070.stdout:3555 read 0x7a60522 thru 0x7a6cbe5 (0xc6c4 bytes) 2024-09-11T06:18:53.964 INFO:teuthology.orchestra.run.smithi070.stdout:3556 write 0xd3faaa7 thru 0xd3fd05c (0x25b6 bytes) 2024-09-11T06:18:53.966 INFO:teuthology.orchestra.run.smithi070.stdout:3557 punch from 0x4662aeb to 0x466d18e, (0xa6a3 bytes) 2024-09-11T06:18:53.966 INFO:teuthology.orchestra.run.smithi070.stdout:3558 punch from 0x9726849 to 0x9733bf7, (0xd3ae bytes) 2024-09-11T06:18:53.966 INFO:teuthology.orchestra.run.smithi070.stdout:3559 write 0xba56854 thru 0xba60d2a (0xa4d7 bytes) 2024-09-11T06:18:53.967 INFO:teuthology.orchestra.run.smithi070.stdout:3561 punch from 0x6f7ade1 to 0x6f857f9, (0xaa18 bytes) 2024-09-11T06:18:53.967 INFO:teuthology.orchestra.run.smithi070.stdout:3562 read 0x70592e5 thru 0x705a9f4 (0x1710 bytes) 2024-09-11T06:18:53.968 INFO:teuthology.orchestra.run.smithi070.stdout:3563 write 0x90a6027 thru 0x90b45cd (0xe5a7 bytes) 2024-09-11T06:18:53.972 INFO:teuthology.orchestra.run.smithi070.stdout:3564 trunc from 0xd462a47 to 0xa8eb188 2024-09-11T06:18:53.979 INFO:teuthology.orchestra.run.smithi070.stdout:3567 read 0x180dd0d thru 0x18188c3 (0xabb7 bytes) 2024-09-11T06:18:53.983 INFO:teuthology.orchestra.run.smithi070.stdout:3568 trunc from 0xa8eb188 to 0xd8da563 2024-09-11T06:18:53.989 INFO:teuthology.orchestra.run.smithi070.stdout:3569 punch from 0x9e9f78f to 0x9ea8cb6, (0x9527 bytes) 2024-09-11T06:18:53.989 INFO:teuthology.orchestra.run.smithi070.stdout:3570 read 0x884f406 thru 0x8857d60 (0x895b bytes) 2024-09-11T06:18:53.989 INFO:teuthology.orchestra.run.smithi070.stdout:3571 punch from 0x3b653dd to 0x3b6ed41, (0x9964 bytes) 2024-09-11T06:18:53.989 INFO:teuthology.orchestra.run.smithi070.stdout:3572 writesame 0x8fa8bc1 thru 0x8fad9bf data_size 0x1(0x4dff bytes) 2024-09-11T06:18:54.005 INFO:teuthology.orchestra.run.smithi070.stdout:3574 trunc from 0xd8da563 to 0x8794025 2024-09-11T06:18:54.013 INFO:teuthology.orchestra.run.smithi070.stdout:3575 read 0xe5fc80 thru 0xe6f089 (0xf40a bytes) 2024-09-11T06:18:54.014 INFO:teuthology.orchestra.run.smithi070.stdout:3578 punch from 0x2c3cf05 to 0x2c3d557, (0x652 bytes) 2024-09-11T06:18:54.014 INFO:teuthology.orchestra.run.smithi070.stdout:3579 write 0x51acd13 thru 0x51b1f3b (0x5229 bytes) 2024-09-11T06:18:54.014 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:54.013+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:54.021 INFO:teuthology.orchestra.run.smithi070.stdout:3581 trunc from 0x8794025 to 0xdd5cc4e 2024-09-11T06:18:54.027 INFO:teuthology.orchestra.run.smithi070.stdout:3582 read 0x9c12331 thru 0x9c14393 (0x2063 bytes) 2024-09-11T06:18:54.027 INFO:teuthology.orchestra.run.smithi070.stdout:3583 punch from 0x504a73d to 0x505840c, (0xdccf bytes) 2024-09-11T06:18:54.028 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.028 INFO:teuthology.orchestra.run.smithi070.stdout:3585 read 0x73f354c thru 0x73fc1b4 (0x8c69 bytes) 2024-09-11T06:18:54.028 INFO:teuthology.orchestra.run.smithi070.stdout:3586 read 0x434d7ad thru 0x4352e2f (0x5683 bytes) 2024-09-11T06:18:54.029 INFO:teuthology.orchestra.run.smithi070.stdout:3587 read 0xd7eb457 thru 0xd7f9e43 (0xe9ed bytes) 2024-09-11T06:18:54.038 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:54.038 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:54.045 INFO:teuthology.orchestra.run.smithi070.stdout:3589 trunc from 0xdd5cc4e to 0x97c5dc 2024-09-11T06:18:54.048 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:54.060 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.060 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.060 INFO:teuthology.orchestra.run.smithi070.stdout:3592 punch from 0x418cb9 to 0x41dbd1, (0x4f18 bytes) 2024-09-11T06:18:54.075 INFO:teuthology.orchestra.run.smithi070.stdout:3593 write 0x764840d thru 0x7656d06 (0xe8fa bytes) 2024-09-11T06:18:54.078 INFO:teuthology.orchestra.run.smithi070.stdout:3594 read 0x97c2c3 thru 0x983333 (0x7071 bytes) 2024-09-11T06:18:54.079 INFO:teuthology.orchestra.run.smithi070.stdout:3595 punch from 0x5b35574 to 0x5b377a1, (0x222d bytes) 2024-09-11T06:18:54.079 INFO:teuthology.orchestra.run.smithi070.stdout:3597 read 0x122a1e4 thru 0x122e9f6 (0x4813 bytes) 2024-09-11T06:18:54.079 INFO:teuthology.orchestra.run.smithi070.stdout:3598 write 0x6638a22 thru 0x66433a1 (0xa980 bytes) 2024-09-11T06:18:54.080 INFO:teuthology.orchestra.run.smithi070.stdout:3599 read 0x3d1d661 thru 0x3d2716a (0x9b0a bytes) 2024-09-11T06:18:54.080 INFO:teuthology.orchestra.run.smithi070.stdout:3600 punch from 0x23691a3 to 0x2376be8, (0xda45 bytes) 2024-09-11T06:18:54.087 INFO:teuthology.orchestra.run.smithi070.stdout:3601 writesame 0x851ca26 thru 0x8528a20 data_size 0x11(0xbffb bytes) 2024-09-11T06:18:54.098 INFO:teuthology.orchestra.run.smithi070.stdout:3606 trunc from 0x8528a21 to 0x1e20ea 2024-09-11T06:18:54.115 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:54.114+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:54.120 INFO:teuthology.orchestra.run.smithi070.stdout:3607 write 0x645cf84 thru 0x64639c9 (0x6a46 bytes) 2024-09-11T06:18:54.123 INFO:teuthology.orchestra.run.smithi070.stdout:3611 read 0x216bd2 thru 0x22679c (0xfbcb bytes) 2024-09-11T06:18:54.125 INFO:teuthology.orchestra.run.smithi070.stdout:3612 trunc from 0x64639ca to 0x79e6987 2024-09-11T06:18:54.131 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.131 INFO:teuthology.orchestra.run.smithi070.stdout:3615 punch from 0x3e7bec6 to 0x3e828b0, (0x69ea bytes) 2024-09-11T06:18:54.131 INFO:teuthology.orchestra.run.smithi070.stdout:3616 read 0x3a6c0d9 thru 0x3a77375 (0xb29d bytes) 2024-09-11T06:18:54.132 INFO:teuthology.orchestra.run.smithi070.stdout:3617 writesame 0x2022bf6 thru 0x2026566 data_size 0x11(0x3971 bytes) 2024-09-11T06:18:54.133 INFO:teuthology.orchestra.run.smithi070.stdout:3619 read 0x5511bd thru 0x558bfc (0x7a40 bytes) 2024-09-11T06:18:54.134 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.134 INFO:teuthology.orchestra.run.smithi070.stdout:3623 write 0x74e7746 thru 0x74eb2e5 (0x3ba0 bytes) 2024-09-11T06:18:54.136 INFO:teuthology.orchestra.run.smithi070.stdout:3624 writesame 0x72bf0f6 thru 0x72c52d0 data_size 0xd(0x61db bytes) 2024-09-11T06:18:54.139 INFO:teuthology.orchestra.run.smithi070.stdout:3626 punch from 0x8b61f8 to 0x8bb80a, (0x5612 bytes) 2024-09-11T06:18:54.139 INFO:teuthology.orchestra.run.smithi070.stdout:3627 punch from 0x179411e to 0x179ce6e, (0x8d50 bytes) 2024-09-11T06:18:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:18:54.146 INFO:teuthology.orchestra.run.smithi070.stdout:3628 trunc from 0x79e6987 to 0xd777acd 2024-09-11T06:18:54.154 INFO:teuthology.orchestra.run.smithi070.stdout:3629 writesame 0xfcb371 thru 0xfd80cc data_size 0x4e(0xcd5c bytes) 2024-09-11T06:18:54.157 INFO:teuthology.orchestra.run.smithi070.stdout:3630 write 0xccb4d27 thru 0xccb52ec (0x5c6 bytes) 2024-09-11T06:18:54.158 INFO:teuthology.orchestra.run.smithi070.stdout:3631 write 0x6e48cd4 thru 0x6e4bfe8 (0x3315 bytes) 2024-09-11T06:18:54.165 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:54.165 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:54.171 INFO:teuthology.orchestra.run.smithi070.stdout:3632 trunc from 0xd777acd to 0x381b275 2024-09-11T06:18:54.174 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:54.179 INFO:teuthology.orchestra.run.smithi070.stdout:3633 read 0x34e8067 thru 0x34e9e1c (0x1db6 bytes) 2024-09-11T06:18:54.180 INFO:teuthology.orchestra.run.smithi070.stdout:3634 read 0x1a8c834 thru 0x1a8e210 (0x19dd bytes) 2024-09-11T06:18:54.180 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.180 INFO:teuthology.orchestra.run.smithi070.stdout:3637 writesame 0x13ed41f thru 0x13ef5f6 data_size 0x13(0x21d8 bytes) 2024-09-11T06:18:54.181 INFO:teuthology.orchestra.run.smithi070.stdout:3638 read 0x8cd126 thru 0x8d19cc (0x48a7 bytes) 2024-09-11T06:18:54.181 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.181 INFO:teuthology.orchestra.run.smithi070.stdout:3641 read 0x237d4d7 thru 0x23888fe (0xb428 bytes) 2024-09-11T06:18:54.181 INFO:teuthology.orchestra.run.smithi070.stdout:3642 read 0x22c4fe6 thru 0x22c9fef (0x500a bytes) 2024-09-11T06:18:54.191 INFO:teuthology.orchestra.run.smithi070.stdout:3643 write 0x699b652 thru 0x69aaf4a (0xf8f9 bytes) 2024-09-11T06:18:54.194 INFO:teuthology.orchestra.run.smithi070.stdout:3644 read 0x3aa5322 thru 0x3aabe8d (0x6b6c bytes) 2024-09-11T06:18:54.194 INFO:teuthology.orchestra.run.smithi070.stdout:3647 writesame 0x3c01884 thru 0x3c01ef6 data_size 0x1(0x673 bytes) 2024-09-11T06:18:54.196 INFO:teuthology.orchestra.run.smithi070.stdout:3649 punch from 0x1e694e0 to 0x1e75e4d, (0xc96d bytes) 2024-09-11T06:18:54.199 INFO:teuthology.orchestra.run.smithi070.stdout:3650 trunc from 0x69aaf4b to 0x439642e 2024-09-11T06:18:54.207 INFO:teuthology.orchestra.run.smithi070.stdout:3651 write 0x3b0d8f thru 0x3bbab3 (0xad25 bytes) 2024-09-11T06:18:54.210 INFO:teuthology.orchestra.run.smithi070.stdout:3652 trunc from 0x439642e to 0x5fb7ffe 2024-09-11T06:18:54.216 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:54.215+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:54.226 INFO:teuthology.orchestra.run.smithi070.stdout:3654 trunc from 0x5fb7ffe to 0xe61145c 2024-09-11T06:18:54.235 INFO:teuthology.orchestra.run.smithi070.stdout:3655 trunc from 0xe61145c to 0xb7a9f7c 2024-09-11T06:18:54.242 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.242 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.242 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.242 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.252 INFO:teuthology.orchestra.run.smithi070.stdout:3663 write 0xec279d8 thru 0xec358b3 (0xdedc bytes) 2024-09-11T06:18:54.253 INFO:teuthology.orchestra.run.smithi070.stdout:3664 read 0x4f2338b thru 0x4f267f1 (0x3467 bytes) 2024-09-11T06:18:54.256 INFO:teuthology.orchestra.run.smithi070.stdout:3665 trunc from 0xec358b4 to 0xcf89bbc 2024-09-11T06:18:54.277 INFO:teuthology.orchestra.run.smithi070.stdout:3668 trunc from 0xcf89bbc to 0x1a78d52 2024-09-11T06:18:54.286 INFO:teuthology.orchestra.run.smithi070.stdout:3669 read 0x15d976a thru 0x15e455f (0xadf6 bytes) 2024-09-11T06:18:54.290 INFO:teuthology.orchestra.run.smithi070.stdout:3670 trunc from 0x1a78d52 to 0x4e47894 2024-09-11T06:18:54.295 INFO:teuthology.orchestra.run.smithi070.stdout:3672 read 0x161a13a thru 0x16286e2 (0xe5a9 bytes) 2024-09-11T06:18:54.296 INFO:teuthology.orchestra.run.smithi070.stdout:3673 read 0x38881e5 thru 0x389794f (0xf76b bytes) 2024-09-11T06:18:54.296 INFO:teuthology.orchestra.run.smithi070.stdout:3674 read 0x402831b thru 0x403133f (0x9025 bytes) 2024-09-11T06:18:54.306 INFO:teuthology.orchestra.run.smithi070.stdout:3676 trunc from 0x4e47894 to 0xd2656be 2024-09-11T06:18:54.313 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.313 INFO:teuthology.orchestra.run.smithi070.stdout:3680 read 0x10c6528 thru 0x10d4456 (0xdf2f bytes) 2024-09-11T06:18:54.313 INFO:teuthology.orchestra.run.smithi070.stdout:3681 write 0x7e0506a thru 0x7e0dde0 (0x8d77 bytes) 2024-09-11T06:18:54.316 INFO:teuthology.orchestra.run.smithi070.stdout:3682 punch from 0x5136f67 to 0x5139cb9, (0x2d52 bytes) 2024-09-11T06:18:54.316 INFO:teuthology.orchestra.run.smithi070.stdout:3683 writesame 0x7725578 thru 0x77264be data_size 0x1(0xf47 bytes) 2024-09-11T06:18:54.316 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:54.315+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:54.317 INFO:teuthology.orchestra.run.smithi070.stdout:3684 write 0x67d22b4 thru 0x67d38b2 (0x15ff bytes) 2024-09-11T06:18:54.318 INFO:teuthology.orchestra.run.smithi070.stdout:3685 writesame 0x5c4eb99 thru 0x5c55bb0 data_size 0x44(0x7018 bytes) 2024-09-11T06:18:54.320 INFO:teuthology.orchestra.run.smithi070.stdout:3687 read 0x9a7a41d thru 0x9a7d682 (0x3266 bytes) 2024-09-11T06:18:54.320 INFO:teuthology.orchestra.run.smithi070.stdout:3689 writesame 0x55c1576 thru 0x55ce73d data_size 0x62(0xd1c8 bytes) 2024-09-11T06:18:54.321 INFO:teuthology.orchestra.run.smithi070.stdout:3690 read 0xc42be5c thru 0xc430177 (0x431c bytes) 2024-09-11T06:18:54.322 INFO:teuthology.orchestra.run.smithi070.stdout:3691 write 0x4a901a6 thru 0x4a901ec (0x47 bytes) 2024-09-11T06:18:54.323 INFO:teuthology.orchestra.run.smithi070.stdout:3692 read 0x9c185e8 thru 0x9c25437 (0xce50 bytes) 2024-09-11T06:18:54.325 INFO:teuthology.orchestra.run.smithi070.stdout:3693 trunc from 0xd2656be to 0xe078b6c 2024-09-11T06:18:54.325 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:54.325 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:54.331 INFO:teuthology.orchestra.run.smithi070.stdout:3694 punch from 0x7dd212f to 0x7ddd4e7, (0xb3b8 bytes) 2024-09-11T06:18:54.331 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.331 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.331 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.331 INFO:teuthology.orchestra.run.smithi070.stdout:3699 write 0x445024c thru 0x445d751 (0xd506 bytes) 2024-09-11T06:18:54.332 INFO:teuthology.orchestra.run.smithi070.stdout:3700 write 0x2b9f7bb thru 0x2ba6383 (0x6bc9 bytes) 2024-09-11T06:18:54.334 INFO:teuthology.orchestra.run.smithi070.stdout:3701 write 0x1e22505 thru 0x1e263ea (0x3ee6 bytes) 2024-09-11T06:18:54.335 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:54.335 INFO:teuthology.orchestra.run.smithi070.stdout:3702 read 0x11de58f thru 0x11e4653 (0x60c5 bytes) 2024-09-11T06:18:54.335 INFO:teuthology.orchestra.run.smithi070.stdout:3704 read 0xbc81065 thru 0xbc8aa43 (0x99df bytes) 2024-09-11T06:18:54.336 INFO:teuthology.orchestra.run.smithi070.stdout:3705 read 0x5e3b528 thru 0x5e48c28 (0xd701 bytes) 2024-09-11T06:18:54.337 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.337 INFO:teuthology.orchestra.run.smithi070.stdout:3707 read 0x4eec9ac thru 0x4ef5f3b (0x9590 bytes) 2024-09-11T06:18:54.337 INFO:teuthology.orchestra.run.smithi070.stdout:3709 punch from 0x544a681 to 0x5452cde, (0x865d bytes) 2024-09-11T06:18:54.338 INFO:teuthology.orchestra.run.smithi070.stdout:3712 write 0x5d2b6f5 thru 0x5d2ca52 (0x135e bytes) 2024-09-11T06:18:54.338 INFO:teuthology.orchestra.run.smithi070.stdout:3714 read 0x39ffbc4 thru 0x3a03ba6 (0x3fe3 bytes) 2024-09-11T06:18:54.339 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.340 INFO:teuthology.orchestra.run.smithi070.stdout:3717 trunc from 0xe078b6c to 0xd0c531b 2024-09-11T06:18:54.351 INFO:teuthology.orchestra.run.smithi070.stdout:3718 writesame 0x50196a1 thru 0x5023a4f data_size 0x1(0xa3af bytes) 2024-09-11T06:18:54.361 INFO:teuthology.orchestra.run.smithi070.stdout:3719 writesame 0xff2d13 thru 0xffc93a data_size 0x26(0x9c28 bytes) 2024-09-11T06:18:54.362 INFO:teuthology.orchestra.run.smithi070.stdout:3721 read 0x2410d64 thru 0x2418bd1 (0x7e6e bytes) 2024-09-11T06:18:54.363 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.363 INFO:teuthology.orchestra.run.smithi070.stdout:3723 trunc from 0xd0c531b to 0xc3bfc29 2024-09-11T06:18:54.372 INFO:teuthology.orchestra.run.smithi070.stdout:3724 punch from 0x255e879 to 0x2568ea3, (0xa62a bytes) 2024-09-11T06:18:54.372 INFO:teuthology.orchestra.run.smithi070.stdout:3725 read 0x3aac06f thru 0x3ab9374 (0xd306 bytes) 2024-09-11T06:18:54.372 INFO:teuthology.orchestra.run.smithi070.stdout:3726 write 0xbbf0244 thru 0xbbf43a2 (0x415f bytes) 2024-09-11T06:18:54.375 INFO:teuthology.orchestra.run.smithi070.stdout:3727 writesame 0x8efa1ef thru 0x8eff493 data_size 0x1(0x52a5 bytes) 2024-09-11T06:18:54.393 INFO:teuthology.orchestra.run.smithi070.stdout:3728 writesame 0xd5f5fe0 thru 0xd5f9a3f data_size 0x10(0x3a60 bytes) 2024-09-11T06:18:54.395 INFO:teuthology.orchestra.run.smithi070.stdout:3729 writesame 0x8d8736f thru 0x8d95082 data_size 0x2(0xdd14 bytes) 2024-09-11T06:18:54.417 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:54.416+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:54.418 INFO:teuthology.orchestra.run.smithi070.stdout:3732 trunc from 0xd5f9a40 to 0x512f8b5 2024-09-11T06:18:54.427 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.427 INFO:teuthology.orchestra.run.smithi070.stdout:3735 read 0x3e4e4e6 thru 0x3e4ed29 (0x844 bytes) 2024-09-11T06:18:54.427 INFO:teuthology.orchestra.run.smithi070.stdout:3736 punch from 0x39bc554 to 0x39c4693, (0x813f bytes) 2024-09-11T06:18:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:3737 read 0x4155395 thru 0x415605a (0xcc6 bytes) 2024-09-11T06:18:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:3738 read 0x40bdf4d thru 0x40cb7c7 (0xd87b bytes) 2024-09-11T06:18:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:3740 read 0x1fea464 thru 0x1ff08b1 (0x644e bytes) 2024-09-11T06:18:54.429 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.429 INFO:teuthology.orchestra.run.smithi070.stdout:3742 read 0xb7292 thru 0xc2168 (0xaed7 bytes) 2024-09-11T06:18:54.432 INFO:teuthology.orchestra.run.smithi070.stdout:3743 read 0x38c04b thru 0x3904ec (0x44a2 bytes) 2024-09-11T06:18:54.432 INFO:teuthology.orchestra.run.smithi070.stdout:3744 read 0x12d3480 thru 0x12d4171 (0xcf2 bytes) 2024-09-11T06:18:54.447 INFO:teuthology.orchestra.run.smithi070.stdout:3745 write 0xe33eac4 thru 0xe33ee81 (0x3be bytes) 2024-09-11T06:18:54.448 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.448 INFO:teuthology.orchestra.run.smithi070.stdout:3747 writesame 0xa86da46 thru 0xa87ba04 data_size 0x3(0xdfbf bytes) 2024-09-11T06:18:54.463 INFO:teuthology.orchestra.run.smithi070.stdout:3748 trunc from 0xe33ee82 to 0x6e9a8e9 2024-09-11T06:18:54.471 INFO:teuthology.orchestra.run.smithi070.stdout:3749 write 0x2702d92 thru 0x27063c5 (0x3634 bytes) 2024-09-11T06:18:54.472 INFO:teuthology.orchestra.run.smithi070.stdout:3751 read 0x339f74e thru 0x33a2e76 (0x3729 bytes) 2024-09-11T06:18:54.472 INFO:teuthology.orchestra.run.smithi070.stdout:3752 read 0x112336e thru 0x112a01c (0x6caf bytes) 2024-09-11T06:18:54.472 INFO:teuthology.orchestra.run.smithi070.stdout:3753 read 0x2ad83e6 thru 0x2ae82d9 (0xfef4 bytes) 2024-09-11T06:18:54.473 INFO:teuthology.orchestra.run.smithi070.stdout:3754 punch from 0x5309b9e to 0x531943d, (0xf89f bytes) 2024-09-11T06:18:54.473 INFO:teuthology.orchestra.run.smithi070.stdout:3755 write 0x17ae287 thru 0x17b7aa2 (0x981c bytes) 2024-09-11T06:18:54.479 INFO:teuthology.orchestra.run.smithi070.stdout:3756 trunc from 0x6e9a8e9 to 0xb3b9178 2024-09-11T06:18:54.485 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:54.485 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:54.486 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.486 INFO:teuthology.orchestra.run.smithi070.stdout:3761 punch from 0x8b7877c to 0x8b82823, (0xa0a7 bytes) 2024-09-11T06:18:54.486 INFO:teuthology.orchestra.run.smithi070.stdout:3762 read 0x59c0cde thru 0x59c58b0 (0x4bd3 bytes) 2024-09-11T06:18:54.486 INFO:teuthology.orchestra.run.smithi070.stdout:3765 write 0x1157c09 thru 0x11663a0 (0xe798 bytes) 2024-09-11T06:18:54.492 INFO:teuthology.orchestra.run.smithi070.stdout:3766 trunc from 0xb3b9178 to 0x7ebe88d 2024-09-11T06:18:54.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:54.512 INFO:teuthology.orchestra.run.smithi070.stdout:3768 write 0xe5d39a6 thru 0xe5dea98 (0xb0f3 bytes) 2024-09-11T06:18:54.514 INFO:teuthology.orchestra.run.smithi070.stdout:3770 writesame 0x3f43545 thru 0x3f4cd1c data_size 0x8(0x97d8 bytes) 2024-09-11T06:18:54.517 INFO:teuthology.orchestra.run.smithi070.stdout:3771 punch from 0x8e88577 to 0x8e939f0, (0xb479 bytes) 2024-09-11T06:18:54.517 INFO:teuthology.orchestra.run.smithi070.stdout:3772 punch from 0x10f4a1f to 0x1102d5a, (0xe33b bytes) 2024-09-11T06:18:54.517 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.517 INFO:teuthology.orchestra.run.smithi070.stdout:3775 write 0x59b4a3d thru 0x59b6b52 (0x2116 bytes) 2024-09-11T06:18:54.518 INFO:teuthology.orchestra.run.smithi070.stdout:3776 write 0x9e188b6 thru 0x9e1f778 (0x6ec3 bytes) 2024-09-11T06:18:54.518 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:54.517+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:54.518 INFO:teuthology.orchestra.run.smithi070.stdout:3777 writesame 0xbca2c82 thru 0xbca3d60 data_size 0x1(0x10df bytes) 2024-09-11T06:18:54.520 INFO:teuthology.orchestra.run.smithi070.stdout:3779 write 0x2690ed7 thru 0x26937b0 (0x28da bytes) 2024-09-11T06:18:54.521 INFO:teuthology.orchestra.run.smithi070.stdout:3780 read 0x3de8b7c thru 0x3df35c8 (0xaa4d bytes) 2024-09-11T06:18:54.522 INFO:teuthology.orchestra.run.smithi070.stdout:3781 read 0x7cea40c thru 0x7cf8716 (0xe30b bytes) 2024-09-11T06:18:54.522 INFO:teuthology.orchestra.run.smithi070.stdout:3783 write 0x7d6578c thru 0x7d672de (0x1b53 bytes) 2024-09-11T06:18:54.523 INFO:teuthology.orchestra.run.smithi070.stdout:3784 read 0x3b1f404 thru 0x3b2890d (0x950a bytes) 2024-09-11T06:18:54.524 INFO:teuthology.orchestra.run.smithi070.stdout:3785 write 0x63f7bd6 thru 0x63fb639 (0x3a64 bytes) 2024-09-11T06:18:54.525 INFO:teuthology.orchestra.run.smithi070.stdout:3786 punch from 0xb6620d4 to 0xb667d26, (0x5c52 bytes) 2024-09-11T06:18:54.525 INFO:teuthology.orchestra.run.smithi070.stdout:3789 writesame 0x4ed8500 thru 0x4edcc44 data_size 0x59(0x4745 bytes) 2024-09-11T06:18:54.527 INFO:teuthology.orchestra.run.smithi070.stdout:3790 write 0x8f599b9 thru 0x8f66c3b (0xd283 bytes) 2024-09-11T06:18:54.529 INFO:teuthology.orchestra.run.smithi070.stdout:3791 trunc from 0xe5dea99 to 0xe43d02a 2024-09-11T06:18:54.546 INFO:teuthology.orchestra.run.smithi070.stdout:3792 trunc from 0xe43d02a to 0x5227a94 2024-09-11T06:18:54.565 INFO:teuthology.orchestra.run.smithi070.stdout:3794 writesame 0x9f81af7 thru 0x9f8e899 data_size 0x1(0xcda3 bytes) 2024-09-11T06:18:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:3797 trunc from 0x9f8e89a to 0xb7604ab 2024-09-11T06:18:54.573 INFO:teuthology.orchestra.run.smithi070.stdout:3798 read 0x65ca9cc thru 0x65cf7f9 (0x4e2e bytes) 2024-09-11T06:18:54.574 INFO:teuthology.orchestra.run.smithi070.stdout:3799 write 0x53786ac thru 0x5384563 (0xbeb8 bytes) 2024-09-11T06:18:54.574 INFO:teuthology.orchestra.run.smithi070.stdout:3800 writesame 0x7ce364e thru 0x7ce5d5f data_size 0x3(0x2712 bytes) 2024-09-11T06:18:54.576 INFO:teuthology.orchestra.run.smithi070.stdout:3801 write 0x704cb7a thru 0x704f6b5 (0x2b3c bytes) 2024-09-11T06:18:54.585 INFO:teuthology.orchestra.run.smithi070.stdout:3803 write 0xd6709ca thru 0xd6730bf (0x26f6 bytes) 2024-09-11T06:18:54.586 INFO:teuthology.orchestra.run.smithi070.stdout:3804 read 0x4836885 thru 0x48445ec (0xdd68 bytes) 2024-09-11T06:18:54.587 INFO:teuthology.orchestra.run.smithi070.stdout:3805 read 0xa97a846 thru 0xa98254a (0x7d05 bytes) 2024-09-11T06:18:54.588 INFO:teuthology.orchestra.run.smithi070.stdout:3806 write 0xc9c3f22 thru 0xc9cd5b4 (0x9693 bytes) 2024-09-11T06:18:54.589 INFO:teuthology.orchestra.run.smithi070.stdout:3807 write 0x1edd2a8 thru 0x1ee1e10 (0x4b69 bytes) 2024-09-11T06:18:54.591 INFO:teuthology.orchestra.run.smithi070.stdout:3808 write 0x354d4f8 thru 0x355387e (0x6387 bytes) 2024-09-11T06:18:54.592 INFO:teuthology.orchestra.run.smithi070.stdout:3810 writesame 0x2d38217 thru 0x2d382d8 data_size 0x1(0xc2 bytes) 2024-09-11T06:18:54.606 INFO:teuthology.orchestra.run.smithi070.stdout:3811 trunc from 0xd6730c0 to 0x2b0a09d 2024-09-11T06:18:54.613 INFO:teuthology.orchestra.run.smithi070.stdout:3812 writesame 0x204d7be thru 0x205a513 data_size 0x3(0xcd56 bytes) 2024-09-11T06:18:54.618 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:54.618 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:54.618 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:54.617+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:54.621 INFO:teuthology.orchestra.run.smithi070.stdout:3813 punch from 0x84bddf to 0x84d14a, (0x136b bytes) 2024-09-11T06:18:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:3814 punch from 0xd7ba54 to 0xd7da32, (0x1fde bytes) 2024-09-11T06:18:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:3819 write 0x28528ef thru 0x28530b1 (0x7c3 bytes) 2024-09-11T06:18:54.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:54.636 INFO:teuthology.orchestra.run.smithi070.stdout:3820 write 0x904f152 thru 0x9053c19 (0x4ac8 bytes) 2024-09-11T06:18:54.638 INFO:teuthology.orchestra.run.smithi070.stdout:3821 write 0x56b7146 thru 0x56c65f0 (0xf4ab bytes) 2024-09-11T06:18:54.639 INFO:teuthology.orchestra.run.smithi070.stdout:3822 punch from 0x89760a3 to 0x897f2d8, (0x9235 bytes) 2024-09-11T06:18:54.639 INFO:teuthology.orchestra.run.smithi070.stdout:3823 write 0x4fba8f8 thru 0x4fc10d9 (0x67e2 bytes) 2024-09-11T06:18:54.641 INFO:teuthology.orchestra.run.smithi070.stdout:3825 read 0x6ce067c thru 0x6cec27e (0xbc03 bytes) 2024-09-11T06:18:54.648 INFO:teuthology.orchestra.run.smithi070.stdout:3827 write 0xa891555 thru 0xa89ad70 (0x981c bytes) 2024-09-11T06:18:54.649 INFO:teuthology.orchestra.run.smithi070.stdout:3828 read 0x7befdd7 thru 0x7bfccdb (0xcf05 bytes) 2024-09-11T06:18:54.650 INFO:teuthology.orchestra.run.smithi070.stdout:3829 writesame 0x430195d thru 0x430f7d3 data_size 0x1(0xde77 bytes) 2024-09-11T06:18:54.672 INFO:teuthology.orchestra.run.smithi070.stdout:3830 writesame 0x175ea13 thru 0x175fd37 data_size 0xd(0x1325 bytes) 2024-09-11T06:18:54.674 INFO:teuthology.orchestra.run.smithi070.stdout:3831 writesame 0x7d05723 thru 0x7d0de03 data_size 0x2b(0x86e1 bytes) 2024-09-11T06:18:54.675 INFO:teuthology.orchestra.run.smithi070.stdout:3832 writesame 0xc0945 thru 0xc277d data_size 0x1(0x1e39 bytes) 2024-09-11T06:18:54.679 INFO:teuthology.orchestra.run.smithi070.stdout:3835 read 0x9815050 thru 0x981e588 (0x9539 bytes) 2024-09-11T06:18:54.679 INFO:teuthology.orchestra.run.smithi070.stdout:3838 read 0xeaf00e thru 0xeafe44 (0xe37 bytes) 2024-09-11T06:18:54.679 INFO:teuthology.orchestra.run.smithi070.stdout:3840 writesame 0x6958ef thru 0x69edd5 data_size 0x1(0x94e7 bytes) 2024-09-11T06:18:54.692 INFO:teuthology.orchestra.run.smithi070.stdout:3841 punch from 0x4b08379 to 0x4b08eb9, (0xb40 bytes) 2024-09-11T06:18:54.692 INFO:teuthology.orchestra.run.smithi070.stdout:3842 writesame 0x8cb6d75 thru 0x8cbbd96 data_size 0x27(0x5022 bytes) 2024-09-11T06:18:54.694 INFO:teuthology.orchestra.run.smithi070.stdout:3843 write 0x947100a thru 0x947c2de (0xb2d5 bytes) 2024-09-11T06:18:54.695 INFO:teuthology.orchestra.run.smithi070.stdout:3846 write 0x5d4f559 thru 0x5d556f8 (0x61a0 bytes) 2024-09-11T06:18:54.696 INFO:teuthology.orchestra.run.smithi070.stdout:3848 read 0x4c2b9f6 thru 0x4c34f74 (0x957f bytes) 2024-09-11T06:18:54.697 INFO:teuthology.orchestra.run.smithi070.stdout:3849 punch from 0x943d9c5 to 0x9445754, (0x7d8f bytes) 2024-09-11T06:18:54.697 INFO:teuthology.orchestra.run.smithi070.stdout:3850 read 0x62fc0b5 thru 0x63084d3 (0xc41f bytes) 2024-09-11T06:18:54.697 INFO:teuthology.orchestra.run.smithi070.stdout:3851 write 0x6b27468 thru 0x6b2a604 (0x319d bytes) 2024-09-11T06:18:54.698 INFO:teuthology.orchestra.run.smithi070.stdout:3852 read 0x2de0740 thru 0x2deb0da (0xa99b bytes) 2024-09-11T06:18:54.699 INFO:teuthology.orchestra.run.smithi070.stdout:3853 write 0x4b2b4c7 thru 0x4b3b1d8 (0xfd12 bytes) 2024-09-11T06:18:54.712 INFO:teuthology.orchestra.run.smithi070.stdout:3854 trunc from 0xa89ad71 to 0x401c77 2024-09-11T06:18:54.719 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:54.719+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:54.728 INFO:teuthology.orchestra.run.smithi070.stdout:3855 read 0x2609d5 thru 0x26c659 (0xbc85 bytes) 2024-09-11T06:18:54.747 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:54.747 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:54.750 INFO:teuthology.orchestra.run.smithi070.stdout:3856 writesame 0xe00d57e thru 0xe016773 data_size 0x77(0x91f6 bytes) 2024-09-11T06:18:54.751 INFO:teuthology.orchestra.run.smithi070.stdout:3858 write 0xab43284 thru 0xab47a55 (0x47d2 bytes) 2024-09-11T06:18:54.753 INFO:teuthology.orchestra.run.smithi070.stdout:3859 write 0x9ddffea thru 0x9ded9d3 (0xd9ea bytes) 2024-09-11T06:18:54.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:54.757 INFO:teuthology.orchestra.run.smithi070.stdout:3860 read 0xb32859d thru 0xb337965 (0xf3c9 bytes) 2024-09-11T06:18:54.772 INFO:teuthology.orchestra.run.smithi070.stdout:3861 trunc from 0xe016774 to 0x92e271 2024-09-11T06:18:54.800 INFO:teuthology.orchestra.run.smithi070.stdout:3862 write 0xd643d54 thru 0xd6483d0 (0x467d bytes) 2024-09-11T06:18:54.803 INFO:teuthology.orchestra.run.smithi070.stdout:3863 write 0x110d4da thru 0x11183da (0xaf01 bytes) 2024-09-11T06:18:54.812 INFO:teuthology.orchestra.run.smithi070.stdout:3864 write 0xe28d818 thru 0xe28e10f (0x8f8 bytes) 2024-09-11T06:18:54.820 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:54.820+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:54.829 INFO:teuthology.orchestra.run.smithi070.stdout:3865 trunc from 0xe28e110 to 0x1116864 2024-09-11T06:18:54.843 INFO:teuthology.orchestra.run.smithi070.stdout:3866 trunc from 0x1116864 to 0x634e113 2024-09-11T06:18:54.848 INFO:teuthology.orchestra.run.smithi070.stdout:3867 read 0x2789bfa thru 0x278f5bb (0x59c2 bytes) 2024-09-11T06:18:54.855 INFO:teuthology.orchestra.run.smithi070.stdout:3868 trunc from 0x634e113 to 0xc7acf6 2024-09-11T06:18:54.884 INFO:teuthology.orchestra.run.smithi070.stdout:3870 write 0xdfe9be6 thru 0xdff4cff (0xb11a bytes) 2024-09-11T06:18:54.886 INFO:teuthology.orchestra.run.smithi070.stdout:3872 write 0x24d5c9d thru 0x24d724e (0x15b2 bytes) 2024-09-11T06:18:54.888 INFO:teuthology.orchestra.run.smithi070.stdout:3873 write 0x306c4dc thru 0x3071785 (0x52aa bytes) 2024-09-11T06:18:54.888 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:54.889 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:54.891 INFO:teuthology.orchestra.run.smithi070.stdout:3875 trunc from 0xdff4d00 to 0xe834e89 2024-09-11T06:18:54.896 INFO:teuthology.orchestra.run.smithi070.stdout:3876 read 0x699054c thru 0x699458e (0x4043 bytes) 2024-09-11T06:18:54.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:54.910 INFO:teuthology.orchestra.run.smithi070.stdout:3877 trunc from 0xe834e89 to 0x30537aa 2024-09-11T06:18:54.921 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:54.921+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:54.927 INFO:teuthology.orchestra.run.smithi070.stdout:3878 write 0x82dc748 thru 0x82ea35a (0xdc13 bytes) 2024-09-11T06:18:54.928 INFO:teuthology.orchestra.run.smithi070.stdout:3880 read 0xf9c287 thru 0xfab661 (0xf3db bytes) 2024-09-11T06:18:54.928 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.928 INFO:teuthology.orchestra.run.smithi070.stdout:3882 read 0x538103b thru 0x5385c9b (0x4c61 bytes) 2024-09-11T06:18:54.940 INFO:teuthology.orchestra.run.smithi070.stdout:3884 write 0xdb14ef3 thru 0xdb219ec (0xcafa bytes) 2024-09-11T06:18:54.943 INFO:teuthology.orchestra.run.smithi070.stdout:3886 write 0x278f41b thru 0x279e474 (0xf05a bytes) 2024-09-11T06:18:54.960 INFO:teuthology.orchestra.run.smithi070.stdout:3887 trunc from 0xdb219ed to 0xfe16f3 2024-09-11T06:18:54.972 INFO:teuthology.orchestra.run.smithi070.stdout:3888 trunc from 0xfe16f3 to 0x1668c45 2024-09-11T06:18:54.978 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:54.991 INFO:teuthology.orchestra.run.smithi070.stdout:3891 trunc from 0x1668c45 to 0xbf68d05 2024-09-11T06:18:54.997 INFO:teuthology.orchestra.run.smithi070.stdout:3895 punch from 0x385e0ca to 0x3860097, (0x1fcd bytes) 2024-09-11T06:18:54.997 INFO:teuthology.orchestra.run.smithi070.stdout:3896 writesame 0x535f18a thru 0x5365156 data_size 0x9(0x5fcd bytes) 2024-09-11T06:18:55.000 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.000 INFO:teuthology.orchestra.run.smithi070.stdout:3899 write 0xe3a0ed thru 0xe3dfaf (0x3ec3 bytes) 2024-09-11T06:18:55.003 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.003 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.003 INFO:teuthology.orchestra.run.smithi070.stdout:3904 read 0x296af8c thru 0x29794b8 (0xe52d bytes) 2024-09-11T06:18:55.008 INFO:teuthology.orchestra.run.smithi070.stdout:3905 trunc from 0xbf68d05 to 0x82afc8c 2024-09-11T06:18:55.014 INFO:teuthology.orchestra.run.smithi070.stdout:3906 punch from 0x6eb4197 to 0x6eb65d4, (0x243d bytes) 2024-09-11T06:18:55.015 INFO:teuthology.orchestra.run.smithi070.stdout:3909 punch from 0x23f0a9d to 0x23fe37c, (0xd8df bytes) 2024-09-11T06:18:55.015 INFO:teuthology.orchestra.run.smithi070.stdout:3912 write 0x3e072a5 thru 0x3e11d41 (0xaa9d bytes) 2024-09-11T06:18:55.017 INFO:teuthology.orchestra.run.smithi070.stdout:3913 read 0x39f02ef thru 0x39f2db6 (0x2ac8 bytes) 2024-09-11T06:18:55.017 INFO:teuthology.orchestra.run.smithi070.stdout:3914 read 0x9e7fc2 thru 0x9f3f08 (0xbf47 bytes) 2024-09-11T06:18:55.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:55.022 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:55.021+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:55.025 INFO:teuthology.orchestra.run.smithi070.stdout:3917 writesame 0xaed191e thru 0xaed6214 data_size 0x1(0x48f7 bytes) 2024-09-11T06:18:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:3918 writesame 0x3b02e45 thru 0x3b03363 data_size 0x3(0x51f bytes) 2024-09-11T06:18:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:55.027 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:55.030 INFO:teuthology.orchestra.run.smithi070.stdout:3919 read 0x6a375c thru 0x6b1038 (0xd8dd bytes) 2024-09-11T06:18:55.030 INFO:teuthology.orchestra.run.smithi070.stdout:3920 read 0x7036219 thru 0x703b264 (0x504c bytes) 2024-09-11T06:18:55.031 INFO:teuthology.orchestra.run.smithi070.stdout:3921 punch from 0x5b8f9f6 to 0x5b940f2, (0x46fc bytes) 2024-09-11T06:18:55.031 INFO:teuthology.orchestra.run.smithi070.stdout:3922 read 0x2986b99 thru 0x2995e24 (0xf28c bytes) 2024-09-11T06:18:55.031 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.037 INFO:teuthology.orchestra.run.smithi070.stdout:3924 trunc from 0xaed6215 to 0x6213ef4 2024-09-11T06:18:55.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:55.045 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.045 INFO:teuthology.orchestra.run.smithi070.stdout:3928 write 0x38750ac thru 0x3883671 (0xe5c6 bytes) 2024-09-11T06:18:55.049 INFO:teuthology.orchestra.run.smithi070.stdout:3929 trunc from 0x6213ef4 to 0x395c5e9 2024-09-11T06:18:55.061 INFO:teuthology.orchestra.run.smithi070.stdout:3930 read 0x218d4d3 thru 0x2197f0f (0xaa3d bytes) 2024-09-11T06:18:55.062 INFO:teuthology.orchestra.run.smithi070.stdout:3931 writesame 0x231c3d9 thru 0x231e8f2 data_size 0x3(0x251a bytes) 2024-09-11T06:18:55.080 INFO:teuthology.orchestra.run.smithi070.stdout:3933 writesame 0x7d044d1 thru 0x7d09717 data_size 0x15(0x5247 bytes) 2024-09-11T06:18:55.091 INFO:teuthology.orchestra.run.smithi070.stdout:3934 write 0x87cbfd6 thru 0x87ce0aa (0x20d5 bytes) 2024-09-11T06:18:55.093 INFO:teuthology.orchestra.run.smithi070.stdout:3936 punch from 0x53d8f72 to 0x53e8c1c, (0xfcaa bytes) 2024-09-11T06:18:55.093 INFO:teuthology.orchestra.run.smithi070.stdout:3937 punch from 0x3efa2e8 to 0x3efc6ef, (0x2407 bytes) 2024-09-11T06:18:55.093 INFO:teuthology.orchestra.run.smithi070.stdout:3938 writesame 0x44ec25 thru 0x45650e data_size 0x86(0x78ea bytes) 2024-09-11T06:18:55.093 INFO:teuthology.orchestra.run.smithi070.stdout:3939 read 0x3f34133 thru 0x3f4344a (0xf318 bytes) 2024-09-11T06:18:55.094 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.111 INFO:teuthology.orchestra.run.smithi070.stdout:3941 write 0xdd040b7 thru 0xdd0a948 (0x6892 bytes) 2024-09-11T06:18:55.113 INFO:teuthology.orchestra.run.smithi070.stdout:3946 read 0x470aacd thru 0x4711b8e (0x70c2 bytes) 2024-09-11T06:18:55.113 INFO:teuthology.orchestra.run.smithi070.stdout:3947 writesame 0xda2f090 thru 0xda2f2fc data_size 0x9(0x26d bytes) 2024-09-11T06:18:55.116 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.116 INFO:teuthology.orchestra.run.smithi070.stdout:3950 writesame 0x5379ebb thru 0x5386d75 data_size 0x45(0xcebb bytes) 2024-09-11T06:18:55.117 INFO:teuthology.orchestra.run.smithi070.stdout:3952 read 0x5d14bc9 thru 0x5d1ce4b (0x8283 bytes) 2024-09-11T06:18:55.117 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.118 INFO:teuthology.orchestra.run.smithi070.stdout:3956 write 0xf324ce thru 0xf39788 (0x72bb bytes) 2024-09-11T06:18:55.119 INFO:teuthology.orchestra.run.smithi070.stdout:3958 write 0x30e10c2 thru 0x30e1d32 (0xc71 bytes) 2024-09-11T06:18:55.120 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.120 INFO:teuthology.orchestra.run.smithi070.stdout:3960 punch from 0x8b092c2 to 0x8b1380c, (0xa54a bytes) 2024-09-11T06:18:55.121 INFO:teuthology.orchestra.run.smithi070.stdout:3961 punch from 0x412e62f to 0x4131012, (0x29e3 bytes) 2024-09-11T06:18:55.121 INFO:teuthology.orchestra.run.smithi070.stdout:3962 punch from 0x82080e9 to 0x8209c9e, (0x1bb5 bytes) 2024-09-11T06:18:55.121 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:55.123+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:55.131 INFO:teuthology.orchestra.run.smithi070.stdout:3964 writesame 0xebd3a66 thru 0xebe0d3b data_size 0x1(0xd2d6 bytes) 2024-09-11T06:18:55.132 INFO:teuthology.orchestra.run.smithi070.stdout:3965 read 0x42293c3 thru 0x423442d (0xb06b bytes) 2024-09-11T06:18:55.142 INFO:teuthology.orchestra.run.smithi070.stdout:3966 trunc from 0xebe0d3c to 0x78886eb 2024-09-11T06:18:55.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:18:55.158 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:55.161 INFO:teuthology.orchestra.run.smithi070.stdout:3967 write 0xab7cacd thru 0xab7e128 (0x165c bytes) 2024-09-11T06:18:55.162 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:55.162 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:55.163 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:55.163 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:55.163 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:55.163 INFO:teuthology.orchestra.run.smithi070.stdout:3969 punch from 0x329df76 to 0x329ffb3, (0x203d bytes) 2024-09-11T06:18:55.163 INFO:teuthology.orchestra.run.smithi070.stdout:3970 punch from 0xa25f24a to 0xa2677ac, (0x8562 bytes) 2024-09-11T06:18:55.163 INFO:teuthology.orchestra.run.smithi070.stdout:3972 read 0x54cbcb7 thru 0x54cd5db (0x1925 bytes) 2024-09-11T06:18:55.163 INFO:teuthology.orchestra.run.smithi070.stdout:3973 punch from 0x89acc94 to 0x89ad68c, (0x9f8 bytes) 2024-09-11T06:18:55.172 INFO:teuthology.orchestra.run.smithi070.stdout:3974 write 0xdf3c3a2 thru 0xdf45e88 (0x9ae7 bytes) 2024-09-11T06:18:55.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:55.175 INFO:teuthology.orchestra.run.smithi070.stdout:3975 writesame 0x69015c thru 0x69deb3 data_size 0x12(0xdd58 bytes) 2024-09-11T06:18:55.176 INFO:teuthology.orchestra.run.smithi070.stdout:3976 write 0x5562422 thru 0x55691eb (0x6dca bytes) 2024-09-11T06:18:55.179 INFO:teuthology.orchestra.run.smithi070.stdout:3979 punch from 0xa7ae216 to 0xa7bba73, (0xd85d bytes) 2024-09-11T06:18:55.179 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:55.180 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:55.180 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-11T06:18:55.190 INFO:teuthology.orchestra.run.smithi070.stdout:3982 trunc from 0xdf45e89 to 0x487961a 2024-09-11T06:18:55.199 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:55.200 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:55.203 INFO:teuthology.orchestra.run.smithi070.stdout:3983 writesame 0x5028ffe thru 0x5035079 data_size 0x4(0xc07c bytes) 2024-09-11T06:18:55.204 INFO:teuthology.orchestra.run.smithi070.stdout:3985 punch from 0x10c07f4 to 0x10c8a69, (0x8275 bytes) 2024-09-11T06:18:55.209 INFO:teuthology.orchestra.run.smithi070.stdout:3986 trunc from 0x503507a to 0x14bda3a 2024-09-11T06:18:55.218 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:55.218 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:55.224 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:55.223+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:55.236 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:55.236 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:55.240 INFO:teuthology.orchestra.run.smithi070.stdout:3987 write 0xd5e4d6b thru 0xd5f2c60 (0xdef6 bytes) 2024-09-11T06:18:55.242 INFO:teuthology.orchestra.run.smithi070.stdout:3988 read 0x64db696 thru 0x64df1cc (0x3b37 bytes) 2024-09-11T06:18:55.242 INFO:teuthology.orchestra.run.smithi070.stdout:3990 trunc from 0xd5f2c61 to 0xd42f22d 2024-09-11T06:18:55.248 INFO:teuthology.orchestra.run.smithi070.stdout:3991 read 0x6d6dd40 thru 0x6d73464 (0x5725 bytes) 2024-09-11T06:18:55.262 INFO:teuthology.orchestra.run.smithi070.stdout:3992 trunc from 0xd42f22d to 0x2791ba9 2024-09-11T06:18:55.267 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:55.267 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:55.268 INFO:teuthology.orchestra.run.smithi070.stderr:no valid command found; 10 closest matches: 2024-09-11T06:18:55.268 INFO:teuthology.orchestra.run.smithi070.stderr:0 2024-09-11T06:18:55.268 INFO:teuthology.orchestra.run.smithi070.stderr:1 2024-09-11T06:18:55.268 INFO:teuthology.orchestra.run.smithi070.stderr:2 2024-09-11T06:18:55.268 INFO:teuthology.orchestra.run.smithi070.stderr:abort 2024-09-11T06:18:55.268 INFO:teuthology.orchestra.run.smithi070.stderr:assert 2024-09-11T06:18:55.268 INFO:teuthology.orchestra.run.smithi070.stderr:config diff 2024-09-11T06:18:55.269 INFO:teuthology.orchestra.run.smithi070.stderr:config diff get 2024-09-11T06:18:55.269 INFO:teuthology.orchestra.run.smithi070.stderr:config get 2024-09-11T06:18:55.269 INFO:teuthology.orchestra.run.smithi070.stderr:config help [] 2024-09-11T06:18:55.269 INFO:teuthology.orchestra.run.smithi070.stderr:config set ... 2024-09-11T06:18:55.269 INFO:teuthology.orchestra.run.smithi070.stderr:admin_socket: invalid command 2024-09-11T06:18:55.270 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T06:18:55.270 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-11T06:18:55.285 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:55.286 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:55.286 INFO:teuthology.orchestra.run.smithi070.stdout:3993 write 0xbdd886b thru 0xbde7e7d (0xf613 bytes) 2024-09-11T06:18:55.288 INFO:teuthology.orchestra.run.smithi070.stdout:3994 write 0xb308937 thru 0xb3092dc (0x9a6 bytes) 2024-09-11T06:18:55.289 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-11T06:18:55.289 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-11T06:18:55.290 INFO:teuthology.orchestra.run.smithi070.stdout:3995 read 0x8aaf510 thru 0x8abd420 (0xdf11 bytes) 2024-09-11T06:18:55.290 INFO:teuthology.orchestra.run.smithi070.stdout:3996 writesame 0xabaa4c2 thru 0xababef3 data_size 0x7(0x1a32 bytes) 2024-09-11T06:18:55.291 INFO:teuthology.orchestra.run.smithi070.stdout:3997 read 0x7480d9a thru 0x748a9e3 (0x9c4a bytes) 2024-09-11T06:18:55.291 INFO:teuthology.orchestra.run.smithi070.stdout:3998 read 0x620723e thru 0x6213852 (0xc615 bytes) 2024-09-11T06:18:55.292 INFO:teuthology.orchestra.run.smithi070.stdout:3999 writesame 0x12682f1 thru 0x1272b75 data_size 0x7(0xa885 bytes) 2024-09-11T06:18:55.295 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.295 INFO:teuthology.orchestra.run.smithi070.stdout:4003 read 0x3d4836 thru 0x3dd82f (0x8ffa bytes) 2024-09-11T06:18:55.300 INFO:teuthology.orchestra.run.smithi070.stdout:4004 trunc from 0xbde7e7e to 0x83be960 2024-09-11T06:18:55.307 INFO:teuthology.orchestra.run.smithi070.stdout:4006 write 0x1fcc539 thru 0x1fdb574 (0xf03c bytes) 2024-09-11T06:18:55.310 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 95.505099395000002, 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:18:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:18:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.168745458, 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:18:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:18:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:18:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.168726117999999, 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:55.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:18:55.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.168707769000001, 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:18:55.326 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:18:55.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.168689584999999, 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:18:55.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:18:55.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.168670799000001, 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:18:55.335 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:18:55.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.168651799999999, 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:18:55.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.168623211, 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:18:55.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.168410085000001, 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.349 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:18:55.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165855197999999, 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:18:55.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165831507, 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:18:55.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165811480999999, 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:18:55.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.366 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165769925999999, 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:18:55.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:18:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:55.371 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165745983000001, 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:55.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:18:55.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165724574999999, 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:18:55.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:18:55.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165703786999998, 2024-09-11T06:18:55.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:18:55.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165683752, 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:18:55.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:18:55.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165663615, 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:18:55.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165641617999999, 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.165621553000001, 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.402 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:55.403 INFO:teuthology.orchestra.run.smithi070.stdout:4007 trunc from 0x83be960 to 0x68cea5e 2024-09-11T06:18:55.403 INFO:teuthology.orchestra.run.smithi070.stdout:4008 read 0x437fa88 thru 0x43825a5 (0x2b1e bytes) 2024-09-11T06:18:55.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:55.406 INFO:teuthology.orchestra.run.smithi070.stdout:4010 writesame 0x93ccde2 thru 0x93d37a7 data_size 0x3(0x69c6 bytes) 2024-09-11T06:18:55.406 INFO:teuthology.orchestra.run.smithi070.stdout:4013 read 0x8cd9d50 thru 0x8cdc8db (0x2b8c bytes) 2024-09-11T06:18:55.406 INFO:teuthology.orchestra.run.smithi070.stdout:4014 read 0x12797ef thru 0x12871e8 (0xd9fa bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4015 write 0x765a3ac thru 0x7666e98 (0xcaed bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4016 writesame 0xe54292e thru 0xe545890 data_size 0x1(0x2f63 bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4017 punch from 0x57a54b9 to 0x57ad327, (0x7e6e bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4018 write 0xe03e2c5 thru 0xe043822 (0x555e bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4019 punch from 0x2f9d6f8 to 0x2faa6c1, (0xcfc9 bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4020 write 0xa3a7937 thru 0xa3a9753 (0x1e1d bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4021 write 0xd52d84e thru 0xd538b4d (0xb300 bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4022 writesame 0xf50970 thru 0xf5f1d6 data_size 0x49(0xe867 bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4023 writesame 0xdb619e7 thru 0xdb61d55 data_size 0x1(0x36f bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4024 writesame 0x8b691fa thru 0x8b6bde9 data_size 0x26(0x2bf0 bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4027 read 0x756eb74 thru 0x7578d52 (0xa1df bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4028 read 0x6327848 thru 0x6329033 (0x17ec bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4029 trunc from 0xe545891 to 0x4752017 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4030 read 0x3b9aafc thru 0x3ba91b2 (0xe6b7 bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4031 punch from 0x28ba8c9 to 0x28be687, (0x3dbe bytes) 2024-09-11T06:18:55.407 INFO:teuthology.orchestra.run.smithi070.stdout:4034 writesame 0x83bbddc thru 0x83c686c data_size 0x7b(0xaa91 bytes) 2024-09-11T06:18:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:4037 read 0xc50a8e thru 0xc58a3f (0x7fb2 bytes) 2024-09-11T06:18:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:4038 read 0x6821bcb thru 0x682934b (0x7781 bytes) 2024-09-11T06:18:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:4039 trunc from 0x83c686d to 0x1bf738c 2024-09-11T06:18:55.424 INFO:teuthology.orchestra.run.smithi070.stdout:4040 write 0xaf6e1c5 thru 0xaf79c6c (0xbaa8 bytes) 2024-09-11T06:18:55.424 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:55.423+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:55.426 INFO:teuthology.orchestra.run.smithi070.stdout:4042 writesame 0x9c3c998 thru 0x9c4a1a4 data_size 0x29(0xd80d bytes) 2024-09-11T06:18:55.428 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.435 INFO:teuthology.orchestra.run.smithi070.stdout:4045 trunc from 0xaf79c6d to 0x4fc11d9 2024-09-11T06:18:55.455 INFO:teuthology.orchestra.run.smithi070.stdout:4048 write 0xa8537e3 thru 0xa862f08 (0xf726 bytes) 2024-09-11T06:18:55.456 INFO:teuthology.orchestra.run.smithi070.stdout:4049 write 0x3f8b738 thru 0x3f93269 (0x7b32 bytes) 2024-09-11T06:18:55.457 INFO:teuthology.orchestra.run.smithi070.stdout:4053 write 0x4da26e0 thru 0x4da7a2b (0x534c bytes) 2024-09-11T06:18:55.459 INFO:teuthology.orchestra.run.smithi070.stdout:4054 writesame 0x9cf90c3 thru 0x9cfe7dc data_size 0x1(0x571a bytes) 2024-09-11T06:18:55.472 INFO:teuthology.orchestra.run.smithi070.stdout:4055 write 0xaa9ee65 thru 0xaaa2955 (0x3af1 bytes) 2024-09-11T06:18:55.473 INFO:teuthology.orchestra.run.smithi070.stdout:4057 write 0x418ce7b thru 0x4191dbc (0x4f42 bytes) 2024-09-11T06:18:55.486 INFO:teuthology.orchestra.run.smithi070.stdout:4058 trunc from 0xaaa2956 to 0x26daad1 2024-09-11T06:18:55.506 INFO:teuthology.orchestra.run.smithi070.stdout:4060 write 0x88f47dd thru 0x88fbb92 (0x73b6 bytes) 2024-09-11T06:18:55.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:55.506+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:55.507 INFO:teuthology.orchestra.run.smithi070.stdout:4061 writesame 0x4403990 thru 0x440785e data_size 0x1(0x3ecf bytes) 2024-09-11T06:18:55.519 INFO:teuthology.orchestra.run.smithi070.stdout:4063 writesame 0x8cf348b thru 0x8cfd891 data_size 0x1(0xa407 bytes) 2024-09-11T06:18:55.520 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.529 INFO:teuthology.orchestra.run.smithi070.stdout:4065 trunc from 0x8cfd892 to 0x1c03941 2024-09-11T06:18:55.544 INFO:teuthology.orchestra.run.smithi070.stdout:4066 write 0x4f27da6 thru 0x4f30608 (0x8863 bytes) 2024-09-11T06:18:55.546 INFO:teuthology.orchestra.run.smithi070.stdout:4067 trunc from 0x4f30609 to 0x4643bcb 2024-09-11T06:18:55.553 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:55.553 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:55.553 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:18:55.553 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:55.556 INFO:teuthology.orchestra.run.smithi070.stdout:4068 trunc from 0x4643bcb to 0x5b2d892 2024-09-11T06:18:55.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:55.568 INFO:teuthology.orchestra.run.smithi070.stdout:4069 write 0x7e74d71 thru 0x7e7bcbf (0x6f4f bytes) 2024-09-11T06:18:55.570 INFO:teuthology.orchestra.run.smithi070.stdout:4071 writesame 0x2ebaf18 thru 0x2ecad70 data_size 0x17(0xfe59 bytes) 2024-09-11T06:18:55.579 INFO:teuthology.orchestra.run.smithi070.stdout:4073 trunc from 0x7e7bcc0 to 0xd42a144 2024-09-11T06:18:55.588 INFO:teuthology.orchestra.run.smithi070.stdout:4074 trunc from 0xd42a144 to 0xa7e2c16 2024-09-11T06:18:55.595 INFO:teuthology.orchestra.run.smithi070.stdout:4075 read 0x345b22f thru 0x3466be6 (0xb9b8 bytes) 2024-09-11T06:18:55.595 INFO:teuthology.orchestra.run.smithi070.stdout:4076 write 0x57d73a2 thru 0x57e0957 (0x95b6 bytes) 2024-09-11T06:18:55.597 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.597 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.597 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.597 INFO:teuthology.orchestra.run.smithi070.stdout:4083 read 0x51e276e thru 0x51f209e (0xf931 bytes) 2024-09-11T06:18:55.597 INFO:teuthology.orchestra.run.smithi070.stdout:4084 write 0x21bcf07 thru 0x21c2780 (0x587a bytes) 2024-09-11T06:18:55.599 INFO:teuthology.orchestra.run.smithi070.stdout:4085 writesame 0x4e57d8d thru 0x4e679b6 data_size 0x9f(0xfc2a bytes) 2024-09-11T06:18:55.602 INFO:teuthology.orchestra.run.smithi070.stdout:4086 trunc from 0xa7e2c16 to 0xba516c7 2024-09-11T06:18:55.608 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:55.607+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:55.608 INFO:teuthology.orchestra.run.smithi070.stdout:4087 read 0x7dba021 thru 0x7dc5bcc (0xbbac bytes) 2024-09-11T06:18:55.608 INFO:teuthology.orchestra.run.smithi070.stdout:4088 writesame 0x53d2fba thru 0x53d9b99 data_size 0x10(0x6be0 bytes) 2024-09-11T06:18:55.609 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:55.607+0000 7ff160885640 -1 osd.2 109 log_to_monitors true 2024-09-11T06:18:55.610 INFO:teuthology.orchestra.run.smithi070.stdout:4090 write 0x63938df thru 0x639e1b6 (0xa8d8 bytes) 2024-09-11T06:18:55.623 INFO:teuthology.orchestra.run.smithi070.stdout:4091 trunc from 0xba516c7 to 0x1dc83e2 2024-09-11T06:18:55.651 INFO:teuthology.orchestra.run.smithi070.stdout:4093 write 0xe97c51d thru 0xe984741 (0x8225 bytes) 2024-09-11T06:18:55.653 INFO:teuthology.orchestra.run.smithi070.stdout:4095 punch from 0x5374631 to 0x537b86b, (0x723a bytes) 2024-09-11T06:18:55.653 INFO:teuthology.orchestra.run.smithi070.stdout:4096 read 0xd4c1739 thru 0xd4cdbd6 (0xc49e bytes) 2024-09-11T06:18:55.653 INFO:teuthology.orchestra.run.smithi070.stdout:4097 writesame 0xbe7e9bf thru 0xbe869db data_size 0x1(0x801d bytes) 2024-09-11T06:18:55.664 INFO:teuthology.orchestra.run.smithi070.stdout:4099 read 0x22ed5b7 thru 0x22f3972 (0x63bc bytes) 2024-09-11T06:18:55.664 INFO:teuthology.orchestra.run.smithi070.stdout:4100 write 0x1a24939 thru 0x1a2e929 (0x9ff1 bytes) 2024-09-11T06:18:55.666 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.666 INFO:teuthology.orchestra.run.smithi070.stdout:4104 writesame 0x8d331a9 thru 0x8d3d776 data_size 0x13(0xa5ce bytes) 2024-09-11T06:18:55.671 INFO:teuthology.orchestra.run.smithi070.stdout:4105 trunc from 0xe984742 to 0xc2e06c9 2024-09-11T06:18:55.678 INFO:teuthology.orchestra.run.smithi070.stdout:4107 write 0x9f32231 thru 0x9f32894 (0x664 bytes) 2024-09-11T06:18:55.679 INFO:teuthology.orchestra.run.smithi070.stdout:4108 read 0x34142f9 thru 0x3421d3e (0xda46 bytes) 2024-09-11T06:18:55.685 INFO:teuthology.orchestra.run.smithi070.stdout:4109 writesame 0xcf57d28 thru 0xcf665cf data_size 0x14(0xe8a8 bytes) 2024-09-11T06:18:55.689 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:55.689 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:18:55.689 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:18:55.689 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:18:55.690 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:55.701 INFO:teuthology.orchestra.run.smithi070.stdout:4110 trunc from 0xcf665d0 to 0x161267d 2024-09-11T06:18:55.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:55.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:55.708+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:55.720 INFO:teuthology.orchestra.run.smithi070.stdout:4111 write 0x2f29efb thru 0x2f304a6 (0x65ac bytes) 2024-09-11T06:18:55.722 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.739 INFO:teuthology.orchestra.run.smithi070.stdout:4115 write 0xc665547 thru 0xc673ede (0xe998 bytes) 2024-09-11T06:18:55.741 INFO:teuthology.orchestra.run.smithi070.stdout:4117 read 0xbef8a5f thru 0xbf01065 (0x8607 bytes) 2024-09-11T06:18:55.754 INFO:teuthology.orchestra.run.smithi070.stdout:4118 trunc from 0xc673edf to 0x123f8e5 2024-09-11T06:18:55.763 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.769 INFO:teuthology.orchestra.run.smithi070.stdout:4120 write 0x22820e8 thru 0x2291263 (0xf17c bytes) 2024-09-11T06:18:55.770 INFO:teuthology.orchestra.run.smithi070.stdout:4123 read 0x5535ac thru 0x553c85 (0x6da bytes) 2024-09-11T06:18:55.779 INFO:teuthology.orchestra.run.smithi070.stdout:4125 trunc from 0x2291264 to 0x95778e8 2024-09-11T06:18:55.790 INFO:teuthology.orchestra.run.smithi070.stdout:4126 trunc from 0x95778e8 to 0x5a3e40d 2024-09-11T06:18:55.796 INFO:teuthology.orchestra.run.smithi070.stdout:4127 read 0x58011b7 thru 0x58027c1 (0x160b bytes) 2024-09-11T06:18:55.796 INFO:teuthology.orchestra.run.smithi070.stdout:4128 read 0x3159883 thru 0x315e8af (0x502d bytes) 2024-09-11T06:18:55.796 INFO:teuthology.orchestra.run.smithi070.stdout:4129 write 0x210a0b5 thru 0x2111096 (0x6fe2 bytes) 2024-09-11T06:18:55.803 INFO:teuthology.orchestra.run.smithi070.stdout:4130 trunc from 0x5a3e40d to 0x9d6b439 2024-09-11T06:18:55.810 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:55.809+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:55.814 INFO:teuthology.orchestra.run.smithi070.stdout:4131 trunc from 0x9d6b439 to 0x3d4ae52 2024-09-11T06:18:55.821 INFO:teuthology.orchestra.run.smithi070.stdout:4132 write 0x1e98d1 thru 0x1f4d6a (0xb49a bytes) 2024-09-11T06:18:55.822 INFO:teuthology.orchestra.run.smithi070.stdout:4134 read 0x299d098 thru 0x29a8c80 (0xbbe9 bytes) 2024-09-11T06:18:55.823 INFO:teuthology.orchestra.run.smithi070.stdout:4135 trunc from 0x3d4ae52 to 0x39ce527 2024-09-11T06:18:55.840 INFO:teuthology.orchestra.run.smithi070.stdout:4136 writesame 0x817c06a thru 0x81844e0 data_size 0x1(0x8477 bytes) 2024-09-11T06:18:55.841 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:18:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:18:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:18:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:18:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 116.219662469, 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:18:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:18:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:18:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:18:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 115.92522689099999, 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:18:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.658663697000001, 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:18:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63576 3.9 3:91ff73c0:::rbd_data.116dccfba5d9.0000000000000006:29 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.656449932000001, 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053575987999999998, 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63576 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182842+0000", 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182844+0000", 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182850+0000", 2024-09-11T06:18:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9970000000000004e-06 2024-09-11T06:18:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182854+0000", 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1829999999999996e-06 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235811+0000", 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052956403999999999 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.235933+0000", 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012229799999999999 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236418+0000", 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048509399999999999 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63577 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.656431011999999, 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053525649000000002, 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63577 2024-09-11T06:18:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182861+0000", 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.22e-07 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182863+0000", 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9e-06 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182876+0000", 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.311e-05 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182887+0000", 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1109e-05 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236375+0000", 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053487499000000001 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236387+0000", 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1708999999999999e-05 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63578 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.656387505000001, 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053516941999999998, 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63578 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182904+0000", 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182905+0000", 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182908+0000", 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6249999999999999e-06 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182915+0000", 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.525e-06 2024-09-11T06:18:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182921+0000", 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.48e-06 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236412+0000", 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053491483999999999 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236421+0000", 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2879999999999998e-06 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63579 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.656314973000001, 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053483819000000002, 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63579 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182977+0000", 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182978+0000", 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.99e-07 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182980+0000", 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6879999999999999e-06 2024-09-11T06:18:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182988+0000", 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.182995+0000", 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0129999999999996e-06 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236448+0000", 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053452983000000003 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236461+0000", 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2865e-05 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63580 3.9 3.3ceff89 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.656288494999998, 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053488579000000001, 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63580 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183003+0000", 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183004+0000", 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183006+0000", 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0650000000000001e-06 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183013+0000", 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6270000000000002e-06 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.183018+0000", 2024-09-11T06:18:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236482+0000", 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053463869999999997 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236492+0000", 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0471e-05 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90636 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 145408~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.695145746000001, 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053568440000000002, 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90636 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144146+0000", 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144147+0000", 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3299999999999998e-07 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144148+0000", 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.688e-06 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144154+0000", 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4990000000000002e-06 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144158+0000", 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3680000000000004e-06 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197315+0000", 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05315698 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197352+0000", 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6510000000000001e-05 2024-09-11T06:18:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197715+0000", 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00036306199999999999 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90637 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.695128772, 2024-09-11T06:18:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053721428000000002, 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90637 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144163+0000", 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144165+0000", 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144171+0000", 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2909999999999998e-06 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144175+0000", 2024-09-11T06:18:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0029999999999996e-06 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197740+0000", 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053565861999999999 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197779+0000", 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8339e-05 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197885+0000", 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105807 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90638 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.695111642000001, 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053925155000000002, 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90638 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144180+0000", 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144181+0000", 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144183+0000", 2024-09-11T06:18:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9479999999999998e-06 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144188+0000", 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4709999999999998e-06 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144193+0000", 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7040000000000002e-06 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197927+0000", 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053734188000000002 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.197993+0000", 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5839000000000004e-05 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198105+0000", 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011268 2024-09-11T06:18:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90639 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.695093233000001, 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054132671, 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90639 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144199+0000", 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144201+0000", 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0209999999999998e-06 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144207+0000", 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0510000000000002e-06 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144212+0000", 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5290000000000002e-06 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198160+0000", 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053948788999999997 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198221+0000", 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0395e-05 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198331+0000", 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110541 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90640 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.695074875, 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054316443999999998, 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90640 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144217+0000", 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3099999999999999e-07 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144219+0000", 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7549999999999999e-06 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144224+0000", 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2839999999999997e-06 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144229+0000", 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4549999999999997e-06 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198363+0000", 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054134045999999998 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198417+0000", 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198534+0000", 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116767 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90641 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.695057975000001, 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534245000000002, 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90641 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144234+0000", 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0499999999999999e-07 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144236+0000", 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144242+0000", 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5210000000000002e-06 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144253+0000", 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1297e-05 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198574+0000", 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054321665999999998 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198647+0000", 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2031000000000002e-05 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198768+0000", 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121703 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90642 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.695033295000002, 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054727525999999999, 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90642 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144259+0000", 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6399999999999998e-07 2024-09-11T06:18:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144261+0000", 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0499999999999999e-06 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144267+0000", 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7749999999999998e-06 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144271+0000", 2024-09-11T06:18:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5399999999999997e-06 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198806+0000", 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054534816999999999 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198867+0000", 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0776999999999998e-05 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.198986+0000", 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119203 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90643 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.695015265999999, 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054909368, 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90643 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144277+0000", 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144279+0000", 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.801e-06 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144284+0000", 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.451e-06 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144289+0000", 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199018+0000", 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054728994000000003 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199072+0000", 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3705999999999997e-05 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199186+0000", 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114521 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90644 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.694998079000001, 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055086361, 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90644 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144294+0000", 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144296+0000", 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.728e-06 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144301+0000", 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4009999999999996e-06 2024-09-11T06:18:55.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144306+0000", 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4159999999999997e-06 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199216+0000", 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054910051000000001 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199269+0000", 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3341000000000003e-05 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199380+0000", 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111103 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:55.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.694981106, 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:18:55.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:18:55.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.694963680000001, 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.694946424000001, 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:18:55.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:18:55.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:18:55.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:18:55.937 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:18:55.938 INFO:teuthology.orchestra.run.smithi070.stdout:4137 read 0x18a1de5 thru 0x18aa7fc (0x8a18 bytes) 2024-09-11T06:18:55.938 INFO:teuthology.orchestra.run.smithi070.stdout:4138 read 0x395f9b5 thru 0x396a11e (0xa76a bytes) 2024-09-11T06:18:55.938 INFO:teuthology.orchestra.run.smithi070.stdout:4139 punch from 0x230bdc8 to 0x2310464, (0x469c bytes) 2024-09-11T06:18:55.938 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.939 INFO:teuthology.orchestra.run.smithi070.stdout:4141 punch from 0x37d3a09 to 0x37e382a, (0xfe21 bytes) 2024-09-11T06:18:55.939 INFO:teuthology.orchestra.run.smithi070.stdout:4145 read 0x4e5bf26 thru 0x4e65178 (0x9253 bytes) 2024-09-11T06:18:55.939 INFO:teuthology.orchestra.run.smithi070.stdout:4146 write 0x198cf6d thru 0x199c065 (0xf0f9 bytes) 2024-09-11T06:18:55.939 INFO:teuthology.orchestra.run.smithi070.stdout:4148 punch from 0x42ede1 to 0x43a419, (0xb638 bytes) 2024-09-11T06:18:55.939 INFO:teuthology.orchestra.run.smithi070.stdout:4149 trunc from 0x81844e1 to 0x4ace6a5 2024-09-11T06:18:55.940 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:55.942 INFO:teuthology.orchestra.run.smithi070.stdout:4150 write 0x8fd27a4 thru 0x8fd8ba8 (0x6405 bytes) 2024-09-11T06:18:55.942 INFO:teuthology.orchestra.run.smithi070.stdout:4151 read 0x2d5dec3 thru 0x2d664df (0x861d bytes) 2024-09-11T06:18:55.942 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.942 INFO:teuthology.orchestra.run.smithi070.stdout:4154 trunc from 0x8fd8ba9 to 0x930f913 2024-09-11T06:18:55.942 INFO:teuthology.orchestra.run.smithi070.stdout:4155 read 0x5edffe0 thru 0x5eecafa (0xcb1b bytes) 2024-09-11T06:18:55.942 INFO:teuthology.orchestra.run.smithi070.stdout:4156 write 0x9b9ad14 thru 0x9ba617f (0xb46c bytes) 2024-09-11T06:18:55.942 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:4158 read 0x10eda5e thru 0x10fba8a (0xe02d bytes) 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:4159 write 0x1d7025a thru 0x1d72f4a (0x2cf1 bytes) 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:4160 writesame 0x214bad2 thru 0x2152dee data_size 0x39(0x731d bytes) 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:4161 read 0x473e093 thru 0x474479f (0x670d bytes) 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:4166 write 0xc0953cc thru 0xc098194 (0x2dc9 bytes) 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:4168 trunc from 0xc098195 to 0x29db225 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:4170 trunc from 0x29db225 to 0x4893b18 2024-09-11T06:18:55.943 INFO:teuthology.orchestra.run.smithi070.stdout:4171 writesame 0x36c191d thru 0x36cdbaf data_size 0x1(0xc293 bytes) 2024-09-11T06:18:55.944 INFO:teuthology.orchestra.run.smithi070.stdout:4172 punch from 0xa6f9ad to 0xa72330, (0x2983 bytes) 2024-09-11T06:18:55.945 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:55.944+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:55.957 INFO:teuthology.orchestra.run.smithi070.stdout:4173 writesame 0x881accd thru 0x88243e0 data_size 0x42(0x9714 bytes) 2024-09-11T06:18:55.958 INFO:teuthology.orchestra.run.smithi070.stdout:4174 writesame 0x666e13a thru 0x667ab16 data_size 0x1(0xc9dd bytes) 2024-09-11T06:18:55.976 INFO:teuthology.orchestra.run.smithi070.stdout:4175 read 0x57b66a9 thru 0x57c2f28 (0xc880 bytes) 2024-09-11T06:18:55.976 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:55.977 INFO:teuthology.orchestra.run.smithi070.stdout:4178 read 0x2b0b955 thru 0x2b1ab29 (0xf1d5 bytes) 2024-09-11T06:18:55.977 INFO:teuthology.orchestra.run.smithi070.stdout:4179 write 0x4317ff8 thru 0x43260ec (0xe0f5 bytes) 2024-09-11T06:18:55.979 INFO:teuthology.orchestra.run.smithi070.stdout:4181 read 0x1bb9d6a thru 0x1bc6d66 (0xcffd bytes) 2024-09-11T06:18:55.982 INFO:teuthology.orchestra.run.smithi070.stdout:4182 trunc from 0x88243e1 to 0x6aab349 2024-09-11T06:18:56.007 INFO:teuthology.orchestra.run.smithi070.stdout:4183 writesame 0xa9f5384 thru 0xa9fe817 data_size 0x25(0x9494 bytes) 2024-09-11T06:18:56.010 INFO:teuthology.orchestra.run.smithi070.stdout:4185 trunc from 0xa9fe818 to 0xca6296f 2024-09-11T06:18:56.023 INFO:teuthology.orchestra.run.smithi070.stdout:4186 trunc from 0xca6296f to 0x8bcda79 2024-09-11T06:18:56.042 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:56.042+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:56.044 INFO:teuthology.orchestra.run.smithi070.stdout:4187 writesame 0xbbc3859 thru 0xbbc9056 data_size 0x7(0x57fe bytes) 2024-09-11T06:18:56.049 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:56.050 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:56.057 INFO:teuthology.orchestra.run.smithi070.stdout:4188 trunc from 0xbbc9057 to 0x1ef31f0 2024-09-11T06:18:56.059 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:56.082 INFO:teuthology.orchestra.run.smithi070.stdout:4190 writesame 0xb742819 thru 0xb742903 data_size 0x1(0xeb bytes) 2024-09-11T06:18:56.083 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.083 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.083 INFO:teuthology.orchestra.run.smithi070.stdout:4194 read 0x5b922aa thru 0x5b9f49c (0xd1f3 bytes) 2024-09-11T06:18:56.092 INFO:teuthology.orchestra.run.smithi070.stdout:4196 trunc from 0xb742904 to 0x3aa203f 2024-09-11T06:18:56.101 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.101 INFO:teuthology.orchestra.run.smithi070.stdout:4198 read 0x26f3860 thru 0x2701f52 (0xe6f3 bytes) 2024-09-11T06:18:56.101 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.102 INFO:teuthology.orchestra.run.smithi070.stdout:4200 punch from 0x51f6e0 to 0x525c0c, (0x652c bytes) 2024-09-11T06:18:56.103 INFO:teuthology.orchestra.run.smithi070.stdout:4201 trunc from 0x3aa203f to 0x59ad181 2024-09-11T06:18:56.112 INFO:teuthology.orchestra.run.smithi070.stdout:4203 trunc from 0x59ad181 to 0x442fe7b 2024-09-11T06:18:56.137 INFO:teuthology.orchestra.run.smithi070.stdout:4204 write 0xcaa7c46 thru 0xcaae29d (0x6658 bytes) 2024-09-11T06:18:56.144 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:56.143+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:56.144 INFO:teuthology.orchestra.run.smithi070.stdout:4205 trunc from 0xcaae29e to 0x6ffb22d 2024-09-11T06:18:56.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:18:56.158 INFO:teuthology.orchestra.run.smithi070.stdout:4206 trunc from 0x6ffb22d to 0xb36aeac 2024-09-11T06:18:56.167 INFO:teuthology.orchestra.run.smithi070.stdout:4208 write 0x9e1bebb thru 0x9e23f68 (0x80ae bytes) 2024-09-11T06:18:56.169 INFO:teuthology.orchestra.run.smithi070.stdout:4211 read 0x417cb7a thru 0x417f479 (0x2900 bytes) 2024-09-11T06:18:56.169 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.169 INFO:teuthology.orchestra.run.smithi070.stdout:4213 punch from 0x627810 to 0x62c448, (0x4c38 bytes) 2024-09-11T06:18:56.169 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.169 INFO:teuthology.orchestra.run.smithi070.stdout:4215 punch from 0x33d8aaa to 0x33dbfae, (0x3504 bytes) 2024-09-11T06:18:56.169 INFO:teuthology.orchestra.run.smithi070.stdout:4217 punch from 0x8322611 to 0x8329a2f, (0x741e bytes) 2024-09-11T06:18:56.179 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:18:56.178+0000 7ff154634640 -1 osd.2 109 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T06:18:56.182 INFO:teuthology.orchestra.run.smithi070.stdout:4218 trunc from 0xb36aeac to 0x48b718 2024-09-11T06:18:56.210 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:56.236 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:56.237 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:56.238 INFO:teuthology.orchestra.run.smithi070.stdout:4219 write 0xc055376 thru 0xc056144 (0xdcf bytes) 2024-09-11T06:18:56.238 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.238 INFO:teuthology.orchestra.run.smithi070.stdout:4222 write 0x3f70032 thru 0x3f732ec (0x32bb bytes) 2024-09-11T06:18:56.238 INFO:teuthology.orchestra.run.smithi070.stdout:4223 punch from 0x53b0c27 to 0x53b3654, (0x2a2d bytes) 2024-09-11T06:18:56.238 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.239 INFO:teuthology.orchestra.run.smithi070.stdout:4226 write 0x2ae4f19 thru 0x2af052e (0xb616 bytes) 2024-09-11T06:18:56.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:4228 write 0xd4ba95b thru 0xd4be29a (0x3940 bytes) 2024-09-11T06:18:56.245 INFO:teuthology.orchestra.run.smithi070.stdout:4229 write 0x9c46500 thru 0x9c54801 (0xe302 bytes) 2024-09-11T06:18:56.248 INFO:teuthology.orchestra.run.smithi070.stdout:4230 punch from 0x14a75bd to 0x14b60bf, (0xeb02 bytes) 2024-09-11T06:18:56.248 INFO:teuthology.orchestra.run.smithi070.stdout:4231 write 0xcd458fa thru 0xcd50d69 (0xb470 bytes) 2024-09-11T06:18:56.252 INFO:teuthology.orchestra.run.smithi070.stdout:4235 read 0x6bb21c8 thru 0x6bba424 (0x825d bytes) 2024-09-11T06:18:56.253 INFO:teuthology.orchestra.run.smithi070.stdout:4236 punch from 0x3560d3d to 0x356cfc0, (0xc283 bytes) 2024-09-11T06:18:56.253 INFO:teuthology.orchestra.run.smithi070.stdout:4237 read 0x67e1f24 thru 0x67eaadd (0x8bba bytes) 2024-09-11T06:18:56.253 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.253 INFO:teuthology.orchestra.run.smithi070.stdout:4239 write 0x824585e thru 0x8246957 (0x10fa bytes) 2024-09-11T06:18:56.255 INFO:teuthology.orchestra.run.smithi070.stdout:4240 read 0x8ce14de thru 0x8ce86f7 (0x721a bytes) 2024-09-11T06:18:56.255 INFO:teuthology.orchestra.run.smithi070.stdout:4241 write 0x4cf88b5 thru 0x4d02bde (0xa32a bytes) 2024-09-11T06:18:56.256 INFO:teuthology.orchestra.run.smithi070.stdout:4242 punch from 0x3ce247b to 0x3ce9e06, (0x798b bytes) 2024-09-11T06:18:56.257 INFO:teuthology.orchestra.run.smithi070.stdout:4243 writesame 0x410460a thru 0x4109867 data_size 0xd(0x525e bytes) 2024-09-11T06:18:56.258 INFO:teuthology.orchestra.run.smithi070.stdout:4244 write 0xc218daf thru 0xc2257cd (0xca1f bytes) 2024-09-11T06:18:56.260 INFO:teuthology.orchestra.run.smithi070.stdout:4245 read 0x88cdc00 thru 0x88cfd5a (0x215b bytes) 2024-09-11T06:18:56.260 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:18:56.260 INFO:teuthology.orchestra.run.smithi070.stdout:4248 write 0x7bb0172 thru 0x7bb4955 (0x47e4 bytes) 2024-09-11T06:18:56.263 INFO:teuthology.orchestra.run.smithi070.stdout:4249 write 0xa865c26 thru 0xa865f14 (0x2ef bytes) 2024-09-11T06:18:56.265 INFO:teuthology.orchestra.run.smithi070.stdout:4252 write 0x9d13dc thru 0x9ddd78 (0xc99d bytes) 2024-09-11T06:18:56.266 INFO:teuthology.orchestra.run.smithi070.stdout:4253 read 0x3287677 thru 0x3294ea9 (0xd833 bytes) 2024-09-11T06:18:56.267 INFO:teuthology.orchestra.run.smithi070.stdout:4254 trunc from 0xd4be29b to 0xc3dd682 2024-09-11T06:18:56.276 INFO:teuthology.orchestra.run.smithi070.stdout:4256 clone 29 order 25 su 131072 sc 7 2024-09-11T06:18:56.283 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:56.283+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:56.345 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:56.345 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:56.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:56.345 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:2311 3.6 3:6105d0c6:::rbd_data.116dc3b5629f.0000000000000031:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.027303539000002, 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020763907000000002, 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 2311 2024-09-11T06:18:56.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316003+0000", 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316004+0000", 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.037e-06 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316011+0000", 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.793e-06 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316023+0000", 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2078e-05 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316029+0000", 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6810000000000003e-06 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316082+0000", 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3214000000000002e-05 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.316151+0000", 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9233999999999995e-05 2024-09-11T06:18:56.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.319646+0000", 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0034945470000000002 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336672+0000", 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017026728000000001 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:56.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336685+0000", 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2686e-05 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336719+0000", 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3661000000000002e-05 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:19.336767+0000", 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8248000000000003e-05 2024-09-11T06:18:56.351 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.352 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.352 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.352 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:4958 3.7 3:e39efd80:::rbd_data.116df69fa911.000000000000000c:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-11T06:18:56.352 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:56.352 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 90.714730321000005, 2024-09-11T06:18:56.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.023064595, 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 4958 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628576+0000", 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628577+0000", 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628581+0000", 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.873e-06 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628591+0000", 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0071999999999999e-05 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628596+0000", 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9010000000000002e-06 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628657+0000", 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0825000000000001e-05 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.628703+0000", 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6823999999999998e-05 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 6", 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.632401+0000", 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.003697231 2024-09-11T06:18:56.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651518+0000", 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019117477000000001 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651537+0000", 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9213000000000001e-05 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651591+0000", 2024-09-11T06:18:56.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3616999999999998e-05 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:25.651641+0000", 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9838e-05 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68256 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:56.358 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881900365, 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018100349000000002, 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68256 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:56.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461406+0000", 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461407+0000", 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6800000000000001e-07 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461416+0000", 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8409999999999995e-06 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461422+0000", 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.806e-06 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461427+0000", 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5040000000000004e-06 2024-09-11T06:18:56.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479297+0000", 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017870381000000001 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479385+0000", 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7690999999999998e-05 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479506+0000", 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012165800000000001 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68257 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881871897, 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018398100000000001, 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.363 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68257 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:56.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461435+0000", 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999995e-07 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461437+0000", 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2740000000000002e-06 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461444+0000", 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6769999999999998e-06 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461450+0000", 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7810000000000002e-06 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479581+0000", 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018131278000000001 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479687+0000", 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105931 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479833+0000", 2024-09-11T06:18:56.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014557200000000001 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68258 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 311296~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881850838999998, 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01871913, 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.368 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68258 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:56.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461456+0000", 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.32e-07 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461464+0000", 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461470+0000", 2024-09-11T06:18:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1120000000000001e-06 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461475+0000", 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7199999999999997e-06 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.479865+0000", 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018390118 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480028+0000", 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016266800000000001 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480175+0000", 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147236 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68259 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 339968~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881826378, 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018993309999999999, 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68259 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.373 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461480+0000", 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461481+0000", 2024-09-11T06:18:56.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6499999999999999e-07 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461483+0000", 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8029999999999999e-06 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461488+0000", 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5319999999999997e-06 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461493+0000", 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.634e-06 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480206+0000", 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018713032000000001 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480367+0000", 2024-09-11T06:18:56.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016139799999999999 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480473+0000", 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106346 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68260 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:29 [read 380928~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:56.377 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881808179, 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019218077, 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68260 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461498+0000", 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461499+0000", 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3099999999999998e-07 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461501+0000", 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7600000000000001e-06 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461506+0000", 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7989999999999999e-06 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461511+0000", 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:18:56.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480510+0000", 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018999095000000001 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480604+0000", 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3795000000000006e-05 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480716+0000", 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000112389 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68326 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881373533000001, 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019001186999999999, 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.382 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68326 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461933+0000", 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9299999999999998e-07 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461935+0000", 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461941+0000", 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461947+0000", 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9519999999999999e-06 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480755+0000", 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018807739 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480838+0000", 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3145000000000004e-05 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480934+0000", 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6009999999999997e-05 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.386 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68343 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881336247, 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019314591999999998, 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68343 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.387 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461970+0000", 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461971+0000", 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4499999999999998e-07 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461977+0000", 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0950000000000001e-06 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461982+0000", 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2950000000000001e-06 2024-09-11T06:18:56.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.461986+0000", 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9779999999999999e-06 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.480964+0000", 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.01897832 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481041+0000", 2024-09-11T06:18:56.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6755000000000006e-05 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481285+0000", 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000243804 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68352 3.2 3:444f8b11:::rbd_data.116dccfba5d9.0000000000000042:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:56.391 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881274901000001, 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019458092, 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68352 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462032+0000", 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4099999999999999e-07 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462034+0000", 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.725e-06 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462040+0000", 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8749999999999997e-06 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462044+0000", 2024-09-11T06:18:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4619999999999998e-06 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481326+0000", 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281586999999999 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481420+0000", 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3727000000000006e-05 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481490+0000", 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0174999999999998e-05 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:68369 3.2 3:466b029f:::rbd_data.116dccfba5d9.0000000000000053:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 30.881235117999999, 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019575028000000001, 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.396 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 68369 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462071+0000", 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462072+0000", 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9399999999999995e-07 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462074+0000", 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.711e-06 2024-09-11T06:18:56.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462080+0000", 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.37e-06 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.462084+0000", 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5279999999999997e-06 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481519+0000", 2024-09-11T06:18:56.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019434165 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481575+0000", 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6489000000000001e-05 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:25.481646+0000", 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1271000000000003e-05 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:110494 3.1b 3:db2012be:::rbd_data.116d6837dfb5.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108)", 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 21.654488114999999, 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026675217000000001, 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 110494 2024-09-11T06:18:56.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688818+0000", 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688819+0000", 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4399999999999999e-07 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688823+0000", 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7699999999999999e-06 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688831+0000", 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6820000000000003e-06 2024-09-11T06:18:56.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688835+0000", 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1980000000000003e-06 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688876+0000", 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1313999999999998e-05 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.688932+0000", 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5559000000000001e-05 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.693699+0000", 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.004767238 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715356+0000", 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.021657342 2024-09-11T06:18:56.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715375+0000", 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9241000000000001e-05 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715435+0000", 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9509000000000002e-05 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:34.715494+0000", 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8619999999999998e-05 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111656 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 1900544~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.906212767, 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017837603, 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.407 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111656 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437094+0000", 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437096+0000", 2024-09-11T06:18:56.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1579999999999999e-06 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437103+0000", 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3860000000000004e-06 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437108+0000", 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2750000000000003e-06 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454788+0000", 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017679812999999999 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454836+0000", 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7882e-05 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454931+0000", 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5673000000000004e-05 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.411 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111657 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.906178621999999, 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018066136, 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.412 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111657 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:56.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437128+0000", 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.99e-07 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437132+0000", 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2310000000000001e-06 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437141+0000", 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2539999999999998e-06 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437147+0000", 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.19e-06 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.454968+0000", 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017820722000000001 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455050+0000", 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1954999999999997e-05 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455194+0000", 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014418499999999999 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.416 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111658 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2555904~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.906149939999999, 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018208022000000001, 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111658 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437157+0000", 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4600000000000005e-07 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437160+0000", 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7250000000000002e-06 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437167+0000", 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7669999999999998e-06 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437172+0000", 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2830000000000001e-06 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455224+0000", 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018051851000000001 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455271+0000", 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7277999999999997e-05 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455365+0000", 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3572000000000005e-05 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.420 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111659 3.2 3:4192ae39:::rbd_data.116d6837dfb5.0000000000000003:2f [sparse-read 2752512~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.906128187, 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018392750999999999, 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.421 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111659 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437178+0000", 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437179+0000", 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437181+0000", 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437187+0000", 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3099999999999997e-06 2024-09-11T06:18:56.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437192+0000", 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455406+0000", 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018214088 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455460+0000", 2024-09-11T06:18:56.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3782000000000001e-05 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455571+0000", 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011140499999999999 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111665 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 1769472~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.906108491000001, 2024-09-11T06:18:56.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018690556000000001, 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111665 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:56.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437198+0000", 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437200+0000", 2024-09-11T06:18:56.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437207+0000", 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3759999999999996e-06 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437212+0000", 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1410000000000004e-06 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455621+0000", 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018408620000000001 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455715+0000", 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4238000000000001e-05 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455889+0000", 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000173769 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111666 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 1966080~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.906088382, 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018930618, 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111666 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437218+0000", 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437219+0000", 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437221+0000", 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9709999999999998e-06 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437227+0000", 2024-09-11T06:18:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.268e-06 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437232+0000", 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1490000000000002e-06 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.455924+0000", 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018692200999999999 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456003+0000", 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8368999999999995e-05 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456149+0000", 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00014622999999999999 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111667 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 2424832~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.906068578999999, 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019219610000000002, 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111667 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437238+0000", 2024-09-11T06:18:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437245+0000", 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1049999999999997e-06 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437252+0000", 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9399999999999996e-06 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437258+0000", 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3639999999999998e-06 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456202+0000", 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018944427999999999 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456295+0000", 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3268000000000002e-05 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456458+0000", 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016213100000000001 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:111668 3.2 3:4021940f:::rbd_data.116d6837dfb5.0000000000000007:2f [sparse-read 2621440~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.906042301999999, 2024-09-11T06:18:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019372776000000001, 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 111668 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437264+0000", 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437265+0000", 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437267+0000", 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.069e-06 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437273+0000", 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3690000000000003e-06 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.437278+0000", 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.169e-06 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456496+0000", 2024-09-11T06:18:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019217304000000001 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456547+0000", 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1004000000000002e-05 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:37.456637+0000", 2024-09-11T06:18:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0402000000000006e-05 2024-09-11T06:18:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.444 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:56.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:56.344+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:56.445 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:56.487 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:56.486+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:56.547 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:56.547+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:56.589 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:56.589 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:56.589 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:56.590 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:56.598 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:56.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:56.648+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:56.701 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:56.701 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:56.701 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:56.701 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:56.701 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:56.709 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:56.749 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:56.748+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:56.851 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:56.850+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:56.854 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29679 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3260416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416337639999995, 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025777099000000001, 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29679 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436323+0000", 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0079999999999999e-06 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436326+0000", 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436329+0000", 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461989+0000", 2024-09-11T06:18:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025660388999999999 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462029+0000", 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9854000000000002e-05 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462099+0000", 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0167999999999996e-05 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29680 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3473408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416328121999996, 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025900241000000001, 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29680 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436332+0000", 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1899999999999999e-07 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436333+0000", 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.049e-06 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436336+0000", 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8830000000000002e-06 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436338+0000", 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4700000000000001e-06 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462122+0000", 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025784081 2024-09-11T06:18:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462162+0000", 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9774999999999998e-05 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462232+0000", 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9764000000000005e-05 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29681 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3588096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416316563999999, 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026043075999999998, 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29681 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436344+0000", 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436348+0000", 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-06 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436350+0000", 2024-09-11T06:18:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462257+0000", 2024-09-11T06:18:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025906966999999999 2024-09-11T06:18:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462304+0000", 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7448999999999999e-05 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462386+0000", 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.174e-05 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29682 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416306555000006, 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026216950999999999, 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29682 2024-09-11T06:18:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436354+0000", 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436357+0000", 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436360+0000", 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.464e-06 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462412+0000", 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026052230999999999 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462459+0000", 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7207999999999999e-05 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462570+0000", 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110968 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29683 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416297119000006, 2024-09-11T06:18:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026370945, 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29683 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436363+0000", 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436364+0000", 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436367+0000", 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436369+0000", 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5059999999999998e-06 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462606+0000", 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026237114999999998 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462653+0000", 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462733+0000", 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0605999999999994e-05 2024-09-11T06:18:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29684 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416287513, 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026632194000000001, 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29684 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436373+0000", 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6899999999999996e-07 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436376+0000", 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9699999999999999e-06 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436379+0000", 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462758+0000", 2024-09-11T06:18:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026378990000000001 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462846+0000", 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8641999999999996e-05 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463004+0000", 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015788 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29685 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416277999000002, 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026764263, 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29685 2024-09-11T06:18:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436383+0000", 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436386+0000", 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436388+0000", 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6570000000000001e-06 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463023+0000", 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026634722 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463068+0000", 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5025999999999999e-05 2024-09-11T06:18:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463146+0000", 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7729000000000001e-05 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29686 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416268009999996, 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026966905999999999, 2024-09-11T06:18:56.888 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29686 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436393+0000", 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:18:56.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436396+0000", 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.915e-06 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436398+0000", 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463173+0000", 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026774703 2024-09-11T06:18:56.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463242+0000", 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9770000000000005e-05 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463358+0000", 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116038 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29687 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416258782, 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027120658999999998, 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29687 2024-09-11T06:18:56.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436402+0000", 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436405+0000", 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8899999999999999e-06 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436407+0000", 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463391+0000", 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026983285999999999 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463433+0000", 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2481999999999997e-05 2024-09-11T06:18:56.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463521+0000", 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8373000000000002e-05 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29688 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416249381, 2024-09-11T06:18:56.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027291494999999999, 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29688 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:56.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436411+0000", 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-06 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436414+0000", 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8940000000000002e-06 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436417+0000", 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5069999999999999e-06 2024-09-11T06:18:56.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463562+0000", 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027144622 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463621+0000", 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9108999999999999e-05 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463702+0000", 2024-09-11T06:18:56.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29689 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416239853999997, 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027435349000000001, 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29689 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436423+0000", 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436426+0000", 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0010000000000002e-06 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436429+0000", 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4739999999999999e-06 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463726+0000", 2024-09-11T06:18:56.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027297482000000001 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463780+0000", 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3714000000000001e-05 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463855+0000", 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5278000000000007e-05 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29690 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416228040999997, 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027575023000000001, 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29690 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436433+0000", 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436436+0000", 2024-09-11T06:18:56.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8959999999999999e-06 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436438+0000", 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.514e-06 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463880+0000", 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027442151000000001 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463924+0000", 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3983000000000002e-05 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464007+0000", 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2274000000000005e-05 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.911 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29691 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416217943999996, 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027733827999999999, 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29691 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:56.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436443+0000", 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.279e-06 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436446+0000", 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436449+0000", 2024-09-11T06:18:56.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464034+0000", 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027585492 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464082+0000", 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7444999999999997e-05 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464175+0000", 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3954000000000002e-05 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29692 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5439488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416208114, 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027927924, 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.916 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29692 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436452+0000", 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436453+0000", 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1179999999999999e-06 2024-09-11T06:18:56.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436456+0000", 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436458+0000", 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464214+0000", 2024-09-11T06:18:56.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027755618999999999 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464266+0000", 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2354000000000001e-05 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464379+0000", 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011328900000000001 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29693 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5554176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416198711999996, 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028112022, 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29693 2024-09-11T06:18:56.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:56.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436462+0000", 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.031e-06 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436465+0000", 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3230000000000002e-06 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436468+0000", 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4870000000000001e-06 2024-09-11T06:18:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464414+0000", 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027946104999999999 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464468+0000", 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3637999999999997e-05 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464573+0000", 2024-09-11T06:18:56.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105232 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29694 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5767168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416188770999995, 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028256073999999999, 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29694 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436472+0000", 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436475+0000", 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8870000000000001e-06 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436478+0000", 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464591+0000", 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028113171999999999 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464643+0000", 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950999999999998e-05 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464727+0000", 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4133000000000002e-05 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29695 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5881856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416179072999995, 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02845924, 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.930 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29695 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436482+0000", 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.111e-06 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436485+0000", 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-11T06:18:56.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436487+0000", 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5859999999999999e-06 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464762+0000", 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028274773 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464848+0000", 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6269999999999999e-05 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464940+0000", 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1345e-05 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.934 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29696 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6094848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416169343000007, 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028603799999999999, 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29696 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:18:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436491+0000", 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.879999999999999e-07 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436494+0000", 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8339999999999999e-06 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436497+0000", 2024-09-11T06:18:56.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.328e-06 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464970+0000", 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028473196999999999 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465017+0000", 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465094+0000", 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6606999999999993e-05 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29697 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6209536~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.416156728000004, 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028751832000000001, 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29697 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436504+0000", 2024-09-11T06:18:56.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.319e-06 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436508+0000", 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2729999999999998e-06 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436510+0000", 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465125+0000", 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028614537999999998 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465174+0000", 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8965000000000003e-05 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465255+0000", 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0798999999999997e-05 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.943 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.509420243999998, 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:56.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:18:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:56.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:18:56.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.949 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:56.950 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:56.950 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:56.951 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:56.951 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:56.950+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:57.051 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:57.051+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:57.095 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:57.096 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:57.096 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:18:57.096 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:57.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:18:57.152 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:57.151+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:57.155 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:18:57.252 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:18:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:18:57.252 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:18:57.253 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:57.254 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:57.253+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:57.259 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:18:57.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:18:57.354 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:57.354+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836468698000004, 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.364 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:18:57.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836450248999995, 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:18:57.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:18:57.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836419452000001, 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.373 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:18:57.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:18:57.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836400444000006, 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:18:57.377 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:18:57.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836381775999996, 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.382 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:18:57.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836359716999993, 2024-09-11T06:18:57.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:57.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.390 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836340852999996, 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:18:57.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836321072000004, 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.395 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:18:57.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836302144000001, 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.399 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.403 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836261664000006, 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.836231554999998, 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.408 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:18:57.411 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.834140359000003, 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:57.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.834063438000001, 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.416 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:18:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:57.420 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.834039137999994, 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:18:57.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.834003718999995, 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.425 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:18:57.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:18:57.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.833986515000007, 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:18:57.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:18:57.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.833970252, 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.433 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:18:57.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.833953274999999, 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.437 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.833937289999994, 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.441 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 68.833919320999996, 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:57.445 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:57.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:57.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:57.449 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:57.450 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:57.450 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:57.451 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:57.451 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:57.451 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:57.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:18:57.455 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:57.454+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:57.456 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:57.456 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-11T06:18:57.471 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:57.472 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:57.488 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:57.488 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:57.504 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:57.505 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:57.521 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:57.521 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:57.537 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:57.589 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:57.588+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:57.597 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:57.597 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:57.606 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:18:57.657 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:57.656+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:57.709 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:57.709 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:57.718 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:18:57.761 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:57.761+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:57.821 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:57.821 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:57.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:18:57.871 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:57.870+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:57.933 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:57.933 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:57.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:18:57.960 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:57.960+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:58.046 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:58.047 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:58.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:18:58.099 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:58.098+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:58.160 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:58.160 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:58.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:58.161+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:58.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:18:58.263 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:58.262+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:58.317 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:58.317 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:58.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:18:58.367 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:58.366+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:58.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:18:58.464+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:18:58.469 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:58.469 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:58.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:18:58.565 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:58.564+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:58.581 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:58.581 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:58.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:18:58.674 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:18:58.673+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:18:58.734 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:58.734 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:58.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:18:58.784 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:58.783+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:58.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:58.868+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:58.885 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:58.886 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:58.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:18:58.969 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:18:58.968+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:18:58.998 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:58.998 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:59.007 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:18:59.070 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:59.069+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:59.121 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:59.121 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:59.129 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:18:59.171 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:59.170+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:59.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:18:59.272 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:59.271+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:59.277 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:59.277 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:59.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:18:59.373 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:18:59.372+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:18:59.429 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:59.429 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:59.437 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:18:59.479 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:18:59.478+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:18:59.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:18:59.582 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:59.582 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:59.590 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:18:59.596 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:59.595+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:59.672 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:18:59.673 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:18:59.676 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:18:59.675+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:18:59.689 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:18:59.689 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:18:59.694 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:18:59.694 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:18:59.703 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:18:59.706 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:18:59.706 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:18:59.722 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:18:59.722 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:18:59.738 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:18:59.738 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:18:59.756 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:18:59.757 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:18:59.771 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:18:59.771 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:18:59.776 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:59.776+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:18:59.789 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:18:59.789 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:18:59.810 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:18:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:18:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:18:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:18:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29679 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3260416~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:59.810 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372353021999999, 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025777099000000001, 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29679 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:59.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436322+0000", 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436323+0000", 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0079999999999999e-06 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436326+0000", 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9639999999999999e-06 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436329+0000", 2024-09-11T06:18:59.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.447e-06 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.461989+0000", 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025660388999999999 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462029+0000", 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9854000000000002e-05 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462099+0000", 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0167999999999996e-05 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29680 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3473408~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372343504, 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025900241000000001, 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.815 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29680 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436331+0000", 2024-09-11T06:18:59.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436332+0000", 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1899999999999999e-07 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436333+0000", 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.049e-06 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436336+0000", 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8830000000000002e-06 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436338+0000", 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4700000000000001e-06 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462122+0000", 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025784081 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462162+0000", 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9774999999999998e-05 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462232+0000", 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9764000000000005e-05 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.819 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29681 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3588096~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372331946000003, 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026043075999999998, 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29681 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.820 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436343+0000", 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3099999999999999e-07 2024-09-11T06:18:59.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436344+0000", 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.133e-06 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436348+0000", 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-06 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436350+0000", 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462257+0000", 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.025906966999999999 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462304+0000", 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7448999999999999e-05 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462386+0000", 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.174e-05 2024-09-11T06:18:59.823 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29682 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372321936999995, 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026216950999999999, 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.824 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29682 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436353+0000", 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436354+0000", 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9900000000000009e-07 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436357+0000", 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436360+0000", 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.464e-06 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462412+0000", 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026052230999999999 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462459+0000", 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7207999999999999e-05 2024-09-11T06:18:59.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462570+0000", 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110968 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29683 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372312500999996, 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026370945, 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.828 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29683 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436362+0000", 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436363+0000", 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436364+0000", 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436367+0000", 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436369+0000", 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5059999999999998e-06 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462606+0000", 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026237114999999998 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462653+0000", 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6498000000000001e-05 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462733+0000", 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0605999999999994e-05 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29684 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:59.832 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372302895000004, 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026632194000000001, 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29684 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436372+0000", 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2000000000000001e-07 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436373+0000", 2024-09-11T06:18:59.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6899999999999996e-07 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436376+0000", 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9699999999999999e-06 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436379+0000", 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462758+0000", 2024-09-11T06:18:59.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026378990000000001 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.462846+0000", 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8641999999999996e-05 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463004+0000", 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015788 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29685 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372293381000006, 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026764263, 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29685 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436382+0000", 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436383+0000", 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0499999999999999e-06 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436386+0000", 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8789999999999999e-06 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436388+0000", 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6570000000000001e-06 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463023+0000", 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026634722 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463068+0000", 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5025999999999999e-05 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463146+0000", 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7729000000000001e-05 2024-09-11T06:18:59.840 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29686 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372283392, 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026966905999999999, 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.841 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29686 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436392+0000", 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436393+0000", 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3500000000000005e-07 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436396+0000", 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.915e-06 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436398+0000", 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463173+0000", 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026774703 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463242+0000", 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9770000000000005e-05 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463358+0000", 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000116038 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29687 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372274164000004, 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027120658999999998, 2024-09-11T06:18:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29687 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436401+0000", 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436402+0000", 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436405+0000", 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8899999999999999e-06 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436407+0000", 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5160000000000001e-06 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463391+0000", 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.026983285999999999 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463433+0000", 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2481999999999997e-05 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463521+0000", 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8373000000000002e-05 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29688 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372264763000004, 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027291494999999999, 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29688 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436410+0000", 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436411+0000", 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.065e-06 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436414+0000", 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8940000000000002e-06 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436417+0000", 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5069999999999999e-06 2024-09-11T06:18:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463562+0000", 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027144622 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463621+0000", 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9108999999999999e-05 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463702+0000", 2024-09-11T06:18:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29689 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372255236000001, 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027435349000000001, 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29689 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436420+0000", 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436423+0000", 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436426+0000", 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0010000000000002e-06 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436429+0000", 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4739999999999999e-06 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463726+0000", 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027297482000000001 2024-09-11T06:18:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463780+0000", 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3714000000000001e-05 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463855+0000", 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5278000000000007e-05 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29690 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372243423, 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027575023000000001, 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29690 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436432+0000", 2024-09-11T06:18:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436433+0000", 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9600000000000008e-07 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436436+0000", 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8959999999999999e-06 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436438+0000", 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.514e-06 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463880+0000", 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027442151000000001 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.463924+0000", 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3983000000000002e-05 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464007+0000", 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2274000000000005e-05 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29691 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372233326, 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027733827999999999, 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29691 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436442+0000", 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436443+0000", 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.279e-06 2024-09-11T06:18:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436446+0000", 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9289999999999998e-06 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436449+0000", 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464034+0000", 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027585492 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464082+0000", 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7444999999999997e-05 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464175+0000", 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3954000000000002e-05 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29692 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5439488~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372223496000004, 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027927924, 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29692 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436451+0000", 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436452+0000", 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436453+0000", 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1179999999999999e-06 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436456+0000", 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8590000000000001e-06 2024-09-11T06:18:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436458+0000", 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464214+0000", 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027755618999999999 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464266+0000", 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2354000000000001e-05 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464379+0000", 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011328900000000001 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29693 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5554176~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372214094, 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028112022, 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29693 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436461+0000", 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436462+0000", 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.031e-06 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436465+0000", 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3230000000000002e-06 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436468+0000", 2024-09-11T06:18:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4870000000000001e-06 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464414+0000", 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.027946104999999999 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464468+0000", 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3637999999999997e-05 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464573+0000", 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105232 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29694 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5767168~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372204152999998, 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028256073999999999, 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29694 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436471+0000", 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:18:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436472+0000", 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436475+0000", 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8870000000000001e-06 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436478+0000", 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464591+0000", 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028113171999999999 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464643+0000", 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1950999999999998e-05 2024-09-11T06:18:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464727+0000", 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4133000000000002e-05 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29695 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 5881856~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372194454999999, 2024-09-11T06:18:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.02845924, 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29695 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436481+0000", 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436482+0000", 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.111e-06 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436485+0000", 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.954e-06 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436487+0000", 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5859999999999999e-06 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464762+0000", 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028274773 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464848+0000", 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6269999999999999e-05 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464940+0000", 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1345e-05 2024-09-11T06:18:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29696 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6094848~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372184724999997, 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028603799999999999, 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29696 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436490+0000", 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436491+0000", 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.879999999999999e-07 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436494+0000", 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8339999999999999e-06 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436497+0000", 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.328e-06 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.464970+0000", 2024-09-11T06:18:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028473196999999999 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465017+0000", 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7639000000000002e-05 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465094+0000", 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6606999999999993e-05 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:29697 3.10 3:0f6ee466:::rbd_data.116d770b822.000000000000000a:13 [read 6209536~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.372172109999994, 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028751832000000001, 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 29697 2024-09-11T06:18:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436503+0000", 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436504+0000", 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.319e-06 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436508+0000", 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2729999999999998e-06 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.436510+0000", 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7140000000000002e-06 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465125+0000", 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.028614537999999998 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465174+0000", 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8965000000000003e-05 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.465255+0000", 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0798999999999997e-05 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.465435626000001, 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:18:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:18:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:18:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:18:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:18:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:18:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:18:59.902 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:18:59.903 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:18:59.904 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:18:59.903+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:00.004 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:00.004+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:00.048 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:00.048 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:00.048 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:00.048 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:00.057 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:00.109 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:19:00.141 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:00.141+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:00.203 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:00.203 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:00.203 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:00.203 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:00.203 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:00.207 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:00.206+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:00.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:00.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:00.317 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:00.316+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:00.357 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30382 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5079040~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829535380999999, 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042792772999999999, 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30382 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526153+0000", 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526154+0000", 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526156+0000", 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7889999999999999e-06 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526162+0000", 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9100000000000002e-06 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526166+0000", 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8210000000000001e-06 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568776+0000", 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042609859999999999 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568851+0000", 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4760999999999998e-05 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568946+0000", 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5252000000000002e-05 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30383 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5406720~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:19:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829516932000004, 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042963821999999999, 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30383 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526172+0000", 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526184+0000", 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1274000000000001e-05 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526191+0000", 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.396e-06 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526196+0000", 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7890000000000002e-06 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.568976+0000", 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042779910999999997 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569044+0000", 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8219999999999994e-05 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569136+0000", 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1877000000000001e-05 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30384 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 5734400~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829486134999996, 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043126104999999998, 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30384 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526203+0000", 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5600000000000001e-07 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526205+0000", 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1260000000000001e-06 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526211+0000", 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.818e-06 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526216+0000", 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6e-06 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569164+0000", 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042948126000000003 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569234+0000", 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0375000000000003e-05 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569329+0000", 2024-09-11T06:19:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4604000000000004e-05 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30385 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6062080~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829467127000001, 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043304407000000003, 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30385 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:19:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526222+0000", 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3799999999999997e-07 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526224+0000", 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.967e-06 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526230+0000", 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8769999999999998e-06 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526235+0000", 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8380000000000001e-06 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569356+0000", 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043121112000000003 2024-09-11T06:19:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569434+0000", 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7859000000000001e-05 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569526+0000", 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2215999999999999e-05 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30386 3.4 3:259fab9d:::rbd_data.116d770b822.000000000000000e:13 [read 6389760~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829448459000005, 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043483094, 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30386 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526240+0000", 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526241+0000", 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526243+0000", 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.804e-06 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526248+0000", 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9009999999999999e-06 2024-09-11T06:19:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526256+0000", 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9330000000000001e-06 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569554+0000", 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043297832000000001 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569634+0000", 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9468000000000006e-05 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569723+0000", 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9804999999999998e-05 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30387 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829426400000003, 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043509806999999998, 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30387 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526262+0000", 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526263+0000", 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.51e-07 2024-09-11T06:19:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526265+0000", 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.08e-06 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526271+0000", 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526276+0000", 2024-09-11T06:19:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1479999999999999e-06 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569762+0000", 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043486195999999998 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569772+0000", 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0417999999999999e-05 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30388 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829407536000005, 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043522960999999999, 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30388 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526281+0000", 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526282+0000", 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526285+0000", 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.179e-06 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526291+0000", 2024-09-11T06:19:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526296+0000", 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6709999999999998e-06 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569797+0000", 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043501339 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569804+0000", 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3250000000000002e-06 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30389 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829387754999999, 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043534997999999998, 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30389 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526301+0000", 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526303+0000", 2024-09-11T06:19:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.889e-06 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526310+0000", 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5239999999999997e-06 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526314+0000", 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6700000000000002e-06 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569829+0000", 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043514048999999999 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569836+0000", 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5290000000000003e-06 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30390 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:19:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829368826999996, 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043550080999999997, 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30390 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526320+0000", 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3000000000000002e-07 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526329+0000", 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9260000000000006e-06 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526348+0000", 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8471999999999999e-05 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526353+0000", 2024-09-11T06:19:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.519e-06 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569859+0000", 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043505914 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569870+0000", 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.092e-05 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30391 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829328347000001, 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043540758999999998, 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30391 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526360+0000", 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526361+0000", 2024-09-11T06:19:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526363+0000", 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526378+0000", 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4911e-05 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526383+0000", 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0780000000000003e-06 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569894+0000", 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043510452999999998 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569901+0000", 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6799999999999993e-06 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30392 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.829298238000007, 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043544053999999999, 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30392 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526391+0000", 2024-09-11T06:19:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526393+0000", 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526399+0000", 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0900000000000001e-06 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.526404+0000", 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569925+0000", 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.043521378999999999 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.569935+0000", 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6190000000000006e-06 2024-09-11T06:19:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30483 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.827207041999998, 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042781698, 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30483 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528482+0000", 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528495+0000", 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2534999999999999e-05 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528502+0000", 2024-09-11T06:19:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9410000000000001e-06 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528506+0000", 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6260000000000003e-06 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571256+0000", 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042750172000000003 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571263+0000", 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1670000000000002e-06 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30485 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.827130120999996, 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042771993000000001, 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30485 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528559+0000", 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528561+0000", 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0190000000000001e-06 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528571+0000", 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.9790000000000005e-06 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528576+0000", 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1599999999999997e-06 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571324+0000", 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042747194000000002 2024-09-11T06:19:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571331+0000", 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.153e-06 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30486 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.827105821000004, 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774626000000003, 2024-09-11T06:19:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30486 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528583+0000", 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528585+0000", 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.88e-06 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528591+0000", 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5539999999999997e-06 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528595+0000", 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1690000000000002e-06 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571354+0000", 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042758611000000002 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571358+0000", 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0069999999999999e-06 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30488 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.827070402000004, 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042774173999999998, 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30488 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528618+0000", 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528619+0000", 2024-09-11T06:19:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528620+0000", 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4699999999999999e-06 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528626+0000", 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3920000000000002e-06 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528630+0000", 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0910000000000003e-06 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571386+0000", 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042756074999999998 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571393+0000", 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30489 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.827053198000002, 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042785114999999999, 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30489 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528636+0000", 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.34e-07 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528638+0000", 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.849e-06 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528644+0000", 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528648+0000", 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3869999999999997e-06 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571413+0000", 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042765522 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571421+0000", 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3039999999999999e-06 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30490 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.827036934999995, 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042798848, 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30490 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528652+0000", 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.41e-07 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528653+0000", 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.296e-06 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528659+0000", 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528663+0000", 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2259999999999999e-06 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571442+0000", 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042778801999999998 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571451+0000", 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9069999999999996e-06 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30491 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.827019957999994, 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806403999999999, 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30491 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528669+0000", 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.72e-07 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528671+0000", 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9700000000000002e-06 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528677+0000", 2024-09-11T06:19:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8629999999999996e-06 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528680+0000", 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.078e-06 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571471+0000", 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042791045 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571475+0000", 2024-09-11T06:19:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0759999999999996e-06 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30492 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.827003973000004, 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042806173000000003, 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30492 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528685+0000", 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528687+0000", 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7400000000000001e-06 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528692+0000", 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5759999999999996e-06 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528697+0000", 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4750000000000004e-06 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571487+0000", 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042789721000000003 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571491+0000", 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3470000000000001e-06 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:30493 3.4 3.b9d5f9a4 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 71.826986004000005, 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042817989000000001, 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 30493 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528703+0000", 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4700000000000002e-07 2024-09-11T06:19:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528710+0000", 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.392e-06 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528720+0000", 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-05 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.528724+0000", 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6990000000000001e-06 2024-09-11T06:19:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571511+0000", 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042787128000000001 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.571521+0000", 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.443 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:00.445 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:00.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:00.443+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:00.445 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:00.445 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:00.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118743 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:00.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.259657688, 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.25967858100000002, 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118743 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:00.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118559+0000", 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118568+0000", 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4279999999999996e-06 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118589+0000", 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1129999999999999e-05 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118599+0000", 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8789999999999998e-06 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118670+0000", 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1087999999999994e-05 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118679+0000", 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.115e-06 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118751 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:00.449 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.25935628799999999, 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.25941765999999999, 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118751 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.85e-07 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118863+0000", 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:00.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2741999999999999e-05 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118884+0000", 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7109999999999995e-06 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118951+0000", 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7347000000000004e-05 2024-09-11T06:19:00.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118958+0000", 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0180000000000004e-06 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118759 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.25904854599999999, 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.259142751, 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:00.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118759 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:00.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119167+0000", 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119173+0000", 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0859999999999998e-06 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:00.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119187+0000", 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4133e-05 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119194+0000", 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-06 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119251+0000", 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6063999999999997e-05 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:00.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119259+0000", 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9750000000000007e-06 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118767 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.25874966999999999, 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.25887541400000003, 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118767 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119465+0000", 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2500000000000004e-07 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119472+0000", 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3330000000000002e-06 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119485+0000", 2024-09-11T06:19:00.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2782999999999999e-05 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9830000000000002e-06 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119548+0000", 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4274000000000002e-05 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:00.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118775 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.25843269600000002, 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.25859027600000001, 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:00.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118775 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:00.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119782+0000", 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4e-07 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119787+0000", 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119800+0000", 2024-09-11T06:19:00.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3728e-05 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119808+0000", 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.661e-06 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119865+0000", 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7345000000000001e-05 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:00.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119876+0000", 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0393e-05 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118783 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.25811420699999998, 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.25830276099999999, 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:00.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118783 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120101+0000", 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120105+0000", 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6269999999999999e-06 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120117+0000", 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1858999999999999e-05 2024-09-11T06:19:00.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120122+0000", 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9439999999999996e-06 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1106999999999998e-05 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120168+0000", 2024-09-11T06:19:00.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6870000000000002e-06 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.25782619600000001, 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.25804563800000002, 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:00.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:00.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:00.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 7 2024-09-11T06:19:00.473 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:00.544 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:00.544+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:00.588 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:00.588 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:00.588 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:00.588 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:00.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:00.645 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:00.644+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:00.738 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:00.739 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:00.746 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:00.745+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:00.747 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:00.847 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:00.846+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:00.850 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:00.850 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609236445999997, 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.851 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:19:00.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:19:00.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609223708000002, 2024-09-11T06:19:00.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:00.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:19:00.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609212575000001, 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:19:00.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.864 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609201987000006, 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.865 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:19:00.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609191491999994, 2024-09-11T06:19:00.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:19:00.873 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609181179000004, 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.874 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.878 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609170637000005, 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:00.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609160330999998, 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:19:00.883 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:19:00.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.887 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609144752999995, 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.888 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:19:00.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.892 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.609125747999997, 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:19:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549596374999993, 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:19:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549577904000003, 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:19:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549559414000001, 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:19:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549542345999996, 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:19:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549524314999999, 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549502130999997, 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:19:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549484139, 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:19:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:19:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549466484999996, 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549443569000005, 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:19:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 72.549425181000004, 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:19:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:00.942 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:00.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:00.947 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:00.946+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:01.047 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:01.047+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:01.058 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:01.059 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:01.059 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:01.059 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:01.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:01.153 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:01.152+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:01.233 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:01.234 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:01.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:01.285 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:01.284+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:01.349 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:01.349+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65211 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 290816~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.080554726000003, 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011362828, 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65211 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307757+0000", 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9299999999999999e-07 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307760+0000", 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0779999999999998e-06 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307768+0000", 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.307773+0000", 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.87e-06 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.317997+0000", 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010223922 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318245+0000", 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024794699999999999 2024-09-11T06:19:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.319120+0000", 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00087475300000000003 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65358 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 196608~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.069597223000002, 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01178332, 2024-09-11T06:19:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65358 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:19:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318715+0000", 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318717+0000", 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1739999999999999e-06 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318726+0000", 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2089999999999994e-06 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318731+0000", 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9690000000000002e-06 2024-09-11T06:19:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.329832+0000", 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011100376 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330093+0000", 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026168699999999998 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330498+0000", 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040453100000000002 2024-09-11T06:19:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65359 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.069572884999999, 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012518262, 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65359 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318739+0000", 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4200000000000001e-07 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318741+0000", 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0439999999999998e-06 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318750+0000", 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7239999999999998e-06 2024-09-11T06:19:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318755+0000", 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8080000000000004e-06 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330616+0000", 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011861349 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.330867+0000", 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025063199999999998 2024-09-11T06:19:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331257+0000", 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039026300000000001 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65360 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 266240~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.069550407999998, 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013368422, 2024-09-11T06:19:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65360 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:19:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318761+0000", 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318762+0000", 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0999999999999999e-07 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318764+0000", 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9080000000000002e-06 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318772+0000", 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1519999999999992e-06 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318783+0000", 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0956e-05 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331395+0000", 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012611938 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.331643+0000", 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000248244 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332130+0000", 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048681400000000002 2024-09-11T06:19:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65382 3.10 3:0bf53440:::rbd_data.116dccfba5d9.0000000000000049:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.069523128, 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013819148, 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65382 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:19:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318789+0000", 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318791+0000", 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9750000000000001e-06 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318799+0000", 2024-09-11T06:19:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5989999999999996e-06 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.318803+0000", 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5090000000000004e-06 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332201+0000", 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013397714 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332295+0000", 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4426999999999996e-05 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.332608+0000", 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031258700000000002 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65418 3.10 3:08e24215:::rbd_data.116dccfba5d9.000000000000001b:29 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:19:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.064992433999997, 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011186454, 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65418 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323319+0000", 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323320+0000", 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0900000000000001e-07 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323323+0000", 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.021e-06 2024-09-11T06:19:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323333+0000", 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0343000000000001e-05 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.323339+0000", 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1109999999999996e-06 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334123+0000", 2024-09-11T06:19:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010783789 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334216+0000", 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2458000000000001e-05 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.334506+0000", 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029012299999999999 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65455 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 159744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.063545273999999, 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010864807000000001, 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65455 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324767+0000", 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324769+0000", 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1160000000000002e-06 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324775+0000", 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7969999999999997e-06 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324779+0000", 2024-09-11T06:19:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9430000000000002e-06 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335383+0000", 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604001 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335467+0000", 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4214000000000004e-05 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335631+0000", 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164334 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65456 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.063527602000001, 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011134408, 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65456 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:19:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324784+0000", 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8599999999999999e-07 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324786+0000", 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.629e-06 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324791+0000", 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3299999999999998e-06 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324795+0000", 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8e-06 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335661+0000", 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010865718 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335745+0000", 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3776999999999994e-05 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335919+0000", 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017386800000000001 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:65457 3.10 3:0e45418a:::rbd_data.116dccfba5d9.0000000000000021:29 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.063511015000003, 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011510302, 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 65457 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324801+0000", 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324803+0000", 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7910000000000001e-06 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324808+0000", 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2979999999999999e-06 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.324812+0000", 2024-09-11T06:19:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9430000000000002e-06 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.335955+0000", 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011142987 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.336053+0000", 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7985000000000005e-05 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.336311+0000", 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025792799999999999 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106380 3.1c 3:3eaf6144:::rbd_data.116d419b7418.000000000000027b:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666900821999999, 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010923146999999999, 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106380 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:19:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721411+0000", 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721413+0000", 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8360000000000001e-06 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721419+0000", 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4269999999999999e-06 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721423+0000", 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.374e-06 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732252+0000", 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010829099999999999 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732334+0000", 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2008000000000005e-05 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106382 3.1c 3:3d8acb81:::rbd_data.116d419b7418.000000000000027d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666857093000001, 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010982667999999999, 2024-09-11T06:19:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106382 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721455+0000", 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9900000000000001e-07 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721458+0000", 2024-09-11T06:19:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.345e-06 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721464+0000", 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4679999999999997e-06 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721470+0000", 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0270000000000001e-06 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732362+0000", 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010892456999999999 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732437+0000", 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4871999999999997e-05 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106383 3.1c 3:3d5051d7:::rbd_data.116d419b7418.000000000000027e:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666834854000001, 2024-09-11T06:19:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011059616, 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106383 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:19:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721477+0000", 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7199999999999999e-07 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721482+0000", 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9960000000000001e-06 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721489+0000", 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721494+0000", 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1100000000000002e-06 2024-09-11T06:19:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732464+0000", 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010969845000000001 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732537+0000", 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3026000000000002e-05 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106426 3.1c 3:3b52f154:::rbd_data.116d419b7418.00000000000002b5:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666762521999999, 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011086477000000001, 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106426 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721549+0000", 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721550+0000", 2024-09-11T06:19:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000005e-07 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721551+0000", 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4759999999999999e-06 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721556+0000", 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9309999999999999e-06 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721560+0000", 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732563+0000", 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011003590000000001 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732636+0000", 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2311999999999995e-05 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106442 3.1c 3:3847cd45:::rbd_data.116d419b7418.00000000000002c5:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666713819000002, 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011139990000000001, 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106442 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:19:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721598+0000", 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721600+0000", 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721604+0000", 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8260000000000003e-06 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721606+0000", 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732662+0000", 2024-09-11T06:19:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011056112999999999 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732738+0000", 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5726e-05 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106464 3.1c 3:3dce2b45:::rbd_data.116d419b7418.00000000000002e1:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:19:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666690636999999, 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011200432999999999, 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106464 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:19:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721621+0000", 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1400000000000001e-07 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721622+0000", 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-07 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721626+0000", 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5880000000000002e-06 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721629+0000", 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3079999999999999e-06 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732765+0000", 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011135369000000001 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732822+0000", 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6974e-05 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106491 3.1c 3:3b1800f8:::rbd_data.116d419b7418.00000000000002fc:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666648307999999, 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011247679999999999, 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106491 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721663+0000", 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721664+0000", 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721677+0000", 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2967e-05 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721681+0000", 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9519999999999996e-06 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721683+0000", 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7779999999999999e-06 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732849+0000", 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011165542000000001 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732911+0000", 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2199999999999994e-05 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106493 3.1c 3:3f1dc0e6:::rbd_data.116d419b7418.00000000000002fe:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666617571, 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011331447, 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106493 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721694+0000", 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721695+0000", 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721696+0000", 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4360000000000001e-06 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721700+0000", 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7639999999999999e-06 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721702+0000", 2024-09-11T06:19:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6400000000000001e-06 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.732935+0000", 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011232328 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733026+0000", 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0859999999999994e-05 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106496 3.1c 3:3f844c73:::rbd_data.116d419b7418.0000000000000307:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666595846, 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011423630000000001, 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106496 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721716+0000", 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721717+0000", 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5199999999999995e-07 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721720+0000", 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1480000000000002e-06 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721723+0000", 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.39e-06 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733056+0000", 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011332844999999999 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733140+0000", 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3959e-05 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106536 3.1c 3:3b36f16b:::rbd_data.116d419b7418.0000000000000335:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666566994, 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011515332, 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106536 2024-09-11T06:19:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721745+0000", 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721746+0000", 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2200000000000002e-07 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721749+0000", 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.523e-06 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721752+0000", 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5770000000000001e-06 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733168+0000", 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011415483000000001 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733260+0000", 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2612e-05 2024-09-11T06:19:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:106560 3.1c 3:3f30db2e:::rbd_data.116d419b7418.000000000000034d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.666556903, 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011596255999999999, 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 106560 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:19:01.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721755+0000", 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2100000000000001e-07 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721756+0000", 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8400000000000002e-07 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721760+0000", 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7809999999999999e-06 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.721763+0000", 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.644e-06 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733290+0000", 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011527953000000001 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:33.733351+0000", 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0673e-05 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.477 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:01.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:01.479 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:01.478+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:01.579 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:01.579+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:01.623 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:01.623 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:01.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:01.680 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:01.679+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:01.735 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:01.735 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:01.735 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:01.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:01.786 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:01.785+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:01.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:01.881 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:01.881+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:01.891 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118743 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7713599250000001, 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99346091199999997, 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118743 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118559+0000", 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118568+0000", 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4279999999999996e-06 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118589+0000", 2024-09-11T06:19:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1129999999999999e-05 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118599+0000", 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8789999999999998e-06 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118670+0000", 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1087999999999994e-05 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118679+0000", 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.115e-06 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111727+0000", 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99304786499999997 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111848+0000", 2024-09-11T06:19:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121347 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112017+0000", 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016935499999999999 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118751 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7710585249999999, 2024-09-11T06:19:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99440886299999998, 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118751 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.85e-07 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118863+0000", 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2741999999999999e-05 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118884+0000", 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7109999999999995e-06 2024-09-11T06:19:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118951+0000", 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7347000000000004e-05 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118958+0000", 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0180000000000004e-06 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113102+0000", 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99414409999999998 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113179+0000", 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113267+0000", 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7745999999999996e-05 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118759 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.770750783, 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99428308499999996, 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118759 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119167+0000", 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119173+0000", 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0859999999999998e-06 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119187+0000", 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4133e-05 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119194+0000", 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-06 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119251+0000", 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6063999999999997e-05 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119259+0000", 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9750000000000007e-06 2024-09-11T06:19:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113295+0000", 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99403649000000005 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113370+0000", 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5266999999999996e-05 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113449+0000", 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8396e-05 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118767 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.770451907, 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99424699400000005, 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118767 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119465+0000", 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2500000000000004e-07 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119472+0000", 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3330000000000002e-06 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119485+0000", 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2782999999999999e-05 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9830000000000002e-06 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119548+0000", 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4274000000000002e-05 2024-09-11T06:19:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113477+0000", 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99392198799999998 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113607+0000", 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012957600000000001 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113711+0000", 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104832 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118775 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.770134933, 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99457822699999998, 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118775 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119782+0000", 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4e-07 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119787+0000", 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119800+0000", 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3728e-05 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119808+0000", 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.661e-06 2024-09-11T06:19:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119865+0000", 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7345000000000001e-05 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119876+0000", 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0393e-05 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114042+0000", 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99416629599999995 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114146+0000", 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104091 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114360+0000", 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000213544 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118783 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7698164439999999, 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99444126499999996, 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118783 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120101+0000", 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120105+0000", 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6269999999999999e-06 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120117+0000", 2024-09-11T06:19:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1858999999999999e-05 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120122+0000", 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9439999999999996e-06 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1106999999999998e-05 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120168+0000", 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6870000000000002e-06 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114344+0000", 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.994176328 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114440+0000", 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6028999999999998e-05 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114541+0000", 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100813 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7695284330000001, 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:19:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:19:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119571 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 13369344~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76227814800000004, 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018023052000000001, 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119571 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127639+0000", 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127641+0000", 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.514e-06 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127648+0000", 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5880000000000003e-06 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127652+0000", 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7500000000000003e-06 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145548+0000", 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017895155999999999 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145596+0000", 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8792999999999999e-05 2024-09-11T06:19:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145661+0000", 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4869000000000005e-05 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119572 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 14286848~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76225750599999997, 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018157623000000001, 2024-09-11T06:19:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119572 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127661+0000", 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127669+0000", 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6380000000000004e-06 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127673+0000", 2024-09-11T06:19:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7620000000000003e-06 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145694+0000", 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018020806 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145758+0000", 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3770999999999996e-05 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145816+0000", 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8476000000000001e-05 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119573 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 15204352~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76221841599999995, 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018351035000000002, 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119573 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127699+0000", 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-07 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127718+0000", 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9667999999999999e-05 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127727+0000", 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6999999999999997e-06 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127733+0000", 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145846+0000", 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018113073 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145959+0000", 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011347 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146049+0000", 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9926000000000006e-05 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119574 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76217650699999995, 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018368603000000001, 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119574 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:19:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127742+0000", 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8109999999999999e-06 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127749+0000", 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5749999999999997e-06 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127764+0000", 2024-09-11T06:19:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5361000000000001e-05 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146094+0000", 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01833015 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146108+0000", 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4265e-05 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119575 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76214442000000004, 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018387018000000001, 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119575 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6899999999999998e-07 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127775+0000", 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1110000000000002e-06 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127781+0000", 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4969999999999998e-06 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127786+0000", 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146148+0000", 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018362195000000001 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146159+0000", 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0903e-05 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119576 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76212364700000002, 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018419563, 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119576 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127795+0000", 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127802+0000", 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.489e-06 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127806+0000", 2024-09-11T06:19:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7430000000000002e-06 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146199+0000", 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018393093999999999 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146212+0000", 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2812e-05 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119577 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76210345099999999, 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018434368, 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119577 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127837+0000", 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3349999999999998e-05 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127844+0000", 2024-09-11T06:19:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2080000000000003e-06 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127849+0000", 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146235+0000", 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018386120999999998 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146247+0000", 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119578 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76206014899999996, 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018438821000000001, 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119578 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127857+0000", 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127859+0000", 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127865+0000", 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127870+0000", 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8879999999999996e-06 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146285+0000", 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018414950999999999 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146295+0000", 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7650000000000005e-06 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119579 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.76203957300000003, 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018456706999999999, 2024-09-11T06:19:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119579 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127879+0000", 2024-09-11T06:19:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8640000000000001e-06 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127886+0000", 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127891+0000", 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0080000000000002e-06 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146323+0000", 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018431811999999999 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146334+0000", 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0814e-05 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119721 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.75953833800000004, 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018040231, 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119721 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130397+0000", 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8663000000000001e-05 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130406+0000", 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9619999999999999e-06 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130412+0000", 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4210000000000003e-06 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148411+0000", 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017999004999999998 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148418+0000", 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7519999999999996e-06 2024-09-11T06:19:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119722 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.75948607899999998, 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018031229999999999, 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119722 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130431+0000", 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1800000000000005e-07 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130434+0000", 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4450000000000001e-06 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130442+0000", 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130448+0000", 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4519999999999996e-06 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148451+0000", 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01800295 2024-09-11T06:19:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148462+0000", 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0828e-05 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119723 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.75946033899999998, 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018050743000000001, 2024-09-11T06:19:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119723 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130457+0000", 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000001e-07 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130459+0000", 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0549999999999998e-06 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130466+0000", 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130477+0000", 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878999999999999e-05 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148496+0000", 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018784999999999 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148507+0000", 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0550000000000001e-05 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119724 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.759430736, 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038285000000001, 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119724 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:01.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5699999999999998e-07 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130488+0000", 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3709999999999998e-06 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130495+0000", 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9260000000000003e-06 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:01.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130500+0000", 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9400000000000001e-06 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148519+0000", 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018688000000001 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148524+0000", 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:19:01.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:01.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:01.987 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:01.988 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:01.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:01.989 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:01.989 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:01.990 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:01.990 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:01.987+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:02.000 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:02.000 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:02.015 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:02.015 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:02.033 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:02.033 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:02.050 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:02.051 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:02.068 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:02.068 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:02.106 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:02.106 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:02.106 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:02.105+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:02.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:02.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:19:02.201 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:02.200+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:02.271 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:02.271 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:02.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:02.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:02.290+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:02.299 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-11T06:19:02.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:02.391+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:02.416 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:02.416 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:02.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:02.493 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:02.492+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:02.519 INFO:teuthology.orchestra.run.smithi070.stdout:4257 read 0x3382b6f thru 0x338e43e (0xb8d0 bytes) 2024-09-11T06:19:02.520 INFO:teuthology.orchestra.run.smithi070.stdout:4259 read 0x9c6bb21 thru 0x9c76cc4 (0xb1a4 bytes) 2024-09-11T06:19:02.533 INFO:teuthology.orchestra.run.smithi070.stdout:4260 trunc from 0xc3dd682 to 0x1512f06 2024-09-11T06:19:02.534 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:02.534 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:02.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:02.547 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:02.547 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:02.547 INFO:teuthology.orchestra.run.smithi070.stdout:4267 punch from 0x51420 to 0x54fd4, (0x3bb4 bytes) 2024-09-11T06:19:02.555 INFO:teuthology.orchestra.run.smithi070.stdout:4268 write 0x2eecf60 thru 0x2efa1ce (0xd26f bytes) 2024-09-11T06:19:02.557 INFO:teuthology.orchestra.run.smithi070.stdout:4269 read 0x205f9eb thru 0x2065ed8 (0x64ee bytes) 2024-09-11T06:19:02.557 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:02.575 INFO:teuthology.orchestra.run.smithi070.stdout:4273 write 0xc2061d8 thru 0xc2144e8 (0xe311 bytes) 2024-09-11T06:19:02.576 INFO:teuthology.orchestra.run.smithi070.stdout:4274 write 0x5bb9c11 thru 0x5bc1943 (0x7d33 bytes) 2024-09-11T06:19:02.578 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:02.578 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:02.578 INFO:teuthology.orchestra.run.smithi070.stdout:4278 write 0x2a83d4 thru 0x2a96e0 (0x130d bytes) 2024-09-11T06:19:02.579 INFO:teuthology.orchestra.run.smithi070.stdout:4279 clone 30 order 20 su 4096 sc 2 2024-09-11T06:19:02.594 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:02.593+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:02.653 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:02.653 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:02.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:02.695 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:02.694+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:02.796 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:02.795+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:02.805 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:02.805 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:02.814 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:02.896 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:02.895+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:02.930 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:02.930 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:02.940 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:03.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:03.024+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:03.084 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:03.084 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:03.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:03.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:03.133+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:03.167 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:19:03.199 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:03.198+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:03.240 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:03.240 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:03.249 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:03.334 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:03.333+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:03.392 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:03.393 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:03.400 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:03.400+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:03.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:03.501 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:03.501+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:03.544 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:03.545 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:03.553 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:03.637 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:03.636+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:03.696 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:03.696 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:03.703 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:03.703+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:03.705 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:03.805 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:03.804+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:03.847 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:03.847 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:03.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:03.906 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:03.905+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:03.959 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:03.959 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:03.967 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:04.007 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:04.006+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:04.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:04.111 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:04.111 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:04.120 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:04.125 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:04.124+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:04.209 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:04.208+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:04.230 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:04.230 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:04.253 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:04.253 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:04.268 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:04.268 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:04.274 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:04.274 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:04.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:04.294 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:04.294 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:04.313 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:04.313 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:04.319 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:04.318+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:04.333 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:04.333 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:04.353 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:04.353 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:04.372 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:04.372 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:04.430 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:04.429+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:04.473 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:04.473 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:04.473 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:04.473 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:04.474 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:04.485 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:04.511 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:04.511+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:04.612 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:04.611+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:04.635 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:04.635 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:04.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:04.635 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:04.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.635 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393473939000003, 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.636 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:19:04.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393461200999994, 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:19:04.640 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:19:04.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393450068000007, 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.645 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:19:04.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393439479999998, 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:19:04.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393428985, 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.654 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:19:04.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393418671999996, 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:19:04.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:19:04.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:19:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:19:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:19:04.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:19:04.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:19:04.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:19:04.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393408129999997, 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.665 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:19:04.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393397824000004, 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.670 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:19:04.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393382246000002, 2024-09-11T06:19:04.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:04.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.679 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.393363241000003, 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.680 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:19:04.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333833867999999, 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:19:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333815396999995, 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:19:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:19:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333796906999993, 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:19:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:19:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333779839000002, 2024-09-11T06:19:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333761808000006, 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:19:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333739624000003, 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:19:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333721632000007, 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:19:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:19:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:19:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333703978000003, 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:19:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333681061999997, 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:19:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:19:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 76.333662673999996, 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:19:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:04.732 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:04.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:04.734 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:04.733+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:04.834 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:04.834+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:04.891 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129241 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868101+0000", 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016216834999999999, 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016234264000000002, 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129241 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868101+0000", 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868101+0000", 2024-09-11T06:19:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868101+0000", 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0400000000000002e-07 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868103+0000", 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1490000000000001e-06 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868111+0000", 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868116+0000", 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9760000000000003e-06 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129306 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.869940+0000", 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014377391, 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014430241, 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129306 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869940+0000", 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869940+0000", 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869941+0000", 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869943+0000", 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3410000000000001e-06 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869950+0000", 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4109999999999999e-06 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869956+0000", 2024-09-11T06:19:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8980000000000001e-06 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129389 3.1c 3.976bd6fc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.883204+0000", 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001114077, 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001195315, 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129389 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.883204+0000", 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.883204+0000", 2024-09-11T06:19:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.883205+0000", 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8100000000000001e-07 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.883210+0000", 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2129999999999999e-06 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.883220+0000", 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.061e-05 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.883228+0000", 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1169999999999998e-06 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129242 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868123+0000", 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016195112000000001, 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016306161999999999, 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129242 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868123+0000", 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868123+0000", 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868123+0000", 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3099999999999998e-07 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868125+0000", 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4540000000000001e-06 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868132+0000", 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1e-06 2024-09-11T06:19:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868135+0000", 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3969999999999998e-06 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129307 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.869965+0000", 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014353154, 2024-09-11T06:19:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014511240999999999, 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129307 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869965+0000", 2024-09-11T06:19:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869965+0000", 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869965+0000", 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869967+0000", 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1399999999999998e-06 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869976+0000", 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3279999999999995e-06 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869982+0000", 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2889999999999997e-06 2024-09-11T06:19:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129243 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868143+0000", 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016174908000000002, 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016362697999999998, 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129243 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868143+0000", 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868143+0000", 2024-09-11T06:19:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868143+0000", 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.08e-07 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868145+0000", 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1770000000000001e-06 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868153+0000", 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1709999999999996e-06 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868157+0000", 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7729999999999999e-06 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129308 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870003+0000", 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014314881, 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0145314, 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129308 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870003+0000", 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870003+0000", 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870004+0000", 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-11T06:19:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870007+0000", 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9489999999999998e-06 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870018+0000", 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0351e-05 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870025+0000", 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2590000000000003e-06 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129182 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8491008~4096 [fadvise_nocache] out=4096b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867064+0000", 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017253269000000002, 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017503972, 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129182 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867064+0000", 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867064+0000", 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867065+0000", 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000002e-07 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867067+0000", 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.885e-06 2024-09-11T06:19:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867072+0000", 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7150000000000003e-06 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867079+0000", 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3430000000000001e-06 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884461+0000", 2024-09-11T06:19:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017382523 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884508+0000", 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6387000000000002e-05 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884568+0000", 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0733999999999998e-05 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129244 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868164+0000", 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016153842000000002, 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016464482999999999, 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129244 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868164+0000", 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868164+0000", 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868164+0000", 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868166+0000", 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4580000000000001e-06 2024-09-11T06:19:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868171+0000", 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.967e-06 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868173+0000", 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129309 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870036+0000", 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014281194000000001, 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014622464, 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129309 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870036+0000", 2024-09-11T06:19:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870036+0000", 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870037+0000", 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870040+0000", 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6510000000000001e-06 2024-09-11T06:19:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870047+0000", 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9709999999999998e-06 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870052+0000", 2024-09-11T06:19:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4079999999999997e-06 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129183 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8499200~4096 [fadvise_nocache] out=4096b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867085+0000", 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017232260999999999, 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017605841000000001, 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129183 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867085+0000", 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867085+0000", 2024-09-11T06:19:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867086+0000", 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867088+0000", 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.063e-06 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867096+0000", 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6590000000000007e-06 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867100+0000", 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.977e-06 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884585+0000", 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017484042000000002 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884631+0000", 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6832999999999997e-05 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884696+0000", 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4268000000000002e-05 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129245 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868178+0000", 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016139259, 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016566649999999999, 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129245 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868178+0000", 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868178+0000", 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868179+0000", 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868193+0000", 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4045e-05 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868203+0000", 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.893e-06 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868208+0000", 2024-09-11T06:19:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-06 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129310 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870060+0000", 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014257763999999999, 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014712871000000001, 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129310 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870060+0000", 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870060+0000", 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870060+0000", 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.15e-07 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870062+0000", 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1519999999999999e-06 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870069+0000", 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1380000000000004e-06 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870073+0000", 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5850000000000001e-06 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129184 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8507392~4096 [fadvise_nocache] out=4096b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867107+0000", 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017210932000000002, 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017697088, 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129184 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867107+0000", 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867107+0000", 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867107+0000", 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:19:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867109+0000", 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2529999999999999e-06 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867116+0000", 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9670000000000004e-06 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867122+0000", 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2619999999999998e-06 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884709+0000", 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017587419999999999 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884755+0000", 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5757999999999998e-05 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129246 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868224+0000", 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016093675000000002, 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016629042, 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129246 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868224+0000", 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868224+0000", 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868224+0000", 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868226+0000", 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.761e-06 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868236+0000", 2024-09-11T06:19:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9599999999999995e-06 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868282+0000", 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6406999999999998e-05 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129311 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870080+0000", 2024-09-11T06:19:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014238149, 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014804421, 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129311 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870080+0000", 2024-09-11T06:19:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870080+0000", 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870080+0000", 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870082+0000", 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1160000000000002e-06 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870088+0000", 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8930000000000002e-06 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870093+0000", 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129185 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8515584~4096 [fadvise_nocache] out=4096b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867128+0000", 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017189817, 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017794432999999998, 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129185 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867128+0000", 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867128+0000", 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867128+0000", 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867130+0000", 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.889e-06 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867136+0000", 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4010000000000002e-06 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867141+0000", 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7360000000000001e-06 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884837+0000", 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017695747000000001 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884885+0000", 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8319000000000003e-05 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129247 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868308+0000", 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016009644, 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016647757999999999, 2024-09-11T06:19:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129247 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868308+0000", 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868308+0000", 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868309+0000", 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0999999999999998e-07 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868312+0000", 2024-09-11T06:19:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9790000000000002e-06 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868335+0000", 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3357999999999999e-05 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868341+0000", 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6579999999999999e-06 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129312 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870100+0000", 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014217877, 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014901776, 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129312 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870100+0000", 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870100+0000", 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870100+0000", 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4000000000000002e-07 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870106+0000", 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9089999999999997e-06 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870113+0000", 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5740000000000001e-06 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870117+0000", 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7539999999999997e-06 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129248 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868350+0000", 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015967535000000001, 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016680555, 2024-09-11T06:19:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129248 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868350+0000", 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868350+0000", 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868351+0000", 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3000000000000001e-07 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868354+0000", 2024-09-11T06:19:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1970000000000001e-06 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868374+0000", 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0208999999999999e-05 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868380+0000", 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.981e-06 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129313 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870125+0000", 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014192276, 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014932367, 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129313 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870125+0000", 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870125+0000", 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870126+0000", 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870128+0000", 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.086e-06 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870134+0000", 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-11T06:19:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870139+0000", 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129186 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8523776~4096 [fadvise_nocache] out=4096b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867147+0000", 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017170682, 2024-09-11T06:19:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017940042999999999, 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129186 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867147+0000", 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867147+0000", 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867147+0000", 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867149+0000", 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.888e-06 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867155+0000", 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7119999999999997e-06 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867159+0000", 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5000000000000001e-06 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.884976+0000", 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017816176 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.885023+0000", 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7175000000000001e-05 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.885094+0000", 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1097e-05 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129249 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868389+0000", 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015928245000000001, 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016751064, 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129249 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868389+0000", 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868389+0000", 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868390+0000", 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868393+0000", 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7599999999999998e-06 2024-09-11T06:19:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868400+0000", 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868412+0000", 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2079000000000001e-05 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129314 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870252+0000", 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.01406518, 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014916321, 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129314 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870252+0000", 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870252+0000", 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870253+0000", 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6599999999999996e-07 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870256+0000", 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4120000000000001e-06 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870264+0000", 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8290000000000008e-06 2024-09-11T06:19:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870309+0000", 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4709000000000002e-05 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129187 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8531968~4096 [fadvise_nocache] out=4096b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867166+0000", 2024-09-11T06:19:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017152151000000001, 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018034237000000002, 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129187 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867166+0000", 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867166+0000", 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867166+0000", 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867168+0000", 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0959999999999999e-06 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867177+0000", 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9120000000000004e-06 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867180+0000", 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.818e-06 2024-09-11T06:19:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.885109+0000", 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017929706 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.885156+0000", 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6836999999999999e-05 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129250 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868420+0000", 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015897275999999998, 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016826898999999999, 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129250 2024-09-11T06:19:04.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868420+0000", 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868420+0000", 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868421+0000", 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.51e-07 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868423+0000", 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3769999999999999e-06 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868430+0000", 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.737e-06 2024-09-11T06:19:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868435+0000", 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2229999999999998e-06 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129315 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870321+0000", 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013996612, 2024-09-11T06:19:04.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014959714000000001, 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129315 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870321+0000", 2024-09-11T06:19:04.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870321+0000", 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870322+0000", 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9200000000000001e-07 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870325+0000", 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.416e-06 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870331+0000", 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8590000000000001e-06 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870334+0000", 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4929999999999998e-06 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.994 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129188 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8540160~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867185+0000", 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017132992, 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018126613999999999, 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:04.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129188 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867185+0000", 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867185+0000", 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867185+0000", 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867187+0000", 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8929999999999999e-06 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867192+0000", 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5910000000000003e-06 2024-09-11T06:19:04.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867197+0000", 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.885236+0000", 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038615000000001 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:04.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.885286+0000", 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0346000000000002e-05 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129251 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868442+0000", 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015875752, 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016901830999999999, 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:04.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129251 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868442+0000", 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868442+0000", 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868442+0000", 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868444+0000", 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868451+0000", 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.212e-06 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868465+0000", 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4823e-05 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.002 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129316 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870339+0000", 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013978355, 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015044963, 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129316 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870339+0000", 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870339+0000", 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870340+0000", 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6e-07 2024-09-11T06:19:05.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870341+0000", 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.342e-06 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870344+0000", 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.478e-06 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870347+0000", 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4930000000000001e-06 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129189 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8548352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867203+0000", 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017114615, 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018214867999999999, 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:05.006 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129189 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867203+0000", 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867203+0000", 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867203+0000", 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867205+0000", 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0379999999999998e-06 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867211+0000", 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9920000000000004e-06 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867218+0000", 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2110000000000003e-06 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.885372+0000", 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018153860000000001 2024-09-11T06:19:05.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129252 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868474+0000", 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015843589000000002, 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016974589000000002, 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129252 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868474+0000", 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868474+0000", 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868475+0000", 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7599999999999997e-07 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868477+0000", 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7070000000000001e-06 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868486+0000", 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4060000000000005e-06 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868491+0000", 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9239999999999998e-06 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129317 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870350+0000", 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013967485, 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015156444, 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129317 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870350+0000", 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870350+0000", 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870350+0000", 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-07 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870352+0000", 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.176e-06 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870355+0000", 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2440000000000002e-06 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870357+0000", 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.396e-06 2024-09-11T06:19:05.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129190 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 8556544~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867225+0000", 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017093133999999999, 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018330947, 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129190 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867225+0000", 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867225+0000", 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867225+0000", 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867227+0000", 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0509999999999999e-06 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867233+0000", 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.28e-06 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867238+0000", 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7790000000000003e-06 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.885524+0000", 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018285523000000001 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129253 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868732+0000", 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015586037000000001, 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016858313, 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129253 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868732+0000", 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868732+0000", 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868732+0000", 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868735+0000", 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.79e-06 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868742+0000", 2024-09-11T06:19:05.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1230000000000002e-06 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868746+0000", 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3069999999999996e-06 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129318 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870360+0000", 2024-09-11T06:19:05.024 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013957198000000001, 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015257635, 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129318 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870360+0000", 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870360+0000", 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870361+0000", 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870362+0000", 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.192e-06 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870365+0000", 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1149999999999998e-06 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870367+0000", 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.464e-06 2024-09-11T06:19:05.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129191 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867244+0000", 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017073774999999999, 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018403755000000001, 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129191 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867244+0000", 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867244+0000", 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867244+0000", 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0499999999999999e-07 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867246+0000", 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.996e-06 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867254+0000", 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3819999999999998e-06 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867258+0000", 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4580000000000003e-06 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129254 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868753+0000", 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015565048, 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016938928999999998, 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129254 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868753+0000", 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868753+0000", 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868753+0000", 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4400000000000001e-07 2024-09-11T06:19:05.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868754+0000", 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.336e-06 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868758+0000", 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6239999999999999e-06 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868765+0000", 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.148e-06 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129319 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870371+0000", 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013946984000000001, 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015351347, 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129319 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870371+0000", 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870371+0000", 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870371+0000", 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870372+0000", 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0589999999999999e-06 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870375+0000", 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.027e-06 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870378+0000", 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5890000000000001e-06 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129192 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867266+0000", 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017051795000000002, 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018483413000000001, 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129192 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867266+0000", 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867266+0000", 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867266+0000", 2024-09-11T06:19:05.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867268+0000", 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1730000000000002e-06 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867275+0000", 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2049999999999999e-06 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867280+0000", 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1080000000000001e-06 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129255 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868769+0000", 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015548709000000001, 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017007587000000001, 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129255 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868769+0000", 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868769+0000", 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868769+0000", 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.29e-07 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868771+0000", 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.353e-06 2024-09-11T06:19:05.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868774+0000", 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.495e-06 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868777+0000", 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6900000000000001e-06 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129320 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870382+0000", 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013935805000000001, 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015435809999999999, 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129320 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.046 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870382+0000", 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870382+0000", 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870382+0000", 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.11e-07 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870383+0000", 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.046e-06 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870387+0000", 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5700000000000001e-06 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870389+0000", 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.649e-06 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129193 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867286+0000", 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.017031896000000001, 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018564707, 2024-09-11T06:19:05.049 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129193 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867286+0000", 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867286+0000", 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867286+0000", 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867293+0000", 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8040000000000004e-06 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867299+0000", 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.088e-06 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867303+0000", 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129256 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868780+0000", 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015537551, 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017100595999999999, 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129256 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868780+0000", 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868780+0000", 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868780+0000", 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2999999999999999e-07 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868781+0000", 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.125e-06 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868785+0000", 2024-09-11T06:19:05.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.208e-06 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868787+0000", 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5620000000000002e-06 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129321 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870394+0000", 2024-09-11T06:19:05.056 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013923777, 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015519392999999999, 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129321 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870394+0000", 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870394+0000", 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870394+0000", 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870396+0000", 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.866e-06 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870401+0000", 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3759999999999999e-06 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870406+0000", 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5770000000000004e-06 2024-09-11T06:19:05.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129194 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867326+0000", 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016991849, 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018619196000000001, 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129194 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867326+0000", 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867326+0000", 2024-09-11T06:19:05.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867326+0000", 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3500000000000002e-07 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867329+0000", 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867335+0000", 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2580000000000001e-06 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867338+0000", 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.208e-06 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129257 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.063 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868790+0000", 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015527192, 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017197665000000001, 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129257 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868790+0000", 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868790+0000", 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868791+0000", 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.04e-07 2024-09-11T06:19:05.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868795+0000", 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2599999999999999e-06 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868799+0000", 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4109999999999998e-06 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868802+0000", 2024-09-11T06:19:05.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1089999999999998e-06 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129322 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870412+0000", 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013905288, 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015606761, 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129322 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870412+0000", 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870412+0000", 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870413+0000", 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3300000000000003e-07 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870415+0000", 2024-09-11T06:19:05.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1959999999999998e-06 2024-09-11T06:19:05.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870433+0000", 2024-09-11T06:19:05.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.842e-05 2024-09-11T06:19:05.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870439+0000", 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3249999999999998e-06 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129195 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867343+0000", 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016975086, 2024-09-11T06:19:05.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018703853999999999, 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129195 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867343+0000", 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867343+0000", 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867343+0000", 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000002e-07 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867344+0000", 2024-09-11T06:19:05.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-06 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867348+0000", 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2989999999999998e-06 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867351+0000", 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8380000000000002e-06 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.076 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129258 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868806+0000", 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015511607, 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017269120999999998, 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129258 2024-09-11T06:19:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868806+0000", 2024-09-11T06:19:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868806+0000", 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868806+0000", 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868808+0000", 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.325e-06 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868811+0000", 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.05e-06 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868813+0000", 2024-09-11T06:19:05.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5339999999999998e-06 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129323 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870446+0000", 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013871204999999999, 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015674021, 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129323 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870446+0000", 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870446+0000", 2024-09-11T06:19:05.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870447+0000", 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2500000000000001e-07 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870449+0000", 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3929999999999998e-06 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870457+0000", 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3289999999999996e-06 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870462+0000", 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129196 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867356+0000", 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016962013000000001, 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018795579999999999, 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129196 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867356+0000", 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867356+0000", 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867356+0000", 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867358+0000", 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.888e-06 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867363+0000", 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867368+0000", 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2760000000000002e-06 2024-09-11T06:19:05.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129259 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868817+0000", 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.01550035, 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017361087000000001, 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129259 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868817+0000", 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868817+0000", 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868818+0000", 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868819+0000", 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.156e-06 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868822+0000", 2024-09-11T06:19:05.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1520000000000001e-06 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868824+0000", 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5639999999999999e-06 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129324 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870468+0000", 2024-09-11T06:19:05.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013849200000000001, 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015738628000000001, 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129324 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870468+0000", 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870468+0000", 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870469+0000", 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1399999999999997e-07 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870477+0000", 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6850000000000001e-06 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870485+0000", 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1720000000000007e-06 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870490+0000", 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3469999999999998e-06 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.094 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129197 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867373+0000", 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016945077999999999, 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018877602, 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.095 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129197 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867373+0000", 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867373+0000", 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867373+0000", 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867374+0000", 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3239999999999999e-06 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867378+0000", 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.388e-06 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867380+0000", 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5569999999999998e-06 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129260 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868828+0000", 2024-09-11T06:19:05.098 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.01549011, 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017450297, 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129260 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868828+0000", 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868828+0000", 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868828+0000", 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-07 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868829+0000", 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0300000000000001e-06 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868833+0000", 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8279999999999996e-06 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868835+0000", 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7149999999999998e-06 2024-09-11T06:19:05.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129325 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870498+0000", 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013820107, 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015811769999999999, 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129325 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870498+0000", 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870498+0000", 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870498+0000", 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0499999999999999e-07 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870500+0000", 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870508+0000", 2024-09-11T06:19:05.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8180000000000004e-06 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870512+0000", 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129198 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867383+0000", 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016934307999999999, 2024-09-11T06:19:05.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018954009000000001, 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129198 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867383+0000", 2024-09-11T06:19:05.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867383+0000", 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867384+0000", 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867385+0000", 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0809999999999999e-06 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867388+0000", 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0750000000000002e-06 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867392+0000", 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9750000000000001e-06 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.108 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129261 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868838+0000", 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015479263, 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017550466000000001, 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129261 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868838+0000", 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868838+0000", 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868839+0000", 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-07 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868840+0000", 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.147e-06 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868843+0000", 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.044e-06 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868845+0000", 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5749999999999999e-06 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129199 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867399+0000", 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016918807000000001, 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019018040999999999, 2024-09-11T06:19:05.112 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129199 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867399+0000", 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867399+0000", 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867399+0000", 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867401+0000", 2024-09-11T06:19:05.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0040000000000002e-06 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867409+0000", 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867413+0000", 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129262 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868849+0000", 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.01546842, 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01759604, 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129262 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.116 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868849+0000", 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868849+0000", 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868849+0000", 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868851+0000", 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0699999999999999e-06 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868854+0000", 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1499999999999999e-06 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868856+0000", 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.819e-06 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129326 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870517+0000", 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013800801999999999, 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015955429, 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129326 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870517+0000", 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870517+0000", 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870517+0000", 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870519+0000", 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.403e-06 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870522+0000", 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3469999999999999e-06 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870525+0000", 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.672e-06 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129200 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867420+0000", 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016897391000000001, 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019096676, 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129200 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867420+0000", 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867420+0000", 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867421+0000", 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T06:19:05.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867423+0000", 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1600000000000001e-06 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867430+0000", 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867435+0000", 2024-09-11T06:19:05.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4599999999999996e-06 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129263 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868860+0000", 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015458082999999999, 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017685262, 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129263 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868860+0000", 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868860+0000", 2024-09-11T06:19:05.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868860+0000", 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868861+0000", 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.068e-06 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868864+0000", 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0359999999999998e-06 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868866+0000", 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4719999999999998e-06 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129327 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.129 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870528+0000", 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013790096999999999, 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016047470000000001, 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129327 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870528+0000", 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870528+0000", 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870528+0000", 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2399999999999999e-07 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870529+0000", 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1599999999999999e-06 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870540+0000", 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0774000000000001e-05 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870542+0000", 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7489999999999999e-06 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129201 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867441+0000", 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016876636, 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019162479999999999, 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129201 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867441+0000", 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867441+0000", 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867441+0000", 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3599999999999999e-07 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867443+0000", 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9929999999999998e-06 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867456+0000", 2024-09-11T06:19:05.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2421e-05 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867461+0000", 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4070000000000001e-06 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129264 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868869+0000", 2024-09-11T06:19:05.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015448231, 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017789103000000001, 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129264 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868869+0000", 2024-09-11T06:19:05.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868869+0000", 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868870+0000", 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9999999999999999e-07 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868871+0000", 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.049e-06 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868874+0000", 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0180000000000002e-06 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868877+0000", 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0230000000000001e-06 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.139 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129328 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870547+0000", 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013771049, 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016139902000000001, 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129328 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870547+0000", 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870547+0000", 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870547+0000", 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.35e-07 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870548+0000", 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2550000000000001e-06 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870551+0000", 2024-09-11T06:19:05.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0489999999999999e-06 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870554+0000", 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4820000000000001e-06 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129265 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868880+0000", 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015437688, 2024-09-11T06:19:05.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017833841999999999, 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129265 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868880+0000", 2024-09-11T06:19:05.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868880+0000", 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868880+0000", 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868881+0000", 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868884+0000", 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9909999999999998e-06 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868887+0000", 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129329 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870564+0000", 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013753797999999999, 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016177318, 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129329 2024-09-11T06:19:05.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870564+0000", 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870564+0000", 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870564+0000", 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1400000000000001e-07 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870565+0000", 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.192e-06 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870573+0000", 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8820000000000001e-06 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870576+0000", 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6680000000000001e-06 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129234 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867895+0000", 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016422204999999999, 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018887907999999998, 2024-09-11T06:19:05.150 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129234 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867895+0000", 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867895+0000", 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867903+0000", 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3529999999999997e-06 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867907+0000", 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867917+0000", 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867924+0000", 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830000000000001e-06 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129289 3.1c 3.547f2f9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868891+0000", 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015426812, 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017920939, 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129289 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868891+0000", 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868891+0000", 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868891+0000", 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869117+0000", 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022570700000000001 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869127+0000", 2024-09-11T06:19:05.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0565e-05 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869133+0000", 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0789999999999997e-06 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129330 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870580+0000", 2024-09-11T06:19:05.157 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013737811000000001, 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016259085999999999, 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129330 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870580+0000", 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870580+0000", 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870580+0000", 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870581+0000", 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.221e-06 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870585+0000", 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2270000000000002e-06 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870587+0000", 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-11T06:19:05.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129235 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867935+0000", 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016382306999999999, 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018930716, 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129235 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867935+0000", 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867935+0000", 2024-09-11T06:19:05.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867936+0000", 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867938+0000", 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.419e-06 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867944+0000", 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2380000000000002e-06 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867949+0000", 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7910000000000004e-06 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129301 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.869145+0000", 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.015173147999999999, 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017749346999999999, 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129301 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869145+0000", 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869145+0000", 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869145+0000", 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1500000000000004e-07 2024-09-11T06:19:05.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869148+0000", 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4899999999999999e-06 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869154+0000", 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7039999999999997e-06 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869159+0000", 2024-09-11T06:19:05.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129331 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870590+0000", 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013727461999999999, 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016352802999999999, 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129331 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870590+0000", 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870590+0000", 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870590+0000", 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0699999999999999e-07 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870592+0000", 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1069999999999999e-06 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870595+0000", 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5990000000000002e-06 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870598+0000", 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129236 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867969+0000", 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016348466999999998, 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019004624000000001, 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129236 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867969+0000", 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867969+0000", 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867970+0000", 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:05.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867971+0000", 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.858e-06 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867976+0000", 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8280000000000002e-06 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867979+0000", 2024-09-11T06:19:05.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1650000000000002e-06 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129332 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870601+0000", 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013716875, 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016400391, 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129332 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870601+0000", 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870601+0000", 2024-09-11T06:19:05.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870601+0000", 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.05e-07 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870602+0000", 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870605+0000", 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0139999999999999e-06 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870608+0000", 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.571e-06 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129237 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867983+0000", 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016334292, 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019044537, 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129237 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867983+0000", 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867983+0000", 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867984+0000", 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0599999999999999e-07 2024-09-11T06:19:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867985+0000", 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4920000000000001e-06 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867988+0000", 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2389999999999998e-06 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867991+0000", 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.813e-06 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129302 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.869831+0000", 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014486667999999999, 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017228796000000001, 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129302 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869831+0000", 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869831+0000", 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869832+0000", 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869836+0000", 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2899999999999996e-06 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869849+0000", 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2996999999999999e-05 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869857+0000", 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7789999999999996e-06 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.185 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129370 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.870618+0000", 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.013699371, 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016492150000000001, 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129370 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870618+0000", 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870618+0000", 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870619+0000", 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6e-07 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870620+0000", 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.429e-06 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870624+0000", 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8569999999999997e-06 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.870627+0000", 2024-09-11T06:19:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6630000000000002e-06 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129238 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.867995+0000", 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016322983999999999, 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019166814000000001, 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129238 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867995+0000", 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867995+0000", 2024-09-11T06:19:05.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867995+0000", 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867996+0000", 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.127e-06 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.867999+0000", 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1080000000000001e-06 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868002+0000", 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6390000000000001e-06 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129303 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.869869+0000", 2024-09-11T06:19:05.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014448908999999999, 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017340127, 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129303 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869869+0000", 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869869+0000", 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869869+0000", 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6699999999999999e-07 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869872+0000", 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4830000000000002e-06 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869878+0000", 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4659999999999996e-06 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869883+0000", 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.994e-06 2024-09-11T06:19:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129379 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.873484+0000", 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010834099999999999, 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013768308, 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129379 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.873484+0000", 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.873484+0000", 2024-09-11T06:19:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.873484+0000", 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.54e-07 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.873489+0000", 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.216e-06 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.873499+0000", 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0472000000000001e-05 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.873504+0000", 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.254e-06 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129239 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868006+0000", 2024-09-11T06:19:05.199 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016311926000000001, 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019290381999999998, 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129239 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868006+0000", 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868006+0000", 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868006+0000", 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-07 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868008+0000", 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6610000000000001e-06 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868048+0000", 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0515000000000001e-05 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868064+0000", 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5823000000000001e-05 2024-09-11T06:19:05.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129304 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.869889+0000", 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014428203000000001, 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017458788999999999, 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129304 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869889+0000", 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869889+0000", 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869890+0000", 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869893+0000", 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7700000000000002e-06 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869906+0000", 2024-09-11T06:19:05.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.367e-05 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869911+0000", 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1479999999999997e-06 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129386 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.874132+0000", 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.01018574, 2024-09-11T06:19:05.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013260121, 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129386 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.874132+0000", 2024-09-11T06:19:05.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.874132+0000", 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.874133+0000", 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9199999999999999e-07 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.874137+0000", 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4839999999999998e-06 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.874147+0000", 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3870000000000001e-06 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.874153+0000", 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2689999999999996e-06 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129240 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.868076+0000", 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.016241914, 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019353876999999998, 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129240 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868076+0000", 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868076+0000", 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868076+0000", 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.63e-07 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868080+0000", 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4960000000000001e-06 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868088+0000", 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5059999999999995e-06 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.868092+0000", 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9600000000000002e-06 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129305 3.1c 3.9325fefc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.869919+0000", 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014398955, 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017540824, 2024-09-11T06:19:05.213 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129305 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869919+0000", 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869919+0000", 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869919+0000", 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869921+0000", 2024-09-11T06:19:05.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3520000000000001e-06 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869928+0000", 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4479999999999999e-06 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.869933+0000", 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:129388 3.1c 3.976bd6fc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:04.878528+0000", 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0057895150000000003, 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089604320000000008, 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 129388 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.878528+0000", 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.878528+0000", 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.878529+0000", 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.878534+0000", 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0520000000000001e-06 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.878542+0000", 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0320000000000003e-06 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:04.878547+0000", 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3870000000000003e-06 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 90 2024-09-11T06:19:05.220 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:05.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:19:05.222 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:05.221+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:05.223 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:05.322 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:05.321+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:05.413 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:05.413 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:05.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:05.424 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:05.423+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:05.474 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:19:05.474 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:19:05.475 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T06:19:05.475 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:19:05.524 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:05.524+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:05.610 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130410 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10993664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46146051700000001, 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043187259999999998, 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130410 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146584+0000", 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146592+0000", 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5619999999999998e-06 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146598+0000", 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189643+0000", 2024-09-11T06:19:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043045091000000001 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189704+0000", 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0911e-05 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189769+0000", 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5745000000000002e-05 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130411 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 11001856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46143837599999998, 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043307804999999998, 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130411 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146605+0000", 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146613+0000", 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6729999999999998e-06 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146621+0000", 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8849999999999999e-06 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146626+0000", 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9520000000000002e-06 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189802+0000", 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043175603 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189848+0000", 2024-09-11T06:19:05.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6465999999999999e-05 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189912+0000", 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3835000000000001e-05 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130444 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10752000~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:05.620 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46140957599999999, 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043428937000000001, 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130444 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:05.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146635+0000", 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146642+0000", 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8680000000000001e-06 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146649+0000", 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2319999999999998e-06 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189933+0000", 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043284979000000001 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189982+0000", 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8513000000000001e-05 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190062+0000", 2024-09-11T06:19:05.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9929e-05 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130445 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10760192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46138205199999999, 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043549156999999998, 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130445 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146663+0000", 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146678+0000", 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5201000000000001e-05 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146684+0000", 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190086+0000", 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043401281 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190147+0000", 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1246000000000003e-05 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190210+0000", 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2720999999999998e-05 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130446 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10768384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46134497000000002, 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043660235999999998, 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130446 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146700+0000", 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-06 2024-09-11T06:19:05.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146709+0000", 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3520000000000007e-06 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146718+0000", 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6830000000000003e-06 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190233+0000", 2024-09-11T06:19:05.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043514440000000001 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190283+0000", 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0178e-05 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190358+0000", 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4796999999999996e-05 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130447 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10776576~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.461281049, 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043732383999999999, 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130447 2024-09-11T06:19:05.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146765+0000", 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146782+0000", 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7282000000000002e-05 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146789+0000", 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7279999999999998e-06 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190386+0000", 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043596843000000003 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190431+0000", 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5751999999999998e-05 2024-09-11T06:19:05.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190494+0000", 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2614999999999996e-05 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130448 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10784768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46123931400000001, 2024-09-11T06:19:05.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043831475000000002, 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130448 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:05.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146811+0000", 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146814+0000", 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.543e-06 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146823+0000", 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8699999999999998e-06 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146828+0000", 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-09-11T06:19:05.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190522+0000", 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043694033 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190572+0000", 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0269999999999998e-05 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190635+0000", 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2719999999999996e-05 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130449 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10792960~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46120265799999999, 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043926146999999999, 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130449 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8200000000000001e-07 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146842+0000", 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5910000000000001e-06 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146852+0000", 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0341e-05 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146855+0000", 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190655+0000", 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043800258000000002 2024-09-11T06:19:05.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190706+0000", 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0226999999999999e-05 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190766+0000", 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0517999999999999e-05 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130450 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10801152~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46118345199999999, 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044072734000000002, 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130450 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:05.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146861+0000", 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3379999999999999e-06 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146865+0000", 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3220000000000003e-06 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146868+0000", 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190792+0000", 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043923845000000003 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190853+0000", 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1008999999999998e-05 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190932+0000", 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9326000000000006e-05 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130451 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10809344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.461171418, 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044195328999999998, 2024-09-11T06:19:05.653 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130451 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147086+0000", 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021491899999999999 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147096+0000", 2024-09-11T06:19:05.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0217999999999999e-05 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147105+0000", 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147112+0000", 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190954+0000", 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043842032000000003 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191004+0000", 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0482999999999998e-05 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191066+0000", 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2420000000000002e-05 2024-09-11T06:19:05.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130452 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10817536~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46092235999999998, 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044100716999999998, 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130452 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:05.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147905+0000", 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078465999999999996 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147909+0000", 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2549999999999999e-06 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147919+0000", 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0236e-05 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147927+0000", 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8679999999999999e-06 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191092+0000", 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043164431000000003 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191142+0000", 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9923000000000003e-05 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191221+0000", 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9344000000000005e-05 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130453 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10825728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46008180199999998, 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392063000000002, 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130453 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.663 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147963+0000", 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.795e-06 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147967+0000", 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9979999999999997e-06 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147970+0000", 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191246+0000", 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043275980999999998 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191291+0000", 2024-09-11T06:19:05.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5498999999999999e-05 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191353+0000", 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999994e-05 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130454 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10833920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46006861199999999, 2024-09-11T06:19:05.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043530384999999998, 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130454 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:05.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5199999999999998e-07 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147975+0000", 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.195e-06 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147979+0000", 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.196e-06 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147981+0000", 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191374+0000", 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392673 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191441+0000", 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191504+0000", 2024-09-11T06:19:05.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3602999999999994e-05 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130455 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10842112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46005796599999998, 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043653780000000003, 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130455 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147986+0000", 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.35e-06 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147989+0000", 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147992+0000", 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191525+0000", 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043533080000000002 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191577+0000", 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2506999999999997e-05 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191638+0000", 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0903999999999998e-05 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130456 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10850304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46004752599999998, 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.04379475, 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130456 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149579+0000", 2024-09-11T06:19:05.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001583877 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149584+0000", 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9359999999999998e-06 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149593+0000", 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2429999999999994e-06 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149598+0000", 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0919999999999997e-06 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191663+0000", 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042064987999999998 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191714+0000", 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0506000000000001e-05 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191790+0000", 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130463 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10907648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.45836853999999999, 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043098538999999998, 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130463 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.28e-07 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149679+0000", 2024-09-11T06:19:05.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5449999999999997e-06 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149682+0000", 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.455e-06 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149685+0000", 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.526e-06 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192662+0000", 2024-09-11T06:19:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042976939999999998 2024-09-11T06:19:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192712+0000", 2024-09-11T06:19:05.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0682e-05 2024-09-11T06:19:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192773+0000", 2024-09-11T06:19:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0163e-05 2024-09-11T06:19:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130464 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10915840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.45835441599999999, 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043257601999999999, 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130464 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149920+0000", 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023134100000000001 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149923+0000", 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000001e-06 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149932+0000", 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7080000000000003e-06 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149939+0000", 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6510000000000001e-06 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192802+0000", 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042862572000000002 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192861+0000", 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9077999999999999e-05 2024-09-11T06:19:05.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192946+0000", 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4901999999999995e-05 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130465 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10924032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.458095419, 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043129278, 2024-09-11T06:19:05.693 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130465 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:05.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149949+0000", 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.886e-06 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149953+0000", 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149956+0000", 2024-09-11T06:19:05.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T06:19:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192970+0000", 2024-09-11T06:19:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043013844000000002 2024-09-11T06:19:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193017+0000", 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6530999999999999e-05 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193076+0000", 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9824999999999997e-05 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130466 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10932224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.698 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.45808284799999999, 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043272974999999998, 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130466 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151901+0000", 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001941356 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151905+0000", 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000003e-06 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151912+0000", 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0679999999999999e-06 2024-09-11T06:19:05.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151916+0000", 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9829999999999998e-06 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193097+0000", 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041180814000000003 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193161+0000", 2024-09-11T06:19:05.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3584000000000007e-05 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193233+0000", 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2074000000000001e-05 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130516 3.1c 3:3f6bd6e9:::rbd_object_map.116df114867d.000000000000003e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:05.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.45488036500000001, 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043688850000000001, 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130516 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:05.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153163+0000", 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8299999999999996e-07 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153168+0000", 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153176+0000", 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:05.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153181+0000", 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3539999999999999e-06 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194609+0000", 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041427972 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194661+0000", 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2308999999999997e-05 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194883+0000", 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221466 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196734+0000", 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018515039999999999 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196752+0000", 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7558e-05 2024-09-11T06:19:05.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196812+0000", 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9639000000000003e-05 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196851+0000", 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9536999999999998e-05 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.710 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:05.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:05.711 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:05.710+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:05.811 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:05.811+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:05.887 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:05.887 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:05.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:05.912 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:05.911+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:05.950 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 137, 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:19:04.164384+0000", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:18:57.153745+0000", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:16:42.356322+0000", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:19:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 7, 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:19:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:19:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:19:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:19:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:19:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "137", 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 62, 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 137, 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:05.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:05.971 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:05.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:05.973 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:19:05.974 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:05.975 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 132, 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:19:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:05.977 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:19:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:19:05.979 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:19:05.982 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:05.983 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.6932525634765625, 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 54, 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 92, 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 92, 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 56, 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:19:05.984 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.986 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.988 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/747530186", 2024-09-11T06:19:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/747530186", 2024-09-11T06:19:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/747530186", 2024-09-11T06:19:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/747530186", 2024-09-11T06:19:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:05.989 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 109, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 130, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 133, 2024-09-11T06:19:05.990 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 110, 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:05.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.993 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:19:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:19:05.994 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:05.995 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.996 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/4176263936", 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/4176263936", 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/4176263936", 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/4176263936", 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.997 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 133, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:05.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.002 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:06.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:06.004 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 130, 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:06.005 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.006 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:06.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 130, 2024-09-11T06:19:06.010 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.011 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:19:06.012 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:06.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:19:06.015 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:06.016 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 133, 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:06.018 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.019 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.020 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.019287109375, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 110, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:06.023 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.024 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:19:06.025 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:06.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 56 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:19:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 110 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.035 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.f", 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: 7, 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.12", 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 3, 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 4 2024-09-11T06:19:06.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:19:06.037 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:19:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:19:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:19:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:19:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:19:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.038 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 48, 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 50, 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 52, 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:06.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 54, 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 56, 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.040 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 58, 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 60, 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T06:19:06.041 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.042 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:06.044 INFO:tasks.thrashosds.thrasher:j is {'epoch': 137, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:19:04.164384+0000', 'last_up_change': '2024-09-11T06:18:57.153745+0000', 'last_in_change': '2024-09-11T06:16:42.356322+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 62, 'snap_epoch': 137, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6932525634765625, 'last_clean_begin': 15, 'last_clean_end': 54, 'up_from': 92, 'up_thru': 92, 'down_at': 56, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 747530186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 747530186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 747530186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 747530186}]}, 'public_addr': '172.21.15.70:6817/747530186', 'cluster_addr': '172.21.15.70:6819/747530186', 'heartbeat_back_addr': '172.21.15.70:6823/747530186', 'heartbeat_front_addr': '172.21.15.70:6821/747530186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 109, 'up_from': 130, 'up_thru': 133, 'down_at': 110, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 4176263936}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4176263936}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4176263936}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4176263936}]}, 'public_addr': '172.21.15.70:6809/4176263936', 'cluster_addr': '172.21.15.70:6811/4176263936', 'heartbeat_back_addr': '172.21.15.70:6815/4176263936', 'heartbeat_front_addr': '172.21.15.70:6813/4176263936', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.019287109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 110, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 56}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 110}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.f', 'osds': [7, 2]}], 'pg_upmap_items': [{'pgid': '3.12', 'mappings': [{'from': 3, 'to': 4}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 48, 'length': 1}, {'begin': 50, 'length': 1}, {'begin': 52, 'length': 1}, {'begin': 54, 'length': 1}, {'begin': 56, 'length': 1}, {'begin': 58, 'length': 1}, {'begin': 60, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:19:06.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:19:06.045 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:06.042+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:06.068 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:06.068 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:06.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:06.163 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:06.162+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:06.178 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:19:06.246 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:06.245+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118743 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1416364220000004, 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99346091199999997, 2024-09-11T06:19:06.262 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118743 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118559+0000", 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118568+0000", 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4279999999999996e-06 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118589+0000", 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1129999999999999e-05 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118599+0000", 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8789999999999998e-06 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118670+0000", 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1087999999999994e-05 2024-09-11T06:19:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118679+0000", 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.115e-06 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111727+0000", 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99304786499999997 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111848+0000", 2024-09-11T06:19:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121347 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112017+0000", 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016935499999999999 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118751 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1413350219999998, 2024-09-11T06:19:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99440886299999998, 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118751 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:06.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.85e-07 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118863+0000", 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2741999999999999e-05 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118884+0000", 2024-09-11T06:19:06.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7109999999999995e-06 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118951+0000", 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7347000000000004e-05 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118958+0000", 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0180000000000004e-06 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113102+0000", 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99414409999999998 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113179+0000", 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113267+0000", 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7745999999999996e-05 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118759 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1410272800000003, 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99428308499999996, 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118759 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119167+0000", 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119173+0000", 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0859999999999998e-06 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119187+0000", 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4133e-05 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119194+0000", 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-06 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119251+0000", 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6063999999999997e-05 2024-09-11T06:19:06.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119259+0000", 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9750000000000007e-06 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113295+0000", 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99403649000000005 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113370+0000", 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5266999999999996e-05 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113449+0000", 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8396e-05 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118767 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:06.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1407284039999999, 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99424699400000005, 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118767 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119465+0000", 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2500000000000004e-07 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119472+0000", 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3330000000000002e-06 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119485+0000", 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2782999999999999e-05 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9830000000000002e-06 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119548+0000", 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4274000000000002e-05 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113477+0000", 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99392198799999998 2024-09-11T06:19:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113607+0000", 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012957600000000001 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113711+0000", 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104832 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118775 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1404114300000003, 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99457822699999998, 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118775 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119782+0000", 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4e-07 2024-09-11T06:19:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119787+0000", 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119800+0000", 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3728e-05 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119808+0000", 2024-09-11T06:19:06.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.661e-06 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119865+0000", 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7345000000000001e-05 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119876+0000", 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0393e-05 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114042+0000", 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99416629599999995 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114146+0000", 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104091 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114360+0000", 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000213544 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.289 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118783 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1400929409999998, 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99444126499999996, 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118783 2024-09-11T06:19:06.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120101+0000", 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120105+0000", 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6269999999999999e-06 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120117+0000", 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1858999999999999e-05 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120122+0000", 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9439999999999996e-06 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1106999999999998e-05 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120168+0000", 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6870000000000002e-06 2024-09-11T06:19:06.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114344+0000", 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.994176328 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114440+0000", 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6028999999999998e-05 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114541+0000", 2024-09-11T06:19:06.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100813 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.1398049300000004, 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.295 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:06.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119571 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 13369344~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1325546449999999, 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018023052000000001, 2024-09-11T06:19:06.300 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119571 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:06.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127639+0000", 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127641+0000", 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.514e-06 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127648+0000", 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5880000000000003e-06 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127652+0000", 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7500000000000003e-06 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145548+0000", 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017895155999999999 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145596+0000", 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8792999999999999e-05 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145661+0000", 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4869000000000005e-05 2024-09-11T06:19:06.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119572 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 14286848~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.132534003, 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018157623000000001, 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119572 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127661+0000", 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127669+0000", 2024-09-11T06:19:06.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6380000000000004e-06 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127673+0000", 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7620000000000003e-06 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145694+0000", 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018020806 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145758+0000", 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3770999999999996e-05 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145816+0000", 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8476000000000001e-05 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119573 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 15204352~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1324949130000004, 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018351035000000002, 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119573 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127699+0000", 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-07 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127718+0000", 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9667999999999999e-05 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127727+0000", 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6999999999999997e-06 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127733+0000", 2024-09-11T06:19:06.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145846+0000", 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018113073 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145959+0000", 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011347 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146049+0000", 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9926000000000006e-05 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119574 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1324530040000003, 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018368603000000001, 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119574 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127742+0000", 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8109999999999999e-06 2024-09-11T06:19:06.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127749+0000", 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5749999999999997e-06 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127764+0000", 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5361000000000001e-05 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146094+0000", 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01833015 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146108+0000", 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4265e-05 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119575 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1324209170000001, 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018387018000000001, 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119575 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6899999999999998e-07 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127775+0000", 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1110000000000002e-06 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127781+0000", 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4969999999999998e-06 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127786+0000", 2024-09-11T06:19:06.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146148+0000", 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018362195000000001 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146159+0000", 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0903e-05 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119576 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.132400144, 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018419563, 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119576 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.326 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:06.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:06.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127795+0000", 2024-09-11T06:19:06.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:19:06.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127802+0000", 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.489e-06 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127806+0000", 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7430000000000002e-06 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146199+0000", 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018393093999999999 2024-09-11T06:19:06.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146212+0000", 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2812e-05 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119577 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1323799479999996, 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018434368, 2024-09-11T06:19:06.330 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119577 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127837+0000", 2024-09-11T06:19:06.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3349999999999998e-05 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127844+0000", 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2080000000000003e-06 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127849+0000", 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146235+0000", 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018386120999999998 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146247+0000", 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119578 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:06.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1323366459999997, 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018438821000000001, 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119578 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:06.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127857+0000", 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127859+0000", 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127865+0000", 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127870+0000", 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8879999999999996e-06 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146285+0000", 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018414950999999999 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146295+0000", 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7650000000000005e-06 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119579 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.338 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1323160699999999, 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018456706999999999, 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119579 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:19:06.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127879+0000", 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8640000000000001e-06 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127886+0000", 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127891+0000", 2024-09-11T06:19:06.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0080000000000002e-06 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146323+0000", 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018431811999999999 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146334+0000", 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0814e-05 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119721 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1298148350000004, 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018040231, 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119721 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.343 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:06.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130397+0000", 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8663000000000001e-05 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130406+0000", 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9619999999999999e-06 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130412+0000", 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4210000000000003e-06 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148411+0000", 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017999004999999998 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148418+0000", 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7519999999999996e-06 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119722 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1297625760000001, 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018031229999999999, 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119722 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130431+0000", 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1800000000000005e-07 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130434+0000", 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4450000000000001e-06 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130442+0000", 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-09-11T06:19:06.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130448+0000", 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4519999999999996e-06 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148451+0000", 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01800295 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148462+0000", 2024-09-11T06:19:06.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0828e-05 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119723 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1297368360000002, 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018050743000000001, 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119723 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130457+0000", 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000001e-07 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130459+0000", 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0549999999999998e-06 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130466+0000", 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130477+0000", 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878999999999999e-05 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148496+0000", 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018784999999999 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148507+0000", 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0550000000000001e-05 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119724 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1297072330000004, 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038285000000001, 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:06.355 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119724 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:06.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5699999999999998e-07 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130488+0000", 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3709999999999998e-06 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130495+0000", 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9260000000000003e-06 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130500+0000", 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9400000000000001e-06 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148519+0000", 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018688000000001 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:06.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148524+0000", 2024-09-11T06:19:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:19:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:06.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:06.361 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:06.360+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:06.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:19:06.406 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-09-11T06:19:06.175833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1519132780,"num_objects":940,"num_object_clones":0,"num_object_copies":1880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":940,"num_whiteouts":0,"num_read":112803,"num_read_kb":983061,"num_write":16600,"num_write_kb":659043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":56757868,"num_keys_recovered":113,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11508,"ondisk_log_size":11508,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365868,"kb_used_data":90636,"kb_used_omap":37,"kb_used_meta":275034,"kb_avail":754608852,"statfs":{"total":773094113280,"available":772719464448,"internally_reserved":0,"allocated":92811264,"data_stored":721085069,"data_compressed":20076238,"data_compressed_allocated":62590976,"data_compressed_original":701043228,"omap_allocated":38504,"internal_metadata":281635224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,21],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":162353643,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-256,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1399,"num_read_kb":2208,"num_write":129,"num_write_kb":9653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":3954756,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.069809"},"pg_stats":[{"pgid":"3.1f","version":"135'230","reported_seq":2485,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.166360+0000","last_change":"2024-09-11T06:19:02.166360+0000","last_active":"2024-09-11T06:19:02.166360+0000","last_peered":"2024-09-11T06:19:02.166360+0000","last_clean":"2024-09-11T06:19:02.166360+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:19:02.166360+0000","last_undegraded":"2024-09-11T06:19:02.166360+0000","last_fullsized":"2024-09-11T06:19:02.166360+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:47.364315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000718847,"stat_sum":{"num_bytes":53630340,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2017,"num_read_kb":20555,"num_write":388,"num_write_kb":21311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.1e","version":"134'347","reported_seq":2903,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.166374+0000","last_change":"2024-09-11T06:19:02.166635+0000","last_active":"2024-09-11T06:19:02.166374+0000","last_peered":"2024-09-11T06:19:02.166374+0000","last_clean":"2024-09-11T06:19:02.166374+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:19:02.166374+0000","last_undegraded":"2024-09-11T06:19:02.166374+0000","last_fullsized":"2024-09-11T06:19:02.166374+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:49:37.365083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097519999999999996,"stat_sum":{"num_bytes":31711116,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3229,"num_read_kb":12554,"num_write":535,"num_write_kb":13340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.1d","version":"129'717","reported_seq":5394,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.164317+0000","last_change":"2024-09-11T06:19:02.164517+0000","last_active":"2024-09-11T06:19:02.164317+0000","last_peered":"2024-09-11T06:19:02.164317+0000","last_clean":"2024-09-11T06:19:02.164317+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:19:02.164317+0000","last_undegraded":"2024-09-11T06:19:02.164317+0000","last_fullsized":"2024-09-11T06:19:02.164317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:24.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018216630000000001,"stat_sum":{"num_bytes":110984831,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":6793,"num_read_kb":73484,"num_write":1179,"num_write_kb":31016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.1c","version":"135'221","reported_seq":2406,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.298529+0000","last_change":"2024-09-11T06:19:02.167662+0000","last_active":"2024-09-11T06:19:02.298529+0000","last_peered":"2024-09-11T06:19:02.298529+0000","last_clean":"2024-09-11T06:19:02.298529+0000","last_became_active":"2024-09-11T06:18:19.335163+0000","last_became_peered":"2024-09-11T06:18:19.335163+0000","last_unstale":"2024-09-11T06:19:02.298529+0000","last_undegraded":"2024-09-11T06:19:02.298529+0000","last_fullsized":"2024-09-11T06:19:02.298529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:40:34.988854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001240784,"stat_sum":{"num_bytes":59822463,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2711,"num_read_kb":16199,"num_write":327,"num_write_kb":10931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1622976,"num_keys_recovered":38,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.1b","version":"115'367","reported_seq":2590,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.348627+0000","last_change":"2024-09-11T06:19:02.348888+0000","last_active":"2024-09-11T06:19:02.348627+0000","last_peered":"2024-09-11T06:19:02.348627+0000","last_clean":"2024-09-11T06:19:02.348627+0000","last_became_active":"2024-09-11T06:17:09.677779+0000","last_became_peered":"2024-09-11T06:17:09.677779+0000","last_unstale":"2024-09-11T06:19:02.348627+0000","last_undegraded":"2024-09-11T06:19:02.348627+0000","last_fullsized":"2024-09-11T06:19:02.348627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:14.437863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049770499999999998,"stat_sum":{"num_bytes":25423414,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2661,"num_read_kb":29155,"num_write":553,"num_write_kb":20846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.1a","version":"134'278","reported_seq":4038,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.290513+0000","last_change":"2024-09-11T06:19:02.165997+0000","last_active":"2024-09-11T06:19:02.290513+0000","last_peered":"2024-09-11T06:19:02.290513+0000","last_clean":"2024-09-11T06:19:02.290513+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:19:02.290513+0000","last_undegraded":"2024-09-11T06:19:02.290513+0000","last_fullsized":"2024-09-11T06:19:02.290513+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:26.182784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057972199999999996,"stat_sum":{"num_bytes":88356044,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3831,"num_read_kb":45821,"num_write":334,"num_write_kb":23448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.19","version":"118'254","reported_seq":2654,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.348944+0000","last_change":"2024-09-11T06:19:02.349139+0000","last_active":"2024-09-11T06:19:02.348944+0000","last_peered":"2024-09-11T06:19:02.348944+0000","last_clean":"2024-09-11T06:19:02.348944+0000","last_became_active":"2024-09-11T06:18:19.336396+0000","last_became_peered":"2024-09-11T06:18:19.336396+0000","last_unstale":"2024-09-11T06:19:02.348944+0000","last_undegraded":"2024-09-11T06:19:02.348944+0000","last_fullsized":"2024-09-11T06:19:02.348944+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:25.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062931900000000004,"stat_sum":{"num_bytes":18471163,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2585,"num_read_kb":21766,"num_write":346,"num_write_kb":12685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2873672,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.18","version":"135'931","reported_seq":4688,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.166314+0000","last_change":"2024-09-11T06:19:02.166314+0000","last_active":"2024-09-11T06:19:02.166314+0000","last_peered":"2024-09-11T06:19:02.166314+0000","last_clean":"2024-09-11T06:19:02.166314+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:19:02.166314+0000","last_undegraded":"2024-09-11T06:19:02.166314+0000","last_fullsized":"2024-09-11T06:19:02.166314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:33.327524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082952299999999998,"stat_sum":{"num_bytes":20919350,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":8438,"num_read_kb":23928,"num_write":1413,"num_write_kb":19272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.17","version":"118'165","reported_seq":3084,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.166449+0000","last_change":"2024-09-11T06:19:02.166695+0000","last_active":"2024-09-11T06:19:02.166449+0000","last_peered":"2024-09-11T06:19:02.166449+0000","last_clean":"2024-09-11T06:19:02.166449+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:19:02.166449+0000","last_undegraded":"2024-09-11T06:19:02.166449+0000","last_fullsized":"2024-09-11T06:19:02.166449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:33.646052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080730299999999999,"stat_sum":{"num_bytes":53908187,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":2481,"num_read_kb":26622,"num_write":250,"num_write_kb":12753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.16","version":"137'381","reported_seq":2802,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-11T06:19:05.916596+0000","last_change":"2024-09-11T06:19:02.163805+0000","last_active":"2024-09-11T06:19:05.916596+0000","last_peered":"2024-09-11T06:19:05.916596+0000","last_clean":"2024-09-11T06:19:05.916596+0000","last_became_active":"2024-09-11T06:18:58.166467+0000","last_became_peered":"2024-09-11T06:18:58.166467+0000","last_unstale":"2024-09-11T06:19:05.916596+0000","last_undegraded":"2024-09-11T06:19:05.916596+0000","last_fullsized":"2024-09-11T06:19:05.916596+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:20.807316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056041900000000004,"stat_sum":{"num_bytes":60469325,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3504,"num_read_kb":26614,"num_write":545,"num_write_kb":25507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":319665,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.15","version":"121'236","reported_seq":3065,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.169666+0000","last_change":"2024-09-11T06:19:02.169848+0000","last_active":"2024-09-11T06:19:02.169666+0000","last_peered":"2024-09-11T06:19:02.169666+0000","last_clean":"2024-09-11T06:19:02.169666+0000","last_became_active":"2024-09-11T06:17:09.687839+0000","last_became_peered":"2024-09-11T06:17:09.687839+0000","last_unstale":"2024-09-11T06:19:02.169666+0000","last_undegraded":"2024-09-11T06:19:02.169666+0000","last_fullsized":"2024-09-11T06:19:02.169666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:57:31.123593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000477555,"stat_sum":{"num_bytes":66307674,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2533,"num_read_kb":33123,"num_write":338,"num_write_kb":30975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.14","version":"129'319","reported_seq":3645,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.163801+0000","last_change":"2024-09-11T06:19:02.164263+0000","last_active":"2024-09-11T06:19:02.163801+0000","last_peered":"2024-09-11T06:19:02.163801+0000","last_clean":"2024-09-11T06:19:02.163801+0000","last_became_active":"2024-09-11T06:19:01.108590+0000","last_became_peered":"2024-09-11T06:19:01.108590+0000","last_unstale":"2024-09-11T06:19:02.163801+0000","last_undegraded":"2024-09-11T06:19:02.163801+0000","last_fullsized":"2024-09-11T06:19:02.163801+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:50:25.670375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017338760000000001,"stat_sum":{"num_bytes":60341478,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2923,"num_read_kb":56768,"num_write":335,"num_write_kb":34760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":100858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.163317+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:19:02.163317+0000","last_peered":"2024-09-11T06:19:02.163317+0000","last_clean":"2024-09-11T06:19:02.163317+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:19:02.163317+0000","last_undegraded":"2024-09-11T06:19:02.163317+0000","last_fullsized":"2024-09-11T06:19:02.163317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"134'186","reported_seq":4119,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.349015+0000","last_change":"2024-09-11T06:19:02.349259+0000","last_active":"2024-09-11T06:19:02.349015+0000","last_peered":"2024-09-11T06:19:02.349015+0000","last_clean":"2024-09-11T06:19:02.349015+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:19:02.349015+0000","last_undegraded":"2024-09-11T06:19:02.349015+0000","last_fullsized":"2024-09-11T06:19:02.349015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:22:56.128361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072977999999999997,"stat_sum":{"num_bytes":39517472,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3532,"num_read_kb":41980,"num_write":307,"num_write_kb":24853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":245,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.348316+0000","last_change":"2024-09-11T06:17:01.627002+0000","last_active":"2024-09-11T06:19:02.348316+0000","last_peered":"2024-09-11T06:19:02.348316+0000","last_clean":"2024-09-11T06:19:02.348316+0000","last_became_active":"2024-09-11T06:16:59.893686+0000","last_became_peered":"2024-09-11T06:16:59.893686+0000","last_unstale":"2024-09-11T06:19:02.348316+0000","last_undegraded":"2024-09-11T06:19:02.348316+0000","last_fullsized":"2024-09-11T06:19:02.348316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:52.072834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"123'180","reported_seq":2486,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.349190+0000","last_change":"2024-09-11T06:19:02.349414+0000","last_active":"2024-09-11T06:19:02.349190+0000","last_peered":"2024-09-11T06:19:02.349190+0000","last_clean":"2024-09-11T06:19:02.349190+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:19:02.349190+0000","last_undegraded":"2024-09-11T06:19:02.349190+0000","last_fullsized":"2024-09-11T06:19:02.349190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:36:31.456246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085911600000000005,"stat_sum":{"num_bytes":25713082,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2018,"num_read_kb":26606,"num_write":248,"num_write_kb":17082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.162951+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:19:02.162951+0000","last_peered":"2024-09-11T06:19:02.162951+0000","last_clean":"2024-09-11T06:19:02.162951+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:19:02.162951+0000","last_undegraded":"2024-09-11T06:19:02.162951+0000","last_fullsized":"2024-09-11T06:19:02.162951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"134'471","reported_seq":4198,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-11T06:19:01.109144+0000","last_change":"2024-09-11T06:18:53.142690+0000","last_active":"2024-09-11T06:19:01.109144+0000","last_peered":"2024-09-11T06:19:01.109144+0000","last_clean":"2024-09-11T06:19:01.109144+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:19:01.109144+0000","last_undegraded":"2024-09-11T06:19:01.109144+0000","last_fullsized":"2024-09-11T06:19:01.109144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:06.547290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037515999999999998,"stat_sum":{"num_bytes":90729891,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":4980,"num_read_kb":51863,"num_write":790,"num_write_kb":28329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":245,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.165454+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:19:02.165454+0000","last_peered":"2024-09-11T06:19:02.165454+0000","last_clean":"2024-09-11T06:19:02.165454+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:19:02.165454+0000","last_undegraded":"2024-09-11T06:19:02.165454+0000","last_fullsized":"2024-09-11T06:19:02.165454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"137'637","reported_seq":3362,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-11T06:19:05.874015+0000","last_change":"2024-09-11T06:19:02.165243+0000","last_active":"2024-09-11T06:19:05.874015+0000","last_peered":"2024-09-11T06:19:05.874015+0000","last_clean":"2024-09-11T06:19:05.874015+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:19:05.874015+0000","last_undegraded":"2024-09-11T06:19:05.874015+0000","last_fullsized":"2024-09-11T06:19:05.874015+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:16.787060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010348099999999999,"stat_sum":{"num_bytes":28694540,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":4825,"num_read_kb":23983,"num_write":859,"num_write_kb":14110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.3","version":"127'523","reported_seq":4327,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.169300+0000","last_change":"2024-09-11T06:19:02.169526+0000","last_active":"2024-09-11T06:19:02.169300+0000","last_peered":"2024-09-11T06:19:02.169300+0000","last_clean":"2024-09-11T06:19:02.169300+0000","last_became_active":"2024-09-11T06:18:58.166199+0000","last_became_peered":"2024-09-11T06:18:58.166199+0000","last_unstale":"2024-09-11T06:19:02.169300+0000","last_undegraded":"2024-09-11T06:19:02.169300+0000","last_fullsized":"2024-09-11T06:19:02.169300+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:41:26.255983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000413884,"stat_sum":{"num_bytes":39832183,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":6162,"num_read_kb":30584,"num_write":636,"num_write_kb":22154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":201163,"num_keys_recovered":11,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":246,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.162697+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:19:02.162697+0000","last_peered":"2024-09-11T06:19:02.162697+0000","last_clean":"2024-09-11T06:19:02.162697+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:19:02.162697+0000","last_undegraded":"2024-09-11T06:19:02.162697+0000","last_fullsized":"2024-09-11T06:19:02.162697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"134'430","reported_seq":3921,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.165730+0000","last_change":"2024-09-11T06:19:02.165997+0000","last_active":"2024-09-11T06:19:02.165730+0000","last_peered":"2024-09-11T06:19:02.165730+0000","last_clean":"2024-09-11T06:19:02.165730+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:19:02.165730+0000","last_undegraded":"2024-09-11T06:19:02.165730+0000","last_fullsized":"2024-09-11T06:19:02.165730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:38.229394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066236300000000001,"stat_sum":{"num_bytes":72080926,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3772,"num_read_kb":27476,"num_write":614,"num_write_kb":26183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.165289+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:19:02.165289+0000","last_peered":"2024-09-11T06:19:02.165289+0000","last_clean":"2024-09-11T06:19:02.165289+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:19:02.165289+0000","last_undegraded":"2024-09-11T06:19:02.165289+0000","last_fullsized":"2024-09-11T06:19:02.165289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"129'655","reported_seq":2745,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-11T06:19:01.206552+0000","last_change":"2024-09-11T06:19:01.116411+0000","last_active":"2024-09-11T06:19:01.206552+0000","last_peered":"2024-09-11T06:19:01.206552+0000","last_clean":"2024-09-11T06:19:01.206552+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:19:01.206552+0000","last_undegraded":"2024-09-11T06:19:01.206552+0000","last_fullsized":"2024-09-11T06:19:01.206552+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:41.969394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050560279999999997,"stat_sum":{"num_bytes":84435965,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3031,"num_read_kb":21960,"num_write":874,"num_write_kb":21384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":245,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.162434+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:19:02.162434+0000","last_peered":"2024-09-11T06:19:02.162434+0000","last_clean":"2024-09-11T06:19:02.162434+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:19:02.162434+0000","last_undegraded":"2024-09-11T06:19:02.162434+0000","last_fullsized":"2024-09-11T06:19:02.162434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"115'273","reported_seq":3337,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.349331+0000","last_change":"2024-09-11T06:19:02.349514+0000","last_active":"2024-09-11T06:19:02.349331+0000","last_peered":"2024-09-11T06:19:02.349331+0000","last_clean":"2024-09-11T06:19:02.349331+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:19:02.349331+0000","last_undegraded":"2024-09-11T06:19:02.349331+0000","last_fullsized":"2024-09-11T06:19:02.349331+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:38.726421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092485799999999997,"stat_sum":{"num_bytes":42666637,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":3135,"num_read_kb":19837,"num_write":421,"num_write_kb":17916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":252,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.163028+0000","last_change":"2024-09-11T06:18:58.163978+0000","last_active":"2024-09-11T06:19:02.163028+0000","last_peered":"2024-09-11T06:19:02.163028+0000","last_clean":"2024-09-11T06:19:02.163028+0000","last_became_active":"2024-09-11T06:18:58.163649+0000","last_became_peered":"2024-09-11T06:18:58.163649+0000","last_unstale":"2024-09-11T06:19:02.163028+0000","last_undegraded":"2024-09-11T06:19:02.163028+0000","last_fullsized":"2024-09-11T06:19:02.163028+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:31.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":257,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.165713+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:19:02.165713+0000","last_peered":"2024-09-11T06:19:02.165713+0000","last_clean":"2024-09-11T06:19:02.165713+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:19:02.165713+0000","last_undegraded":"2024-09-11T06:19:02.165713+0000","last_fullsized":"2024-09-11T06:19:02.165713+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"134'390","reported_seq":3943,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.348699+0000","last_change":"2024-09-11T06:19:02.348944+0000","last_active":"2024-09-11T06:19:02.348699+0000","last_peered":"2024-09-11T06:19:02.348699+0000","last_clean":"2024-09-11T06:19:02.348699+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:19:02.348699+0000","last_undegraded":"2024-09-11T06:19:02.348699+0000","last_fullsized":"2024-09-11T06:19:02.348699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:56.728182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054388600000000004,"stat_sum":{"num_bytes":37807604,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4864,"num_read_kb":29844,"num_write":474,"num_write_kb":18448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.9","version":"132'221","reported_seq":4324,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.286641+0000","last_change":"2024-09-11T06:19:02.164685+0000","last_active":"2024-09-11T06:19:02.286641+0000","last_peered":"2024-09-11T06:19:02.286641+0000","last_clean":"2024-09-11T06:19:02.286641+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:19:02.286641+0000","last_undegraded":"2024-09-11T06:19:02.286641+0000","last_fullsized":"2024-09-11T06:19:02.286641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:01:25.179475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019401690000000001,"stat_sum":{"num_bytes":54044179,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3956,"num_read_kb":39790,"num_write":398,"num_write_kb":24034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.a","version":"116'152","reported_seq":3571,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.164177+0000","last_change":"2024-09-11T06:19:02.164388+0000","last_active":"2024-09-11T06:19:02.164177+0000","last_peered":"2024-09-11T06:19:02.164177+0000","last_clean":"2024-09-11T06:19:02.164177+0000","last_became_active":"2024-09-11T06:18:19.333935+0000","last_became_peered":"2024-09-11T06:18:19.333935+0000","last_unstale":"2024-09-11T06:19:02.164177+0000","last_undegraded":"2024-09-11T06:19:02.164177+0000","last_fullsized":"2024-09-11T06:19:02.164177+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:51.029900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001826091,"stat_sum":{"num_bytes":36367158,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3097,"num_read_kb":31998,"num_write":204,"num_write_kb":15118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":9995151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.b","version":"122'428","reported_seq":2578,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-11T06:19:01.108994+0000","last_change":"2024-09-11T06:18:53.142987+0000","last_active":"2024-09-11T06:19:01.108994+0000","last_peered":"2024-09-11T06:19:01.108994+0000","last_clean":"2024-09-11T06:19:01.108994+0000","last_became_active":"2024-09-11T06:18:01.255735+0000","last_became_peered":"2024-09-11T06:18:01.255735+0000","last_unstale":"2024-09-11T06:19:01.108994+0000","last_undegraded":"2024-09-11T06:19:01.108994+0000","last_fullsized":"2024-09-11T06:19:01.108994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:58.542400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073157599999999995,"stat_sum":{"num_bytes":16756436,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2860,"num_read_kb":14763,"num_write":737,"num_write_kb":21169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.c","version":"125'283","reported_seq":2210,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.169379+0000","last_change":"2024-09-11T06:19:02.169577+0000","last_active":"2024-09-11T06:19:02.169379+0000","last_peered":"2024-09-11T06:19:02.169379+0000","last_clean":"2024-09-11T06:19:02.169379+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:19:02.169379+0000","last_undegraded":"2024-09-11T06:19:02.169379+0000","last_fullsized":"2024-09-11T06:19:02.169379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:14:38.016558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044896500000000001,"stat_sum":{"num_bytes":14600464,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2169,"num_read_kb":14420,"num_write":375,"num_write_kb":9889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.d","version":"120'411","reported_seq":2460,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.164857+0000","last_change":"2024-09-11T06:19:02.165112+0000","last_active":"2024-09-11T06:19:02.164857+0000","last_peered":"2024-09-11T06:19:02.164857+0000","last_clean":"2024-09-11T06:19:02.164857+0000","last_became_active":"2024-09-11T06:18:19.334462+0000","last_became_peered":"2024-09-11T06:18:19.334462+0000","last_unstale":"2024-09-11T06:19:02.164857+0000","last_undegraded":"2024-09-11T06:19:02.164857+0000","last_fullsized":"2024-09-11T06:19:02.164857+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:14.070742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022033339999999999,"stat_sum":{"num_bytes":24533336,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2795,"num_read_kb":27958,"num_write":723,"num_write_kb":18312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":7078861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.e","version":"137'441","reported_seq":3136,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-11T06:19:04.731363+0000","last_change":"2024-09-11T06:19:02.165592+0000","last_active":"2024-09-11T06:19:04.731363+0000","last_peered":"2024-09-11T06:19:04.731363+0000","last_clean":"2024-09-11T06:19:04.731363+0000","last_became_active":"2024-09-11T06:19:01.110586+0000","last_became_peered":"2024-09-11T06:19:01.110586+0000","last_unstale":"2024-09-11T06:19:04.731363+0000","last_undegraded":"2024-09-11T06:19:04.731363+0000","last_fullsized":"2024-09-11T06:19:04.731363+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:06.327274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001265906,"stat_sum":{"num_bytes":49317736,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":3182,"num_read_kb":35538,"num_write":584,"num_write_kb":22020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":230114,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.f","version":"137'262","reported_seq":3756,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-11T06:19:05.885217+0000","last_change":"2024-09-11T06:19:02.165179+0000","last_active":"2024-09-11T06:19:05.885217+0000","last_peered":"2024-09-11T06:19:05.885217+0000","last_clean":"2024-09-11T06:19:05.885217+0000","last_became_active":"2024-09-11T06:18:58.166147+0000","last_became_peered":"2024-09-11T06:18:58.166147+0000","last_unstale":"2024-09-11T06:19:05.885217+0000","last_undegraded":"2024-09-11T06:19:05.885217+0000","last_fullsized":"2024-09-11T06:19:05.885217+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:48.686805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015524759999999999,"stat_sum":{"num_bytes":52918468,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3574,"num_read_kb":28972,"num_write":315,"num_write_kb":16098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1241504,"num_keys_recovered":9,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.10","version":"123'266","reported_seq":2446,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.166365+0000","last_change":"2024-09-11T06:19:02.166365+0000","last_active":"2024-09-11T06:19:02.166365+0000","last_peered":"2024-09-11T06:19:02.166365+0000","last_clean":"2024-09-11T06:19:02.166365+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:19:02.166365+0000","last_undegraded":"2024-09-11T06:19:02.166365+0000","last_fullsized":"2024-09-11T06:19:02.166365+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:22.132497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031609500000000002,"stat_sum":{"num_bytes":63247902,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3705,"num_read_kb":35680,"num_write":291,"num_write_kb":22637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.11","version":"118'288","reported_seq":2973,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.163721+0000","last_change":"2024-09-11T06:19:02.164107+0000","last_active":"2024-09-11T06:19:02.163721+0000","last_peered":"2024-09-11T06:19:02.163721+0000","last_clean":"2024-09-11T06:19:02.163721+0000","last_became_active":"2024-09-11T06:18:58.166199+0000","last_became_peered":"2024-09-11T06:18:58.166199+0000","last_unstale":"2024-09-11T06:19:02.163721+0000","last_undegraded":"2024-09-11T06:19:02.163721+0000","last_fullsized":"2024-09-11T06:19:02.163721+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:26.675048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016139920000000001,"stat_sum":{"num_bytes":35307642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2962,"num_read_kb":39190,"num_write":355,"num_write_kb":21973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]},{"pgid":"3.12","version":"115'144","reported_seq":2048,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-11T06:19:01.108967+0000","last_change":"2024-09-11T06:18:53.142860+0000","last_active":"2024-09-11T06:19:01.108967+0000","last_peered":"2024-09-11T06:19:01.108967+0000","last_clean":"2024-09-11T06:19:01.108967+0000","last_became_active":"2024-09-11T06:17:37.166037+0000","last_became_peered":"2024-09-11T06:17:37.166037+0000","last_unstale":"2024-09-11T06:19:01.108967+0000","last_undegraded":"2024-09-11T06:19:01.108967+0000","last_fullsized":"2024-09-11T06:19:01.108967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:48:54.146275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044726800000000001,"stat_sum":{"num_bytes":20070969,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1434,"num_read_kb":21082,"num_write":241,"num_write_kb":16143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":771314,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.13","version":"115'301","reported_seq":3196,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-11T06:19:02.164792+0000","last_change":"2024-09-11T06:19:02.164993+0000","last_active":"2024-09-11T06:19:02.164792+0000","last_peered":"2024-09-11T06:19:02.164792+0000","last_clean":"2024-09-11T06:19:02.164792+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:19:02.164792+0000","last_undegraded":"2024-09-11T06:19:02.164792+0000","last_fullsized":"2024-09-11T06:19:02.164792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:50.024132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021076509999999999,"stat_sum":{"num_bytes":39554418,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":2928,"num_read_kb":32848,"num_write":450,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"},{"start":"32","length":"1"},{"start":"34","length":"1"},{"start":"36","length":"1"},{"start":"38","length":"1"},{"start":"3a","length":"1"},{"start":"3c","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1518542393,"num_objects":936,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":936,"num_whiteouts":0,"num_read":112687,"num_read_kb":982961,"num_write":16439,"num_write_kb":656625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":56757868,"num_keys_recovered":113,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80326656,"data_stored":718367053,"data_compressed":20103711,"data_compressed_allocated":62828544,"data_compressed_original":704459292,"omap_allocated":25754,"internal_metadata":0},"log_size":11388,"ondisk_log_size":11388,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":11168,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":11436032,"data_stored":82018124,"data_compressed":2593675,"data_compressed_allocated":7450624,"data_compressed_original":79334029,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44936,"kb_used_data":9584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326904,"statfs":{"total":96636764160,"available":96590749696,"internally_reserved":0,"allocated":9814016,"data_stored":75235596,"data_compressed":1994635,"data_compressed_allocated":6455296,"data_compressed_original":73051448,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42372,"kb_used_data":15344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329468,"statfs":{"total":96636764160,"available":96593375232,"internally_reserved":0,"allocated":15712256,"data_stored":126211773,"data_compressed":3754374,"data_compressed_allocated":11161600,"data_compressed_original":123066003,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748483,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45068,"kb_used_data":16060,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94326772,"statfs":{"total":96636764160,"available":96590614528,"internally_reserved":0,"allocated":16445440,"data_stored":148949640,"data_compressed":3721996,"data_compressed_allocated":12361728,"data_compressed_original":146250632,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991242,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41976,"kb_used_data":9252,"kb_used_omap":10,"kb_used_meta":32693,"kb_avail":94329864,"statfs":{"total":96636764160,"available":96593780736,"internally_reserved":0,"allocated":9474048,"data_stored":72084125,"data_compressed":2007870,"data_compressed_allocated":6266880,"data_compressed_original":70039849,"omap_allocated":10357,"internal_metadata":33478539},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38832,"kb_used_data":11804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333008,"statfs":{"total":96636764160,"available":96597000192,"internally_reserved":0,"allocated":12087296,"data_stored":93737384,"data_compressed":2500891,"data_compressed_allocated":8060928,"data_compressed_original":91024874,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":9676,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":9908224,"data_stored":71161174,"data_compressed":2073915,"data_compressed_allocated":6299648,"data_compressed_original":68777592,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,21],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43096,"kb_used_data":7748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328744,"statfs":{"total":96636764160,"available":96592633856,"internally_reserved":0,"allocated":7933952,"data_stored":51687253,"data_compressed":1428882,"data_compressed_allocated":4534272,"data_compressed_original":49498801,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":92960080,"data_compressed":2500891,"data_compressed_allocated":8060928,"data_compressed_original":91024874,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7819264,"data_stored":70716453,"data_compressed":1999201,"data_compressed_allocated":6230016,"data_compressed_original":69466409,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14962688,"data_stored":150578137,"data_compressed":3732763,"data_compressed_allocated":12513280,"data_compressed_original":148675464,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14110720,"data_stored":125434450,"data_compressed":3754374,"data_compressed_allocated":11161600,"data_compressed_original":123066003,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8216576,"data_stored":74458292,"data_compressed":1994635,"data_compressed_allocated":6455296,"data_compressed_original":73051448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9781248,"data_stored":80650452,"data_compressed":2585006,"data_compressed_allocated":7413760,"data_compressed_original":78760589,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8478720,"data_stored":70578890,"data_compressed":2074126,"data_compressed_allocated":6303744,"data_compressed_original":68822648,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6467584,"data_stored":52990299,"data_compressed":1462715,"data_compressed_allocated":4689920,"data_compressed_original":51591857,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:19:06.408 INFO:tasks.thrashosds.thrasher:Setting 3.3 to [6, 3] 2024-09-11T06:19:06.408 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.3', '6', '3'] 2024-09-11T06:19:06.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.3 6 3 2024-09-11T06:19:06.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:06.461+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:06.502 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:06.502 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:06.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:06.518 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:06.518 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:06.537 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:06.537 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:06.557 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:06.562 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:06.561+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:06.574 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:06.574 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:06.591 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:06.591 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:06.608 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:06.609 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:06.625 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:06.626 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:06.628 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:06.628 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:06.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:06.643 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:06.643 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:06.663 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:06.663+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:06.746 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:06.747 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:06.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:06.799 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:06.798+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:06.859 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:06.859 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:06.865 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:06.864+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:06.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:06.966 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:06.965+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:07.010 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:07.010 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:07.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:07.067 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:07.066+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:07.122 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:07.123 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:07.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:07.168 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:07.167+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.3 pg_upmap mapping to [6,3] 2024-09-11T06:19:07.251 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:07.251 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:07.260 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:07.268 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:07.268+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:07.318 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-11T06:19:07.367 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:07.367 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:07.369 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:07.369+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:07.376 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:07.470 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:07.469+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:07.519 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:07.519 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:07.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:07.534 INFO:teuthology.orchestra.run.smithi070.stdout:4280 writesame 0x5373f2 thru 0x5448e5 data_size 0x9a(0xd4f4 bytes) 2024-09-11T06:19:07.535 INFO:teuthology.orchestra.run.smithi070.stdout:4281 writesame 0x7058f24 thru 0x70610a2 data_size 0x1(0x817f bytes) 2024-09-11T06:19:07.545 INFO:teuthology.orchestra.run.smithi070.stdout:4282 write 0x39cd47d thru 0x39d3d71 (0x68f5 bytes) 2024-09-11T06:19:07.546 INFO:teuthology.orchestra.run.smithi070.stdout:4283 read 0x291ef4b thru 0x2921997 (0x2a4d bytes) 2024-09-11T06:19:07.547 INFO:teuthology.orchestra.run.smithi070.stdout:4284 write 0x3d28c8 thru 0x3e25a3 (0xfcdc bytes) 2024-09-11T06:19:07.549 INFO:teuthology.orchestra.run.smithi070.stdout:4285 writesame 0x5c0acef thru 0x5c18e6a data_size 0x2(0xe17c bytes) 2024-09-11T06:19:07.561 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:07.564 INFO:teuthology.orchestra.run.smithi070.stdout:4287 trunc from 0xc2144e9 to 0xeadfd70 2024-09-11T06:19:07.572 INFO:teuthology.orchestra.run.smithi070.stdout:4289 punch from 0x3099fe4 to 0x309ae82, (0xe9e bytes) 2024-09-11T06:19:07.572 INFO:teuthology.orchestra.run.smithi070.stdout:4290 writesame 0xd0115c2 thru 0xd020c97 data_size 0xa(0xf6d6 bytes) 2024-09-11T06:19:07.576 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:07.576+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:07.579 INFO:teuthology.orchestra.run.smithi070.stdout:4291 read 0xa6c1858 thru 0xa6c5cb9 (0x4462 bytes) 2024-09-11T06:19:07.579 INFO:teuthology.orchestra.run.smithi070.stdout:4292 read 0xc00a9ae thru 0xc017268 (0xc8bb bytes) 2024-09-11T06:19:07.580 INFO:teuthology.orchestra.run.smithi070.stdout:4293 write 0x6faa75a thru 0x6faf6dd (0x4f84 bytes) 2024-09-11T06:19:07.582 INFO:teuthology.orchestra.run.smithi070.stdout:4296 punch from 0x5a5aed6 to 0x5a66e01, (0xbf2b bytes) 2024-09-11T06:19:07.582 INFO:teuthology.orchestra.run.smithi070.stdout:4297 writesame 0xd6abaed thru 0xd6b2a6f data_size 0x1(0x6f83 bytes) 2024-09-11T06:19:07.594 INFO:teuthology.orchestra.run.smithi070.stdout:4298 read 0x4be735d thru 0x4bf531a (0xdfbe bytes) 2024-09-11T06:19:07.635 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:07.635 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:07.644 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:07.671 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:07.671+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:07.772 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:07.771+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:07.787 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:07.787 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:07.795 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:07.879 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:07.879+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:07.941 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:07.942 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:07.948 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:07.974 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:07.973+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:08.074 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:08.074+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:08.092 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:08.092 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:08.101 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:08.175 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:08.175+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:08.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:19:08.249 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:08.250 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:08.258 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:08.276 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:08.275+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:08.362 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:08.362 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:08.371 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:08.377 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:08.376+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:08.474 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:08.474 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:08.477 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:08.477+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:08.483 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:08.578 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:08.578+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:08.627 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:08.627 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:08.636 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:08.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:08.720 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:08.719+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:08.774 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:08.774 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:08.779 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:08.779 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:08.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:08.779+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:08.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:08.791 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:08.807 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:08.824 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:08.825 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:08.841 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:08.841 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:08.858 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:08.858 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:08.874 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:08.875 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:08.880 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:08.879+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:08.891 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:08.891 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:08.894 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:08.895 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:08.895 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:08.895 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:08.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:08.988 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:08.987+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:09.047 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:09.048 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:09.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:09.081 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:09.080+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:09.182 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:09.181+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:09.189 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:19:09.206 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130410 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10993664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0586271160000003, 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043187259999999998, 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130410 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146584+0000", 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146592+0000", 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5619999999999998e-06 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146598+0000", 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189643+0000", 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043045091000000001 2024-09-11T06:19:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189704+0000", 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0911e-05 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189769+0000", 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5745000000000002e-05 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130411 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 11001856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0586049749999997, 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043307804999999998, 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130411 2024-09-11T06:19:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146605+0000", 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146613+0000", 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6729999999999998e-06 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146621+0000", 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8849999999999999e-06 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146626+0000", 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9520000000000002e-06 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189802+0000", 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043175603 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189848+0000", 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6465999999999999e-05 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189912+0000", 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3835000000000001e-05 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130444 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10752000~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0585761749999998, 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043428937000000001, 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130444 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146635+0000", 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146642+0000", 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8680000000000001e-06 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146649+0000", 2024-09-11T06:19:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2319999999999998e-06 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189933+0000", 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043284979000000001 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189982+0000", 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8513000000000001e-05 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190062+0000", 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9929e-05 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130445 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10760192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0585486509999997, 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043549156999999998, 2024-09-11T06:19:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130445 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146663+0000", 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146678+0000", 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5201000000000001e-05 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146684+0000", 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190086+0000", 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043401281 2024-09-11T06:19:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190147+0000", 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1246000000000003e-05 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190210+0000", 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2720999999999998e-05 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130446 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10768384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0585115690000002, 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043660235999999998, 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130446 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146700+0000", 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-06 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146709+0000", 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3520000000000007e-06 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146718+0000", 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6830000000000003e-06 2024-09-11T06:19:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190233+0000", 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043514440000000001 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190283+0000", 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0178e-05 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190358+0000", 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4796999999999996e-05 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130447 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10776576~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0584476479999996, 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043732383999999999, 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130447 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146765+0000", 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146782+0000", 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7282000000000002e-05 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146789+0000", 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7279999999999998e-06 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190386+0000", 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043596843000000003 2024-09-11T06:19:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190431+0000", 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5751999999999998e-05 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190494+0000", 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2614999999999996e-05 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130448 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10784768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0584059129999996, 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043831475000000002, 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130448 2024-09-11T06:19:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146811+0000", 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146814+0000", 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.543e-06 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146823+0000", 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8699999999999998e-06 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146828+0000", 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190522+0000", 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043694033 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190572+0000", 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0269999999999998e-05 2024-09-11T06:19:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190635+0000", 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2719999999999996e-05 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130449 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10792960~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0583692569999998, 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043926146999999999, 2024-09-11T06:19:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130449 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8200000000000001e-07 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146842+0000", 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5910000000000001e-06 2024-09-11T06:19:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146852+0000", 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0341e-05 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146855+0000", 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190655+0000", 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043800258000000002 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190706+0000", 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0226999999999999e-05 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190766+0000", 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0517999999999999e-05 2024-09-11T06:19:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130450 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10801152~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0583500509999997, 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044072734000000002, 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130450 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146861+0000", 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3379999999999999e-06 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146865+0000", 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3220000000000003e-06 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146868+0000", 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190792+0000", 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043923845000000003 2024-09-11T06:19:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190853+0000", 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1008999999999998e-05 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190932+0000", 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9326000000000006e-05 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130451 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10809344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0583380169999996, 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044195328999999998, 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130451 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147086+0000", 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021491899999999999 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147096+0000", 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0217999999999999e-05 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147105+0000", 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147112+0000", 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190954+0000", 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043842032000000003 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191004+0000", 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0482999999999998e-05 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191066+0000", 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2420000000000002e-05 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130452 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10817536~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.058088959, 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044100716999999998, 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130452 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147905+0000", 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078465999999999996 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147909+0000", 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2549999999999999e-06 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147919+0000", 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0236e-05 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147927+0000", 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8679999999999999e-06 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191092+0000", 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043164431000000003 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191142+0000", 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9923000000000003e-05 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191221+0000", 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9344000000000005e-05 2024-09-11T06:19:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130453 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10825728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0572484009999998, 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392063000000002, 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130453 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147963+0000", 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.795e-06 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147967+0000", 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9979999999999997e-06 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147970+0000", 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191246+0000", 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043275980999999998 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191291+0000", 2024-09-11T06:19:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5498999999999999e-05 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191353+0000", 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999994e-05 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130454 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10833920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0572352110000001, 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043530384999999998, 2024-09-11T06:19:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130454 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5199999999999998e-07 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147975+0000", 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.195e-06 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147979+0000", 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.196e-06 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147981+0000", 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191374+0000", 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392673 2024-09-11T06:19:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191441+0000", 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191504+0000", 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3602999999999994e-05 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130455 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10842112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0572245650000003, 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043653780000000003, 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130455 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147986+0000", 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.35e-06 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147989+0000", 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147992+0000", 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191525+0000", 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043533080000000002 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191577+0000", 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2506999999999997e-05 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191638+0000", 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0903999999999998e-05 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130456 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10850304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0572141249999998, 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.04379475, 2024-09-11T06:19:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130456 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149579+0000", 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001583877 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149584+0000", 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9359999999999998e-06 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149593+0000", 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2429999999999994e-06 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149598+0000", 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0919999999999997e-06 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191663+0000", 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042064987999999998 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191714+0000", 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0506000000000001e-05 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191790+0000", 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130463 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10907648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0555351389999998, 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043098538999999998, 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130463 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.28e-07 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149679+0000", 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5449999999999997e-06 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149682+0000", 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.455e-06 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149685+0000", 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.526e-06 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192662+0000", 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042976939999999998 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192712+0000", 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0682e-05 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192773+0000", 2024-09-11T06:19:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0163e-05 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130464 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10915840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0555210150000001, 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043257601999999999, 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130464 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149920+0000", 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023134100000000001 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149923+0000", 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000001e-06 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149932+0000", 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7080000000000003e-06 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149939+0000", 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6510000000000001e-06 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192802+0000", 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042862572000000002 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192861+0000", 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9077999999999999e-05 2024-09-11T06:19:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192946+0000", 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4901999999999995e-05 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130465 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10924032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0552620179999996, 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043129278, 2024-09-11T06:19:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130465 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149949+0000", 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.886e-06 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149953+0000", 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149956+0000", 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192970+0000", 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043013844000000002 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193017+0000", 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6530999999999999e-05 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193076+0000", 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9824999999999997e-05 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130466 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10932224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0552494469999996, 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043272974999999998, 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130466 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151901+0000", 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001941356 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151905+0000", 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000003e-06 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151912+0000", 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0679999999999999e-06 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151916+0000", 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9829999999999998e-06 2024-09-11T06:19:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193097+0000", 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041180814000000003 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193161+0000", 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3584000000000007e-05 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193233+0000", 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2074000000000001e-05 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130516 3.1c 3:3f6bd6e9:::rbd_object_map.116df114867d.000000000000003e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0520469639999996, 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043688850000000001, 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130516 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153163+0000", 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8299999999999996e-07 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153168+0000", 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153176+0000", 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153181+0000", 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3539999999999999e-06 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194609+0000", 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041427972 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194661+0000", 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2308999999999997e-05 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194883+0000", 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221466 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196734+0000", 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018515039999999999 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196752+0000", 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7558e-05 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196812+0000", 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9639000000000003e-05 2024-09-11T06:19:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196851+0000", 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9536999999999998e-05 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.299 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:09.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:09.301 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:09.299+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:09.305 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.305 INFO:teuthology.orchestra.run.smithi070.stdout:4300 punch from 0x4f0408e to 0x4f0cab0, (0x8a22 bytes) 2024-09-11T06:19:09.315 INFO:teuthology.orchestra.run.smithi070.stdout:4303 trunc from 0xeadfd70 to 0x6cd8c3d 2024-09-11T06:19:09.362 INFO:teuthology.orchestra.run.smithi070.stdout:4306 writesame 0x8c7ca67 thru 0x8c7f865 data_size 0xf(0x2dff bytes) 2024-09-11T06:19:09.366 INFO:teuthology.orchestra.run.smithi070.stdout:4308 trunc from 0x8c7f866 to 0xb93068b 2024-09-11T06:19:09.376 INFO:teuthology.orchestra.run.smithi070.stdout:4309 read 0xad1cbdf thru 0xad2bff5 (0xf417 bytes) 2024-09-11T06:19:09.376 INFO:teuthology.orchestra.run.smithi070.stdout:4310 read 0x2dcc3bd thru 0x2dd8357 (0xbf9b bytes) 2024-09-11T06:19:09.376 INFO:teuthology.orchestra.run.smithi070.stdout:4312 punch from 0xaa7f84e to 0xaa8890a, (0x90bc bytes) 2024-09-11T06:19:09.377 INFO:teuthology.orchestra.run.smithi070.stdout:4314 read 0x3183108 thru 0x318a18e (0x7087 bytes) 2024-09-11T06:19:09.377 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.377 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.388 INFO:teuthology.orchestra.run.smithi070.stdout:4317 write 0xe7dfcca thru 0xe7e2c6b (0x2fa2 bytes) 2024-09-11T06:19:09.394 INFO:teuthology.orchestra.run.smithi070.stdout:4318 punch from 0x87c4b6c to 0x87d389e, (0xed32 bytes) 2024-09-11T06:19:09.394 INFO:teuthology.orchestra.run.smithi070.stdout:4320 writesame 0xb5acb32 thru 0xb5ad3fc data_size 0x1(0x8cb bytes) 2024-09-11T06:19:09.400 INFO:teuthology.orchestra.run.smithi070.stdout:4321 read 0xbaadb58 thru 0xbab2c3b (0x50e4 bytes) 2024-09-11T06:19:09.400 INFO:teuthology.orchestra.run.smithi070.stdout:4322 write 0x2851932 thru 0x28538e0 (0x1faf bytes) 2024-09-11T06:19:09.401 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:09.400+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:09.401 INFO:teuthology.orchestra.run.smithi070.stdout:4323 punch from 0x82711ac to 0x8277045, (0x5e99 bytes) 2024-09-11T06:19:09.401 INFO:teuthology.orchestra.run.smithi070.stdout:4324 read 0x689b2c1 thru 0x68a1211 (0x5f51 bytes) 2024-09-11T06:19:09.402 INFO:teuthology.orchestra.run.smithi070.stdout:4325 write 0x3d26ffb thru 0x3d35845 (0xe84b bytes) 2024-09-11T06:19:09.404 INFO:teuthology.orchestra.run.smithi070.stdout:4327 read 0x9b20f7b thru 0x9b2bb04 (0xab8a bytes) 2024-09-11T06:19:09.405 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.405 INFO:teuthology.orchestra.run.smithi070.stdout:4331 write 0xa1ca996 thru 0xa1d2757 (0x7dc2 bytes) 2024-09-11T06:19:09.411 INFO:teuthology.orchestra.run.smithi070.stdout:4332 trunc from 0xe7e2c6c to 0xc678100 2024-09-11T06:19:09.422 INFO:teuthology.orchestra.run.smithi070.stdout:4333 write 0x5b8f10 thru 0x5bef99 (0x608a bytes) 2024-09-11T06:19:09.424 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.424 INFO:teuthology.orchestra.run.smithi070.stdout:4335 write 0x11b987a thru 0x11bb6e4 (0x1e6b bytes) 2024-09-11T06:19:09.426 INFO:teuthology.orchestra.run.smithi070.stdout:4336 read 0x8e8a2ae thru 0x8e929b3 (0x8706 bytes) 2024-09-11T06:19:09.426 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.426 INFO:teuthology.orchestra.run.smithi070.stdout:4338 write 0xa7d6410 thru 0xa7e4ac7 (0xe6b8 bytes) 2024-09-11T06:19:09.442 INFO:teuthology.orchestra.run.smithi070.stdout:4340 trunc from 0xc678100 to 0x2a066ea 2024-09-11T06:19:09.442 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:09.443 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:09.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:09.481 INFO:teuthology.orchestra.run.smithi070.stdout:4341 read 0x176895f thru 0x1773cb7 (0xb359 bytes) 2024-09-11T06:19:09.482 INFO:teuthology.orchestra.run.smithi070.stdout:4342 read 0x28dc6aa thru 0x28eb86b (0xf1c2 bytes) 2024-09-11T06:19:09.501 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:09.501+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:09.505 INFO:teuthology.orchestra.run.smithi070.stdout:4344 writesame 0xc352e86 thru 0xc361dca data_size 0x1(0xef45 bytes) 2024-09-11T06:19:09.505 INFO:teuthology.orchestra.run.smithi070.stdout:4345 read 0x7c49abe thru 0x7c4a0f4 (0x637 bytes) 2024-09-11T06:19:09.505 INFO:teuthology.orchestra.run.smithi070.stdout:4346 write 0x7eb2132 thru 0x7ebc28d (0xa15c bytes) 2024-09-11T06:19:09.511 INFO:teuthology.orchestra.run.smithi070.stdout:4349 write 0x99fe5c3 thru 0x9a074e7 (0x8f25 bytes) 2024-09-11T06:19:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:4350 write 0x86bc635 thru 0x86c9346 (0xcd12 bytes) 2024-09-11T06:19:09.522 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.522 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.522 INFO:teuthology.orchestra.run.smithi070.stdout:4356 punch from 0x6a6824b to 0x6a729df, (0xa794 bytes) 2024-09-11T06:19:09.522 INFO:teuthology.orchestra.run.smithi070.stdout:4357 write 0x720b26c thru 0x720fa61 (0x47f6 bytes) 2024-09-11T06:19:09.534 INFO:teuthology.orchestra.run.smithi070.stdout:4358 write 0xdbf58bc thru 0xdbf8a9c (0x31e1 bytes) 2024-09-11T06:19:09.539 INFO:teuthology.orchestra.run.smithi070.stdout:4360 write 0x64cd12d thru 0x64d97a9 (0xc67d bytes) 2024-09-11T06:19:09.547 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.549 INFO:teuthology.orchestra.run.smithi070.stdout:4365 trunc from 0xdbf8a9d to 0xc4ef5e0 2024-09-11T06:19:09.567 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.567 INFO:teuthology.orchestra.run.smithi070.stdout:4367 punch from 0x5db5733 to 0x5dbfcad, (0xa57a bytes) 2024-09-11T06:19:09.567 INFO:teuthology.orchestra.run.smithi070.stdout:4368 punch from 0xaa1d0b7 to 0xaa1f6b9, (0x2602 bytes) 2024-09-11T06:19:09.568 INFO:teuthology.orchestra.run.smithi070.stdout:4369 write 0x827a5ec thru 0x8288b3d (0xe552 bytes) 2024-09-11T06:19:09.575 INFO:teuthology.orchestra.run.smithi070.stdout:4371 punch from 0x342f3e0 to 0x3434478, (0x5098 bytes) 2024-09-11T06:19:09.575 INFO:teuthology.orchestra.run.smithi070.stdout:4374 write 0x4c85660 thru 0x4c89657 (0x3ff8 bytes) 2024-09-11T06:19:09.581 INFO:teuthology.orchestra.run.smithi070.stdout:4376 writesame 0x5ca2a84 thru 0x5ca6cd0 data_size 0x1(0x424d bytes) 2024-09-11T06:19:09.592 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.592 INFO:teuthology.orchestra.run.smithi070.stdout:4380 write 0x7f2afbe thru 0x7f36742 (0xb785 bytes) 2024-09-11T06:19:09.596 INFO:teuthology.orchestra.run.smithi070.stdout:4382 trunc from 0xc4ef5e0 to 0xd81e3e7 2024-09-11T06:19:09.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:09.601+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:09.606 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:09.606 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:09.608 INFO:teuthology.orchestra.run.smithi070.stdout:4383 write 0x938c4ae thru 0x939919a (0xcced bytes) 2024-09-11T06:19:09.613 INFO:teuthology.orchestra.run.smithi070.stdout:4384 read 0xcfe0014 thru 0xcfeb67d (0xb66a bytes) 2024-09-11T06:19:09.613 INFO:teuthology.orchestra.run.smithi070.stdout:4386 punch from 0x3797a63 to 0x379926e, (0x180b bytes) 2024-09-11T06:19:09.613 INFO:teuthology.orchestra.run.smithi070.stdout:4387 punch from 0x7ae15ca to 0x7aedc06, (0xc63c bytes) 2024-09-11T06:19:09.617 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:09.619 INFO:teuthology.orchestra.run.smithi070.stdout:4389 trunc from 0xd81e3e7 to 0x87d286a 2024-09-11T06:19:09.630 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.630 INFO:teuthology.orchestra.run.smithi070.stdout:4391 read 0x78bf930 thru 0x78c3e05 (0x44d6 bytes) 2024-09-11T06:19:09.631 INFO:teuthology.orchestra.run.smithi070.stdout:4392 punch from 0x1a98d3 to 0x1b84f9, (0xec26 bytes) 2024-09-11T06:19:09.641 INFO:teuthology.orchestra.run.smithi070.stdout:4395 write 0xd140766 thru 0xd149a99 (0x9334 bytes) 2024-09-11T06:19:09.645 INFO:teuthology.orchestra.run.smithi070.stdout:4396 write 0x4c87e9c thru 0x4c885a2 (0x707 bytes) 2024-09-11T06:19:09.647 INFO:teuthology.orchestra.run.smithi070.stdout:4398 writesame 0x6a080e8 thru 0x6a0aa7c data_size 0x1(0x2995 bytes) 2024-09-11T06:19:09.657 INFO:teuthology.orchestra.run.smithi070.stdout:4401 trunc from 0xd149a9a to 0x87adc09 2024-09-11T06:19:09.675 INFO:teuthology.orchestra.run.smithi070.stdout:4402 write 0x900cce8 thru 0x90153c8 (0x86e1 bytes) 2024-09-11T06:19:09.679 INFO:teuthology.orchestra.run.smithi070.stdout:4403 punch from 0x43f4519 to 0x43fcc61, (0x8748 bytes) 2024-09-11T06:19:09.691 INFO:teuthology.orchestra.run.smithi070.stdout:4407 writesame 0xde65d14 thru 0xde739e7 data_size 0x2a(0xdcd4 bytes) 2024-09-11T06:19:09.691 INFO:teuthology.orchestra.run.smithi070.stdout:4408 write 0x3075c8f thru 0x307af7b (0x52ed bytes) 2024-09-11T06:19:09.702 INFO:teuthology.orchestra.run.smithi070.stdout:4409 trunc from 0xde739e8 to 0x7a69d7d 2024-09-11T06:19:09.702 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:09.701+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:09.713 INFO:teuthology.orchestra.run.smithi070.stdout:4410 read 0x30b4b83 thru 0x30c0650 (0xbace bytes) 2024-09-11T06:19:09.713 INFO:teuthology.orchestra.run.smithi070.stdout:4411 read 0x317bb08 thru 0x318680e (0xad07 bytes) 2024-09-11T06:19:09.713 INFO:teuthology.orchestra.run.smithi070.stdout:4412 punch from 0x6879169 to 0x68810fa, (0x7f91 bytes) 2024-09-11T06:19:09.724 INFO:teuthology.orchestra.run.smithi070.stdout:4413 write 0xba49da8 thru 0xba5881c (0xea75 bytes) 2024-09-11T06:19:09.727 INFO:teuthology.orchestra.run.smithi070.stdout:4415 read 0x6e4edd0 thru 0x6e50108 (0x1339 bytes) 2024-09-11T06:19:09.728 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.728 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.728 INFO:teuthology.orchestra.run.smithi070.stdout:4421 read 0x1555ad3 thru 0x155fc89 (0xa1b7 bytes) 2024-09-11T06:19:09.733 INFO:teuthology.orchestra.run.smithi070.stdout:4422 write 0xbb884fc thru 0xbb9842b (0xff30 bytes) 2024-09-11T06:19:09.738 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:09.738 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118743 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6183086670000009, 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99346091199999997, 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118743 2024-09-11T06:19:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118559+0000", 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118568+0000", 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4279999999999996e-06 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118589+0000", 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1129999999999999e-05 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118599+0000", 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8789999999999998e-06 2024-09-11T06:19:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118670+0000", 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1087999999999994e-05 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118679+0000", 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.115e-06 2024-09-11T06:19:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111727+0000", 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99304786499999997 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111848+0000", 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121347 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112017+0000", 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016935499999999999 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118751 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6180072669999994, 2024-09-11T06:19:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99440886299999998, 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118751 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.85e-07 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118863+0000", 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2741999999999999e-05 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118884+0000", 2024-09-11T06:19:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7109999999999995e-06 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118951+0000", 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7347000000000004e-05 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118958+0000", 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0180000000000004e-06 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113102+0000", 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99414409999999998 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113179+0000", 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113267+0000", 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7745999999999996e-05 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118759 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6176995250000008, 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99428308499999996, 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118759 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119167+0000", 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119173+0000", 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0859999999999998e-06 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119187+0000", 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4133e-05 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119194+0000", 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-06 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119251+0000", 2024-09-11T06:19:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6063999999999997e-05 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119259+0000", 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9750000000000007e-06 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113295+0000", 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99403649000000005 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113370+0000", 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5266999999999996e-05 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113449+0000", 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8396e-05 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118767 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6174006490000004, 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99424699400000005, 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118767 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119465+0000", 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2500000000000004e-07 2024-09-11T06:19:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119472+0000", 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3330000000000002e-06 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119485+0000", 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2782999999999999e-05 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9830000000000002e-06 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119548+0000", 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4274000000000002e-05 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113477+0000", 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99392198799999998 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113607+0000", 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012957600000000001 2024-09-11T06:19:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113711+0000", 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104832 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118775 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6170836749999999, 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99457822699999998, 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118775 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119782+0000", 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4e-07 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119787+0000", 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119800+0000", 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3728e-05 2024-09-11T06:19:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119808+0000", 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.661e-06 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119865+0000", 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7345000000000001e-05 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119876+0000", 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0393e-05 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114042+0000", 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99416629599999995 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114146+0000", 2024-09-11T06:19:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104091 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114360+0000", 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000213544 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118783 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.6167651860000003, 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99444126499999996, 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118783 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120101+0000", 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120105+0000", 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6269999999999999e-06 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120117+0000", 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1858999999999999e-05 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120122+0000", 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9439999999999996e-06 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1106999999999998e-05 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120168+0000", 2024-09-11T06:19:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6870000000000002e-06 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114344+0000", 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.994176328 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114440+0000", 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6028999999999998e-05 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114541+0000", 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100813 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.616477175, 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119571 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 13369344~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6092268900000004, 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018023052000000001, 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119571 2024-09-11T06:19:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127639+0000", 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127641+0000", 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.514e-06 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127648+0000", 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5880000000000003e-06 2024-09-11T06:19:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127652+0000", 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7500000000000003e-06 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145548+0000", 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017895155999999999 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145596+0000", 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8792999999999999e-05 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145661+0000", 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4869000000000005e-05 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119572 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 14286848~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6092062479999996, 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018157623000000001, 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119572 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:19:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127661+0000", 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127669+0000", 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6380000000000004e-06 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127673+0000", 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7620000000000003e-06 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145694+0000", 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018020806 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145758+0000", 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3770999999999996e-05 2024-09-11T06:19:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145816+0000", 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8476000000000001e-05 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119573 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 15204352~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.609167158, 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018351035000000002, 2024-09-11T06:19:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119573 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127699+0000", 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-07 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127718+0000", 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9667999999999999e-05 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127727+0000", 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6999999999999997e-06 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127733+0000", 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145846+0000", 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018113073 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145959+0000", 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011347 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146049+0000", 2024-09-11T06:19:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9926000000000006e-05 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119574 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6091252489999999, 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018368603000000001, 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119574 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127742+0000", 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8109999999999999e-06 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127749+0000", 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5749999999999997e-06 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127764+0000", 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5361000000000001e-05 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146094+0000", 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01833015 2024-09-11T06:19:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146108+0000", 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4265e-05 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119575 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6090931620000006, 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018387018000000001, 2024-09-11T06:19:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119575 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6899999999999998e-07 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127775+0000", 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1110000000000002e-06 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127781+0000", 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4969999999999998e-06 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127786+0000", 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146148+0000", 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018362195000000001 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146159+0000", 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0903e-05 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119576 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6090723889999996, 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018419563, 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119576 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127795+0000", 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127802+0000", 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.489e-06 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127806+0000", 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7430000000000002e-06 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146199+0000", 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018393093999999999 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146212+0000", 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2812e-05 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119577 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6090521930000001, 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018434368, 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119577 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127837+0000", 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3349999999999998e-05 2024-09-11T06:19:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127844+0000", 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2080000000000003e-06 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127849+0000", 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146235+0000", 2024-09-11T06:19:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018386120999999998 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146247+0000", 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119578 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6090088910000002, 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018438821000000001, 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119578 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127857+0000", 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127859+0000", 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127865+0000", 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127870+0000", 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8879999999999996e-06 2024-09-11T06:19:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146285+0000", 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018414950999999999 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146295+0000", 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7650000000000005e-06 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119579 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6089883149999995, 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018456706999999999, 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119579 2024-09-11T06:19:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127879+0000", 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8640000000000001e-06 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127886+0000", 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:19:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127891+0000", 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0080000000000002e-06 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146323+0000", 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018431811999999999 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146334+0000", 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0814e-05 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119721 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6064870800000008, 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018040231, 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119721 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130397+0000", 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8663000000000001e-05 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130406+0000", 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9619999999999999e-06 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130412+0000", 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4210000000000003e-06 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148411+0000", 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017999004999999998 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148418+0000", 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7519999999999996e-06 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119722 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6064348210000006, 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018031229999999999, 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119722 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130431+0000", 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1800000000000005e-07 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130434+0000", 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4450000000000001e-06 2024-09-11T06:19:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130442+0000", 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130448+0000", 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4519999999999996e-06 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148451+0000", 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01800295 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148462+0000", 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0828e-05 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119723 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6064090810000007, 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018050743000000001, 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119723 2024-09-11T06:19:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130457+0000", 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000001e-07 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130459+0000", 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0549999999999998e-06 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130466+0000", 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130477+0000", 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878999999999999e-05 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148496+0000", 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018784999999999 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148507+0000", 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0550000000000001e-05 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119724 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6063794780000009, 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038285000000001, 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119724 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5699999999999998e-07 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130488+0000", 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3709999999999998e-06 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130495+0000", 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9260000000000003e-06 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130500+0000", 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9400000000000001e-06 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148519+0000", 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018688000000001 2024-09-11T06:19:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148524+0000", 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:09.838 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:09.839 INFO:teuthology.orchestra.run.smithi070.stdout:4423 write 0xedc16c4 thru 0xedc27d8 (0x1115 bytes) 2024-09-11T06:19:09.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:09.842 INFO:teuthology.orchestra.run.smithi070.stdout:4424 read 0x49a1096 thru 0x49a5a37 (0x49a2 bytes) 2024-09-11T06:19:09.842 INFO:teuthology.orchestra.run.smithi070.stdout:4425 write 0x21021aa thru 0x210bd35 (0x9b8c bytes) 2024-09-11T06:19:09.842 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.842 INFO:teuthology.orchestra.run.smithi070.stdout:4428 punch from 0xbf67d9c to 0xbf77167, (0xf3cb bytes) 2024-09-11T06:19:09.842 INFO:teuthology.orchestra.run.smithi070.stdout:4429 write 0x9be9eb thru 0x9c8668 (0x9c7e bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4431 write 0xa36d2cb thru 0xa36ff2c (0x2c62 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4433 write 0x27e11e3 thru 0x27efcd8 (0xeaf6 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4434 punch from 0x7e08d6a to 0x7e147ea, (0xba80 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4435 read 0x8c91e6e thru 0x8c9e5b2 (0xc745 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4436 write 0xa52b6a1 thru 0xa5368bd (0xb21d bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4438 write 0xa94d9a4 thru 0xa957648 (0x9ca5 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4439 writesame 0xc91031e thru 0xc9120c4 data_size 0x1(0x1da7 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4440 write 0xa454d92 thru 0xa458325 (0x3594 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4441 write 0xd86fdd5 thru 0xd87c497 (0xc6c3 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4443 punch from 0x3c1e0e7 to 0x3c279cf, (0x98e8 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4444 write 0x6e2dd05 thru 0x6e36cf7 (0x8ff3 bytes) 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4445 trunc from 0xedc27d9 to 0x38ce6ed 2024-09-11T06:19:09.843 INFO:teuthology.orchestra.run.smithi070.stdout:4446 punch from 0x254d34 to 0x260e9d, (0xc169 bytes) 2024-09-11T06:19:09.844 INFO:teuthology.orchestra.run.smithi070.stdout:4447 punch from 0x3468891 to 0x346feec, (0x765b bytes) 2024-09-11T06:19:09.844 INFO:teuthology.orchestra.run.smithi070.stdout:4448 trunc from 0x38ce6ed to 0x2a95b40 2024-09-11T06:19:09.844 INFO:teuthology.orchestra.run.smithi070.stdout:4449 trunc from 0x2a95b40 to 0xd7f8089 2024-09-11T06:19:09.844 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:09.839+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:09.847 INFO:teuthology.orchestra.run.smithi070.stdout:4450 punch from 0x681f50c to 0x6823750, (0x4244 bytes) 2024-09-11T06:19:09.847 INFO:teuthology.orchestra.run.smithi070.stdout:4451 punch from 0xc787ad to 0xc7d04f, (0x48a2 bytes) 2024-09-11T06:19:09.847 INFO:teuthology.orchestra.run.smithi070.stdout:4452 read 0xc72d635 thru 0xc7320f6 (0x4ac2 bytes) 2024-09-11T06:19:09.847 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.848 INFO:teuthology.orchestra.run.smithi070.stdout:4455 read 0x440c260 thru 0x440e1cf (0x1f70 bytes) 2024-09-11T06:19:09.848 INFO:teuthology.orchestra.run.smithi070.stdout:4456 read 0x809b7b7 thru 0x80a9f3b (0xe785 bytes) 2024-09-11T06:19:09.848 INFO:teuthology.orchestra.run.smithi070.stdout:4457 punch from 0x965ed60 to 0x966ea70, (0xfd10 bytes) 2024-09-11T06:19:09.848 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.848 INFO:teuthology.orchestra.run.smithi070.stdout:4459 read 0x8825a8f thru 0x882931c (0x388e bytes) 2024-09-11T06:19:09.848 INFO:teuthology.orchestra.run.smithi070.stdout:4460 writesame 0x3b61b08 thru 0x3b665ea data_size 0x1(0x4ae3 bytes) 2024-09-11T06:19:09.858 INFO:teuthology.orchestra.run.smithi070.stdout:4461 trunc from 0xd7f8089 to 0xb7d360a 2024-09-11T06:19:09.872 INFO:teuthology.orchestra.run.smithi070.stdout:4463 write 0xcd83d47 thru 0xcd8b45e (0x7718 bytes) 2024-09-11T06:19:09.876 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.876 INFO:teuthology.orchestra.run.smithi070.stdout:4467 write 0xa4f3277 thru 0xa4f6e46 (0x3bd0 bytes) 2024-09-11T06:19:09.880 INFO:teuthology.orchestra.run.smithi070.stdout:4468 punch from 0x295478 to 0x296a6f, (0x15f7 bytes) 2024-09-11T06:19:09.881 INFO:teuthology.orchestra.run.smithi070.stdout:4469 read 0xae22429 thru 0xae2f129 (0xcd01 bytes) 2024-09-11T06:19:09.881 INFO:teuthology.orchestra.run.smithi070.stdout:4470 writesame 0x73d813e thru 0x73e6f3a data_size 0x5(0xedfd bytes) 2024-09-11T06:19:09.888 INFO:teuthology.orchestra.run.smithi070.stdout:4471 write 0x974a23d thru 0x9759c25 (0xf9e9 bytes) 2024-09-11T06:19:09.892 INFO:teuthology.orchestra.run.smithi070.stdout:4472 read 0xb6bc9f3 thru 0xb6c401a (0x7628 bytes) 2024-09-11T06:19:09.892 INFO:teuthology.orchestra.run.smithi070.stdout:4475 write 0xaff1384 thru 0xaff85f0 (0x726d bytes) 2024-09-11T06:19:09.897 INFO:teuthology.orchestra.run.smithi070.stdout:4477 read 0x23c5488 thru 0x23c587b (0x3f4 bytes) 2024-09-11T06:19:09.897 INFO:teuthology.orchestra.run.smithi070.stdout:4478 write 0x234375e thru 0x2349289 (0x5b2c bytes) 2024-09-11T06:19:09.899 INFO:teuthology.orchestra.run.smithi070.stdout:4479 read 0x634aa55 thru 0x6355dbf (0xb36b bytes) 2024-09-11T06:19:09.899 INFO:teuthology.orchestra.run.smithi070.stdout:4480 punch from 0x7061c35 to 0x706a17e, (0x8549 bytes) 2024-09-11T06:19:09.899 INFO:teuthology.orchestra.run.smithi070.stdout:4482 write 0xb05df2b thru 0xb06af2d (0xd003 bytes) 2024-09-11T06:19:09.904 INFO:teuthology.orchestra.run.smithi070.stdout:4484 punch from 0x853a014 to 0x8547811, (0xd7fd bytes) 2024-09-11T06:19:09.904 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.904 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:09.905 INFO:teuthology.orchestra.run.smithi070.stdout:4488 write 0xc151f93 thru 0xc152cf3 (0xd61 bytes) 2024-09-11T06:19:09.910 INFO:teuthology.orchestra.run.smithi070.stdout:4489 write 0x6266ad2 thru 0x62761fc (0xf72b bytes) 2024-09-11T06:19:09.914 INFO:teuthology.orchestra.run.smithi070.stdout:4490 writesame 0x177408d thru 0x17795cf data_size 0x17(0x5543 bytes) 2024-09-11T06:19:09.928 INFO:teuthology.orchestra.run.smithi070.stdout:4491 trunc from 0xcd8b45f to 0x38d833b 2024-09-11T06:19:09.940 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:09.939+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:09.957 INFO:teuthology.orchestra.run.smithi070.stdout:4492 writesame 0x9fa7628 thru 0x9fb4fbc data_size 0x9(0xd995 bytes) 2024-09-11T06:19:09.965 INFO:teuthology.orchestra.run.smithi070.stdout:4493 trunc from 0x9fb4fbd to 0x44df353 2024-09-11T06:19:09.970 INFO:teuthology.orchestra.run.smithi070.stdout:4494 punch from 0x1e64199 to 0x1e70df2, (0xcc59 bytes) 2024-09-11T06:19:09.978 INFO:teuthology.orchestra.run.smithi070.stdout:4495 write 0x5b23582 thru 0x5b23f81 (0xa00 bytes) 2024-09-11T06:19:09.980 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:09.980 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:09.981 INFO:teuthology.orchestra.run.smithi070.stdout:4496 writesame 0x55e2444 thru 0x55f0dcd data_size 0x2(0xe98a bytes) 2024-09-11T06:19:09.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:09.994 INFO:teuthology.orchestra.run.smithi070.stdout:4497 writesame 0x531abca thru 0x531d730 data_size 0x1(0x2b67 bytes) 2024-09-11T06:19:10.002 INFO:teuthology.orchestra.run.smithi070.stdout:4498 read 0x2f61cd3 thru 0x2f6228e (0x5bc bytes) 2024-09-11T06:19:10.002 INFO:teuthology.orchestra.run.smithi070.stdout:4500 read 0x2826204 thru 0x2826d1c (0xb19 bytes) 2024-09-11T06:19:10.003 INFO:teuthology.orchestra.run.smithi070.stdout:4502 punch from 0x7abf82 to 0x7b2ae9, (0x6b67 bytes) 2024-09-11T06:19:10.003 INFO:teuthology.orchestra.run.smithi070.stdout:4503 writesame 0x1dde834 thru 0x1ded1f3 data_size 0x5(0xe9c0 bytes) 2024-09-11T06:19:10.008 INFO:teuthology.orchestra.run.smithi070.stdout:4504 read 0xaa24f thru 0xaf4df (0x5291 bytes) 2024-09-11T06:19:10.008 INFO:teuthology.orchestra.run.smithi070.stdout:4505 read 0x51f6e2f thru 0x51ff0a8 (0x827a bytes) 2024-09-11T06:19:10.012 INFO:teuthology.orchestra.run.smithi070.stdout:4506 trunc from 0x5b23f82 to 0x8f7163e 2024-09-11T06:19:10.018 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:10.018 INFO:teuthology.orchestra.run.smithi070.stdout:4508 writesame 0x50b0c21 thru 0x50b2824 data_size 0x16(0x1c04 bytes) 2024-09-11T06:19:10.022 INFO:teuthology.orchestra.run.smithi070.stdout:4509 write 0x4b17195 thru 0x4b1ee7c (0x7ce8 bytes) 2024-09-11T06:19:10.027 INFO:teuthology.orchestra.run.smithi070.stdout:4510 punch from 0x306836f to 0x306b4ea, (0x317b bytes) 2024-09-11T06:19:10.027 INFO:teuthology.orchestra.run.smithi070.stdout:4511 writesame 0x7d373f1 thru 0x7d45007 data_size 0x7(0xdc17 bytes) 2024-09-11T06:19:10.032 INFO:teuthology.orchestra.run.smithi070.stdout:4512 writesame 0x28a77f0 thru 0x28b0616 data_size 0x1(0x8e27 bytes) 2024-09-11T06:19:10.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:10.040+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:10.042 INFO:teuthology.orchestra.run.smithi070.stdout:4513 write 0x1c44162 thru 0x1c4d901 (0x97a0 bytes) 2024-09-11T06:19:10.043 INFO:teuthology.orchestra.run.smithi070.stdout:4514 read 0x3ee59bb thru 0x3eefe0f (0xa455 bytes) 2024-09-11T06:19:10.044 INFO:teuthology.orchestra.run.smithi070.stdout:4516 write 0x6fb5d76 thru 0x6fc2044 (0xc2cf bytes) 2024-09-11T06:19:10.047 INFO:teuthology.orchestra.run.smithi070.stdout:4517 read 0x6240b1 thru 0x63270b (0xe65b bytes) 2024-09-11T06:19:10.048 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:10.048 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:10.048 INFO:teuthology.orchestra.run.smithi070.stdout:4521 write 0x4d0f8f thru 0x4dcff4 (0xc066 bytes) 2024-09-11T06:19:10.059 INFO:teuthology.orchestra.run.smithi070.stdout:4522 writesame 0xbf5afe6 thru 0xbf68b29 data_size 0x2(0xdb44 bytes) 2024-09-11T06:19:10.062 INFO:teuthology.orchestra.run.smithi070.stdout:4523 trunc from 0xbf68b2a to 0xe9610c5 2024-09-11T06:19:10.067 INFO:teuthology.orchestra.run.smithi070.stdout:4524 read 0x6fccf4f thru 0x6fd2c99 (0x5d4b bytes) 2024-09-11T06:19:10.068 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:10.068 INFO:teuthology.orchestra.run.smithi070.stdout:4527 write 0x1291586 thru 0x129fee9 (0xe964 bytes) 2024-09-11T06:19:10.069 INFO:teuthology.orchestra.run.smithi070.stdout:4528 read 0x10816eb thru 0x1089e7a (0x8790 bytes) 2024-09-11T06:19:10.070 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:10.070 INFO:teuthology.orchestra.run.smithi070.stdout:4530 read 0x61a3fbb thru 0x61ae9ce (0xaa14 bytes) 2024-09-11T06:19:10.070 INFO:teuthology.orchestra.run.smithi070.stdout:4531 punch from 0x660de45 to 0x661a81b, (0xc9d6 bytes) 2024-09-11T06:19:10.070 INFO:teuthology.orchestra.run.smithi070.stdout:4533 read 0xd3f8804 thru 0xd402e2d (0xa62a bytes) 2024-09-11T06:19:10.071 INFO:teuthology.orchestra.run.smithi070.stdout:4534 write 0x3f98cf5 thru 0x3fa53a2 (0xc6ae bytes) 2024-09-11T06:19:10.074 INFO:teuthology.orchestra.run.smithi070.stdout:4535 read 0x52113eb thru 0x5215bb6 (0x47cc bytes) 2024-09-11T06:19:10.074 INFO:teuthology.orchestra.run.smithi070.stdout:4536 read 0xcdb3197 thru 0xcdbc628 (0x9492 bytes) 2024-09-11T06:19:10.091 INFO:teuthology.orchestra.run.smithi070.stdout:4539 trunc from 0xe9610c5 to 0x7e27ed 2024-09-11T06:19:10.117 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:10.118 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:10.122 INFO:teuthology.orchestra.run.smithi070.stdout:4540 read 0x2a6c7b thru 0x2b051a (0x98a0 bytes) 2024-09-11T06:19:10.123 INFO:teuthology.orchestra.run.smithi070.stdout:4541 read 0x5f7920 thru 0x5facba (0x339b bytes) 2024-09-11T06:19:10.124 INFO:teuthology.orchestra.run.smithi070.stdout:4543 punch from 0x226d7a to 0x22da9e, (0x6d24 bytes) 2024-09-11T06:19:10.124 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:10.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:10.133 INFO:teuthology.orchestra.run.smithi070.stdout:4547 write 0x44b8d74 thru 0x44c51e7 (0xc474 bytes) 2024-09-11T06:19:10.137 INFO:teuthology.orchestra.run.smithi070.stdout:4549 clone 31 order 21 su 32768 sc 6 2024-09-11T06:19:10.142 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:10.141+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.434901, 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:19:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:19:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:19:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.098547062999998, 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:19:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.098527722999997, 2024-09-11T06:19:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:19:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.098509374000002, 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.098491189999997, 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:19:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:19:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.098472403999999, 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:19:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.098453405000001, 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:19:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:19:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.098424815999998, 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:19:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.098211689999999, 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:19:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:19:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095656802999997, 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:19:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:19:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095633112000002, 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:19:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095613086, 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:19:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095571530999997, 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095547588000002, 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.09552618, 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:19:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095505392, 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:19:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095485357000001, 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:19:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095465220000001, 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:19:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095443222999997, 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:19:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:19:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.095423158000003, 2024-09-11T06:19:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:19:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:19:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.335 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:10.336 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:10.337 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:10.336+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:10.437 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:10.436+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:10.481 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:10.481 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:10.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:10.574 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:10.573+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:10.632 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:10.633 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:10.639 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:10.638+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:10.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:10.740 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:10.739+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:10.786 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 131.16502132299999, 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:19:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 130.870585745, 2024-09-11T06:19:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:19:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:19:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.604022551, 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:19:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.640339959999999, 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.640322533999999, 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:19:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:19:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.640305278, 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:19:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.666095081, 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:19:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:19:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.666002379, 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.665796568999999, 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:19:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.665711002, 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:19:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:19:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.665497744, 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:19:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:19:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.665414425, 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:19:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:19:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.665157541999999, 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.665096103, 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.664850277999999, 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:19:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:19:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.664782151000001, 2024-09-11T06:19:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.664514489, 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.664442448999999, 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:19:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.66427169, 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:19:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:19:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.664166469, 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:19:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:10.892 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:10.893 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:10.894 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:10.893+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:10.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:10.993 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:10.993+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:11.018 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:11.054 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:11.054 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:11.070 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:11.086 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:11.086 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:11.101 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:11.101+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:11.102 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:11.102 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:11.122 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:11.122 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:11.142 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:11.142 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:11.160 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:11.161 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:11.173 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:11.173 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:11.178 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:11.178 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:11.183 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:11.195 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:11.194+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:11.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:19:11.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:11.295+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:11.328 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:11.328 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:11.336 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:11.397 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:11.397+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:11.480 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:11.480 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:11.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:11.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:11.532+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:11.592 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:11.610 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:11.611 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:11.612 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:11.610+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:11.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:11.711+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:11.754 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:11.755 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:11.763 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:11.848 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:11.847+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:11.906 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:11.906 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:11.913 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:11.912+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:11.914 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:12.014 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:12.014+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:12.057 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:12.057 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:12.065 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:12.109 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:19:12.150 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:12.149+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:12.199 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:19:12.199 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:19:12.199 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-11T06:19:12.199 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T06:19:12.200 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T06:19:12.200 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-11T06:19:12.232 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:12.233 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:12.233 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:12.231+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:12.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:12.308 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:12.308 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T06:19:12.308 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:12.316 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:12.316+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:12.385 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:12.385 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:12.394 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:12.438 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:12.437+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:12.497 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:12.497 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:12.506 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:12.518 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:12.517+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:12.618 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:12.618+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:12.650 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:12.650 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:12.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:12.719 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:12.718+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:12.769 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:12.770 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:12.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:12.820 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:12.819+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:12.921 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:12.920+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:12.921 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:12.921 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:12.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:13.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:13.021+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:13.032 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:13.032 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:13.041 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:13.123 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:13.122+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:13.144 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:13.144 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:13.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:13.190 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:13.240 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:13.239+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:13.262 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:13.262 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:13.271 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-11T06:19:13.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:13.349 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:13.350 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:13.350 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:13.349+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:13.378 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:13.406 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:13.406 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:13.424 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:13.425 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:13.424+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:13.431 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118743 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.311635182, 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99346091199999997, 2024-09-11T06:19:13.432 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118743 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118559+0000", 2024-09-11T06:19:13.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118568+0000", 2024-09-11T06:19:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4279999999999996e-06 2024-09-11T06:19:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118589+0000", 2024-09-11T06:19:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1129999999999999e-05 2024-09-11T06:19:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118599+0000", 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8789999999999998e-06 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118670+0000", 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1087999999999994e-05 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118679+0000", 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.115e-06 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111727+0000", 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99304786499999997 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111848+0000", 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121347 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112017+0000", 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016935499999999999 2024-09-11T06:19:13.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118751 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.311333782, 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99440886299999998, 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118751 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.85e-07 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118863+0000", 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2741999999999999e-05 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118884+0000", 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7109999999999995e-06 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118951+0000", 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7347000000000004e-05 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118958+0000", 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0180000000000004e-06 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113102+0000", 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99414409999999998 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113179+0000", 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113267+0000", 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7745999999999996e-05 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118759 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:13.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.31102604, 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99428308499999996, 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118759 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119167+0000", 2024-09-11T06:19:13.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119173+0000", 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0859999999999998e-06 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119187+0000", 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4133e-05 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119194+0000", 2024-09-11T06:19:13.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-06 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119251+0000", 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6063999999999997e-05 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119259+0000", 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9750000000000007e-06 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113295+0000", 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99403649000000005 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113370+0000", 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5266999999999996e-05 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113449+0000", 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8396e-05 2024-09-11T06:19:13.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118767 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.310727163999999, 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99424699400000005, 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118767 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119465+0000", 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2500000000000004e-07 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119472+0000", 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3330000000000002e-06 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119485+0000", 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2782999999999999e-05 2024-09-11T06:19:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9830000000000002e-06 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119548+0000", 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4274000000000002e-05 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:13.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113477+0000", 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99392198799999998 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113607+0000", 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012957600000000001 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113711+0000", 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104832 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118775 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.310410190000001, 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99457822699999998, 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118775 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:13.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119782+0000", 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4e-07 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119787+0000", 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119800+0000", 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3728e-05 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119808+0000", 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.661e-06 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119865+0000", 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7345000000000001e-05 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119876+0000", 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0393e-05 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114042+0000", 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99416629599999995 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114146+0000", 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104091 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114360+0000", 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000213544 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118783 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.310091700999999, 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99444126499999996, 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118783 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120101+0000", 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120105+0000", 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6269999999999999e-06 2024-09-11T06:19:13.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120117+0000", 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1858999999999999e-05 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120122+0000", 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9439999999999996e-06 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1106999999999998e-05 2024-09-11T06:19:13.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120168+0000", 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6870000000000002e-06 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114344+0000", 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.994176328 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114440+0000", 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6028999999999998e-05 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114541+0000", 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100813 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:13.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.309803690000001, 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:13.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119571 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 13369344~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.302553404999999, 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018023052000000001, 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119571 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127638+0000", 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127639+0000", 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:13.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127641+0000", 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.514e-06 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127648+0000", 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5880000000000003e-06 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127652+0000", 2024-09-11T06:19:13.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7500000000000003e-06 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145548+0000", 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017895155999999999 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145596+0000", 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8792999999999999e-05 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145661+0000", 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4869000000000005e-05 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119572 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 14286848~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.302532763, 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018157623000000001, 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119572 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127661+0000", 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127669+0000", 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6380000000000004e-06 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127673+0000", 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7620000000000003e-06 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145694+0000", 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018020806 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145758+0000", 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3770999999999996e-05 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145816+0000", 2024-09-11T06:19:13.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8476000000000001e-05 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119573 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 15204352~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.302493673000001, 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018351035000000002, 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119573 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127699+0000", 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-07 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127718+0000", 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9667999999999999e-05 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127727+0000", 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6999999999999997e-06 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127733+0000", 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145846+0000", 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018113073 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145959+0000", 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011347 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146049+0000", 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9926000000000006e-05 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.484 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119574 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.302451764000001, 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018368603000000001, 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119574 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127742+0000", 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8109999999999999e-06 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127749+0000", 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5749999999999997e-06 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127764+0000", 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5361000000000001e-05 2024-09-11T06:19:13.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146094+0000", 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01833015 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146108+0000", 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4265e-05 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119575 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.302419677, 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018387018000000001, 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119575 2024-09-11T06:19:13.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6899999999999998e-07 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127775+0000", 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1110000000000002e-06 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127781+0000", 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4969999999999998e-06 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127786+0000", 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146148+0000", 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018362195000000001 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146159+0000", 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0903e-05 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119576 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.302398904, 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018419563, 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119576 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:13.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127795+0000", 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127802+0000", 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.489e-06 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127806+0000", 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7430000000000002e-06 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146199+0000", 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018393093999999999 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146212+0000", 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2812e-05 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.497 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119577 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.302378707999999, 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018434368, 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119577 2024-09-11T06:19:13.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127837+0000", 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3349999999999998e-05 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127844+0000", 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2080000000000003e-06 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127849+0000", 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146235+0000", 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018386120999999998 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146247+0000", 2024-09-11T06:19:13.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-09-11T06:19:13.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.503 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119578 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.503 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:13.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.302335405999999, 2024-09-11T06:19:13.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018438821000000001, 2024-09-11T06:19:13.503 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119578 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127857+0000", 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127859+0000", 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T06:19:13.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127865+0000", 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127870+0000", 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8879999999999996e-06 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146285+0000", 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018414950999999999 2024-09-11T06:19:13.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146295+0000", 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7650000000000005e-06 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119579 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.30231483, 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018456706999999999, 2024-09-11T06:19:13.507 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119579 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127879+0000", 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8640000000000001e-06 2024-09-11T06:19:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127886+0000", 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127891+0000", 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0080000000000002e-06 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146323+0000", 2024-09-11T06:19:13.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018431811999999999 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146334+0000", 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0814e-05 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119721 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.299813595, 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018040231, 2024-09-11T06:19:13.511 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119721 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:19:13.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130397+0000", 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8663000000000001e-05 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130406+0000", 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9619999999999999e-06 2024-09-11T06:19:13.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130412+0000", 2024-09-11T06:19:13.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4210000000000003e-06 2024-09-11T06:19:13.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148411+0000", 2024-09-11T06:19:13.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017999004999999998 2024-09-11T06:19:13.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148418+0000", 2024-09-11T06:19:13.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7519999999999996e-06 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119722 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.299761336, 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018031229999999999, 2024-09-11T06:19:13.517 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119722 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130431+0000", 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1800000000000005e-07 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130434+0000", 2024-09-11T06:19:13.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4450000000000001e-06 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130442+0000", 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130448+0000", 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4519999999999996e-06 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148451+0000", 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01800295 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148462+0000", 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0828e-05 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119723 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.521 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.299735596, 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018050743000000001, 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119723 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130457+0000", 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000001e-07 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130459+0000", 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0549999999999998e-06 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130466+0000", 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130477+0000", 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878999999999999e-05 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148496+0000", 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018784999999999 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148507+0000", 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0550000000000001e-05 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119724 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:13.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:13.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.299705993, 2024-09-11T06:19:13.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038285000000001, 2024-09-11T06:19:13.526 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:13.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119724 2024-09-11T06:19:13.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:13.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:13.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:13.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5699999999999998e-07 2024-09-11T06:19:13.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130488+0000", 2024-09-11T06:19:13.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3709999999999998e-06 2024-09-11T06:19:13.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130495+0000", 2024-09-11T06:19:13.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9260000000000003e-06 2024-09-11T06:19:13.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130500+0000", 2024-09-11T06:19:13.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9400000000000001e-06 2024-09-11T06:19:13.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148519+0000", 2024-09-11T06:19:13.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018688000000001 2024-09-11T06:19:13.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148524+0000", 2024-09-11T06:19:13.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:19:13.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.535 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:13.537 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:13.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:13.538 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:13.539 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:13.539 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:13.540 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:13.540 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:13.541 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:13.542 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:13.543 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:13.535+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:13.543 INFO:teuthology.orchestra.run.smithi070.stdout:4551 punch from 0xacc961 to 0xad657f, (0x9c1e bytes) 2024-09-11T06:19:13.544 INFO:teuthology.orchestra.run.smithi070.stdout:4552 trunc from 0x44c51e8 to 0xea45d8d 2024-09-11T06:19:13.544 INFO:teuthology.orchestra.run.smithi070.stdout:4553 clone 32 order 21 su 524288 sc 13 2024-09-11T06:19:13.637 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:13.636+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:13.681 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:13.681 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:13.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:13.775 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:13.774+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:13.834 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:13.834 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:13.834 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:13.834 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:13.834 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:13.838 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:13.838+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:13.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:13.939 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:13.938+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:13.987 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:13.987 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:13.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:13.987 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:13.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.987 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:19:13.987 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:13.987 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 114.18194380200001, 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:19:13.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:13.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:13.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845589865000001, 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:13.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:13.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.997 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845570524999999, 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:13.998 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:13.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.002 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845552175999998, 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:19:14.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:19:14.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845533992, 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:19:14.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:14.011 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845515206000002, 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:14.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845496206999997, 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:19:14.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:19:14.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845467618000001, 2024-09-11T06:19:14.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:19:14.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:19:14.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845254492000002, 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.025 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:19:14.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:19:14.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842699605, 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:19:14.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842675913999997, 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:19:14.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:19:14.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:19:14.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842655888000003, 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:19:14.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:19:14.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:14.042 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842614333, 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842590389999998, 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:19:14.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:19:14.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842568982000003, 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:19:14.051 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:19:14.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:19:14.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842548194000003, 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:19:14.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:19:14.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842528158999997, 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:19:14.060 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:19:14.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842508021999997, 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:19:14.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842486024999999, 2024-09-11T06:19:14.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:19:14.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:19:14.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.842465959999998, 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:19:14.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:19:14.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.078 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:14.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:14.080 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:14.079+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:14.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:19:14.207 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:14.206+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:14.230 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:14.230 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:14.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:14.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:14.281+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:14.382 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:14.382+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:14.386 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:14.386 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:14.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:14.483 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:14.482+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:14.501 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:14.501 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 134.88014376699999, 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:19:14.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:19:14.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:19:14.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:14.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:14.508 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 134.585708189, 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:19:14.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.319144995000002, 2024-09-11T06:19:14.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:19:14.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.355462404000001, 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:19:14.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.523 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.355444978000001, 2024-09-11T06:19:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:19:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:19:14.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:19:14.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:19:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:19:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:19:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:19:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:19:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:19:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.355427722000002, 2024-09-11T06:19:14.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:14.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:14.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.381217525, 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:19:14.535 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:19:14.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:19:14.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:19:14.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:19:14.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.381124823, 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:19:14.542 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:19:14.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.380919013, 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:19:14.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:19:14.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.380833446, 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:19:14.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.380620188, 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:19:14.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.380536869, 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:19:14.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.380279986, 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.569 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:19:14.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.380218547, 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:14.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.379972722, 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:19:14.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.379904594999999, 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.379636933, 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:19:14.590 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:19:14.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.379564893, 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:19:14.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.379394134, 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:19:14.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:19:14.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.379288913, 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:14.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:19:14.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:14.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:14.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:19:14.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:19:14.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:14.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:14.611 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:14.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:14.613 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:14.612+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:14.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:14.712+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:14.728 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:14.728 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:14.738 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:14.821 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:14.821+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:14.881 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:14.881 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:14.881 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:14.881 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:14.881 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:14.889 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:14.915 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:14.914+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:15.017 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:15.015+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:15.034 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:15.034 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124090 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2588672~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638771846999999, 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038606527000000002, 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.035 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124090 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3699999999999999e-07 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393921+0000", 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-06 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393924+0000", 2024-09-11T06:19:15.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9809999999999999e-06 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393927+0000", 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.441e-06 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432404+0000", 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038477645999999997 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432457+0000", 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2266999999999999e-05 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432526+0000", 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9871999999999998e-05 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124091 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:15.039 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638762379999999, 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038834586999999997, 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124091 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393930+0000", 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393931+0000", 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393934+0000", 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.055e-06 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393936+0000", 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432564+0000", 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038628026000000003 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432650+0000", 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5545999999999997e-05 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432764+0000", 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011411199999999999 2024-09-11T06:19:15.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124092 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638752899, 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039050738000000002, 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124092 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393940+0000", 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0699999999999999e-06 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393943+0000", 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-11T06:19:15.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393945+0000", 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.356e-06 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432796+0000", 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038850253000000001 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432883+0000", 2024-09-11T06:19:15.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7287999999999995e-05 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432990+0000", 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106586 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124093 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:15.048 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638743325, 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039266809999999999, 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124093 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393949+0000", 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4600000000000001e-07 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393950+0000", 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.105e-06 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393953+0000", 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.959e-06 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393955+0000", 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.605e-06 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433033+0000", 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039077685000000001 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433095+0000", 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2451000000000002e-05 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433215+0000", 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119759 2024-09-11T06:19:15.052 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124094 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2621440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638733634999999, 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039472198, 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.053 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124094 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5499999999999999e-07 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393964+0000", 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3510000000000001e-06 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393969+0000", 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6080000000000003e-06 2024-09-11T06:19:15.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393974+0000", 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5560000000000001e-06 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433238+0000", 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039264518999999998 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433322+0000", 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3805000000000001e-05 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433430+0000", 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010810399999999999 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124095 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2629632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:15.057 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638711676, 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039657393999999999, 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124095 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:15.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393981+0000", 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393983+0000", 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393988+0000", 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393992+0000", 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0679999999999998e-06 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433471+0000", 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039478924999999998 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433531+0000", 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9883000000000002e-05 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433637+0000", 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106449 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.061 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124096 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2637824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638694414, 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039912982999999999, 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.062 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124096 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393998+0000", 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393999+0000", 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.764e-06 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394004+0000", 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394008+0000", 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.092e-06 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433714+0000", 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039705419999999998 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433804+0000", 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0447999999999999e-05 2024-09-11T06:19:15.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433910+0000", 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010616999999999999 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124097 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2646016~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638676780000001, 2024-09-11T06:19:15.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040088436999999998, 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124097 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394017+0000", 2024-09-11T06:19:15.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394023+0000", 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9449999999999998e-06 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394028+0000", 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433952+0000", 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039924460000000002 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434009+0000", 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6860000000000001e-05 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434103+0000", 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4455000000000003e-05 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.070 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124098 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.63865891, 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040258124999999999, 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124098 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.071 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394035+0000", 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6780000000000001e-06 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394040+0000", 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1540000000000001e-06 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394044+0000", 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2189999999999998e-06 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434130+0000", 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040085549999999998 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434208+0000", 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7865000000000001e-05 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434291+0000", 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3347e-05 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124099 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638642540999999, 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040461951000000003, 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.075 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124099 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394050+0000", 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.89e-07 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394052+0000", 2024-09-11T06:19:15.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394057+0000", 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7529999999999998e-06 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394063+0000", 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434323+0000", 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040260038999999997 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434378+0000", 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5631999999999999e-05 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434511+0000", 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013283699999999999 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124100 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638609566, 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040582739999999999, 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.080 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124100 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394083+0000", 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394087+0000", 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000004e-06 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394093+0000", 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:19:15.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394098+0000", 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9860000000000002e-06 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434548+0000", 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040450016999999998 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434595+0000", 2024-09-11T06:19:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6255999999999999e-05 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434665+0000", 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0338000000000003e-05 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124101 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:15.084 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638586668, 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040783649999999998, 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124101 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:15.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394107+0000", 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394113+0000", 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8440000000000003e-06 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394117+0000", 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.335e-06 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434695+0000", 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040577692999999998 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434783+0000", 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7538000000000001e-05 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434889+0000", 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105989 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.088 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124102 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.6385684, 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040992853000000003, 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.089 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124102 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394124+0000", 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394126+0000", 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394131+0000", 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6879999999999996e-06 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394136+0000", 2024-09-11T06:19:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5430000000000004e-06 2024-09-11T06:19:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434919+0000", 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040782773000000001 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435005+0000", 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6594000000000005e-05 2024-09-11T06:19:15.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435116+0000", 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110776 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124103 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638550002000001, 2024-09-11T06:19:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041211651000000002, 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124103 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394144+0000", 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7689999999999999e-06 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394150+0000", 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6699999999999999e-06 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394154+0000", 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435146+0000", 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040991684 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435239+0000", 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3428000000000001e-05 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435353+0000", 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114219 2024-09-11T06:19:15.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124104 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638531888999999, 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041465574999999998, 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124104 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394162+0000", 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.776e-06 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394168+0000", 2024-09-11T06:19:15.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7080000000000002e-06 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394172+0000", 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5059999999999997e-06 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435385+0000", 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041212998000000001 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435477+0000", 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1528999999999997e-05 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435625+0000", 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148677 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.103 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124105 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638514012, 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041619452000000001, 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124105 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:15.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394180+0000", 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0930000000000001e-06 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394186+0000", 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5389999999999998e-06 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394191+0000", 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7039999999999999e-06 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435663+0000", 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041471806 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435721+0000", 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7655999999999998e-05 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435797+0000", 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6247000000000004e-05 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124106 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638490221, 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041713447000000001, 2024-09-11T06:19:15.108 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124106 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394204+0000", 2024-09-11T06:19:15.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394210+0000", 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2269999999999998e-06 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394215+0000", 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435816+0000", 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041600683999999999 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435858+0000", 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2518999999999997e-05 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435915+0000", 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6514000000000001e-05 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.112 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124107 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638470452, 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041835280000000002, 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124107 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394222+0000", 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394223+0000", 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.793e-06 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394229+0000", 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:19:15.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394233+0000", 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435931+0000", 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041697761 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435972+0000", 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0806000000000002e-05 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436057+0000", 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4602000000000001e-05 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124108 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.117 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.638452730999999, 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042155791999999997, 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124108 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394241+0000", 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0109999999999999e-06 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394247+0000", 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8810000000000001e-06 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394252+0000", 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:19:15.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436174+0000", 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041922012000000002 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436274+0000", 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100054 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436395+0000", 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012093499999999999 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124109 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 10.63843424, 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042294403000000001, 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124109 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394258+0000", 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394269+0000", 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0974e-05 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394275+0000", 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3450000000000002e-06 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394280+0000", 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.826e-06 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436426+0000", 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042146175000000001 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436472+0000", 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436552+0000", 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0075999999999997e-05 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.126 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.127 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:15.128 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:19:15.129 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:15.129 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:15.126+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:15.229 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:15.227+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:15.273 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:15.273 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:15.273 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:15.273 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:15.281 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:15.329 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:15.328+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:15.385 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:15.385 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:15.386 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:15.395 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:15.431 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:15.429+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:15.500 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:15.500 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:15.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.155546639000001, 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.501 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:19:15.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.051622453, 2024-09-11T06:19:15.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:15.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:15.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:19:15.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:15.511 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.051596103, 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:19:15.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:19:15.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:19:15.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.516 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.516 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.516 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.051575623, 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:19:15.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.051556909, 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.521 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:19:15.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042826075000001, 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.526 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:15.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:19:15.530 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.531 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.531 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.531 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.531 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:15.531 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042792491, 2024-09-11T06:19:15.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:19:15.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:19:15.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:19:15.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:19:15.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:19:15.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:19:15.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:19:15.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:19:15.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.537 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.538 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.538 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:15.538 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042779661999999, 2024-09-11T06:19:15.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:19:15.538 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.539 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.539 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.539 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:19:15.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.543 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042769525000001, 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.544 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:19:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042758707000001, 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.549 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:19:15.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.550 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:15.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:19:15.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042748827, 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.554 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:19:15.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042739096, 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:19:15.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:15.563 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042729478, 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.567 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042719664, 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.568 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:15.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.572 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042704297, 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.573 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:15.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:19:15.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:15.578 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.042693995, 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:19:15.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.040993712000001, 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.034848713000001, 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:15.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:19:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.034839217, 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:19:15.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.034829658, 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:15.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:15.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:15.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:15.602 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:15.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:15.604 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:15.602+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:15.605 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:15.704 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:15.702+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:15.708 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:15.708 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:15.717 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:15.726 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:15.742 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:15.743 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:15.758 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:15.758 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:15.774 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:15.774 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:15.794 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:15.794 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:15.805 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:15.803+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:15.812 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:15.812 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:15.828 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:15.829 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:15.847 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:15.863 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:15.863 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:15.872 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:15.906 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:15.904+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:15.974 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:15.975 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:15.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:16.028 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:16.026+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:16.087 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:16.087 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:16.096 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:16.108 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:16.107+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:16.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:16.207+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:16.243 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:16.243 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:16.251 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:16.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:16.334+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:16.357 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-11T06:19:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:16.400 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:16.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:16.411 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:16.409+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:16.449 INFO:teuthology.orchestra.run.smithi070.stdout:4554 punch from 0x4e885d5 to 0x4e933f7, (0xae22 bytes) 2024-09-11T06:19:16.453 INFO:teuthology.orchestra.run.smithi070.stdout:4556 read 0x608e1e8 thru 0x6098c28 (0xaa41 bytes) 2024-09-11T06:19:16.463 INFO:teuthology.orchestra.run.smithi070.stdout:4557 trunc from 0xea45d8d to 0x6683979 2024-09-11T06:19:16.469 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.469 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.469 INFO:teuthology.orchestra.run.smithi070.stdout:4561 write 0x11b99d6 thru 0x11bdf0e (0x4539 bytes) 2024-09-11T06:19:16.471 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.486 INFO:teuthology.orchestra.run.smithi070.stdout:4563 write 0xe490f43 thru 0xe493029 (0x20e7 bytes) 2024-09-11T06:19:16.497 INFO:teuthology.orchestra.run.smithi070.stdout:4566 trunc from 0xe49302a to 0x73f6802 2024-09-11T06:19:16.511 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:16.510+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:16.513 INFO:teuthology.orchestra.run.smithi070.stdout:4567 writesame 0x8b8e02d thru 0x8b94aa4 data_size 0x4(0x6a78 bytes) 2024-09-11T06:19:16.513 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.513 INFO:teuthology.orchestra.run.smithi070.stdout:4570 write 0x1c3e711 thru 0x1c4924a (0xab3a bytes) 2024-09-11T06:19:16.516 INFO:teuthology.orchestra.run.smithi070.stdout:4571 write 0x5e56797 thru 0x5e5fab6 (0x9320 bytes) 2024-09-11T06:19:16.519 INFO:teuthology.orchestra.run.smithi070.stdout:4572 writesame 0x7863ec thru 0x787a23 data_size 0x24(0x1638 bytes) 2024-09-11T06:19:16.520 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:16.520 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:16.529 INFO:teuthology.orchestra.run.smithi070.stdout:4574 write 0xba4c3cc thru 0xba58a9a (0xc6cf bytes) 2024-09-11T06:19:16.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:16.533 INFO:teuthology.orchestra.run.smithi070.stdout:4576 write 0x39cfc7a thru 0x39d9a0a (0x9d91 bytes) 2024-09-11T06:19:16.535 INFO:teuthology.orchestra.run.smithi070.stdout:4577 write 0x3a05e60 thru 0x3a068c6 (0xa67 bytes) 2024-09-11T06:19:16.538 INFO:teuthology.orchestra.run.smithi070.stdout:4578 read 0x911f450 thru 0x912c033 (0xcbe4 bytes) 2024-09-11T06:19:16.541 INFO:teuthology.orchestra.run.smithi070.stdout:4579 trunc from 0xba58a9b to 0x8d56507 2024-09-11T06:19:16.550 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.551 INFO:teuthology.orchestra.run.smithi070.stdout:4581 punch from 0xf98a47 to 0xf9a337, (0x18f0 bytes) 2024-09-11T06:19:16.551 INFO:teuthology.orchestra.run.smithi070.stdout:4583 write 0x8c09b15 thru 0x8c0a676 (0xb62 bytes) 2024-09-11T06:19:16.553 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.553 INFO:teuthology.orchestra.run.smithi070.stdout:4586 read 0x74af8cf thru 0x74b99ff (0xa131 bytes) 2024-09-11T06:19:16.559 INFO:teuthology.orchestra.run.smithi070.stdout:4587 trunc from 0x8d56507 to 0x40afb0e 2024-09-11T06:19:16.587 INFO:teuthology.orchestra.run.smithi070.stdout:4588 read 0x188011b thru 0x1886f8f (0x6e75 bytes) 2024-09-11T06:19:16.587 INFO:teuthology.orchestra.run.smithi070.stdout:4589 read 0x228595d thru 0x228f682 (0x9d26 bytes) 2024-09-11T06:19:16.595 INFO:teuthology.orchestra.run.smithi070.stdout:4590 write 0x59d1d64 thru 0x59d66f2 (0x498f bytes) 2024-09-11T06:19:16.610 INFO:teuthology.orchestra.run.smithi070.stdout:4591 write 0x995edb6 thru 0x9965758 (0x69a3 bytes) 2024-09-11T06:19:16.612 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:16.610+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:16.613 INFO:teuthology.orchestra.run.smithi070.stdout:4592 write 0x7e9af38 thru 0x7e9bbed (0xcb6 bytes) 2024-09-11T06:19:16.619 INFO:teuthology.orchestra.run.smithi070.stdout:4596 trunc from 0x9965759 to 0xaf99343 2024-09-11T06:19:16.624 INFO:teuthology.orchestra.run.smithi070.stdout:4597 punch from 0x752aee4 to 0x752ea59, (0x3b75 bytes) 2024-09-11T06:19:16.638 INFO:teuthology.orchestra.run.smithi070.stdout:4598 trunc from 0xaf99343 to 0x36d1a 2024-09-11T06:19:16.648 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:16.648 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:16.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:16.680 INFO:teuthology.orchestra.run.smithi070.stdout:4599 write 0x2080095 thru 0x2086738 (0x66a4 bytes) 2024-09-11T06:19:16.682 INFO:teuthology.orchestra.run.smithi070.stdout:4600 read 0x10ec89f thru 0x10f8300 (0xba62 bytes) 2024-09-11T06:19:16.682 INFO:teuthology.orchestra.run.smithi070.stdout:4601 read 0x18dada thru 0x19230a (0x4831 bytes) 2024-09-11T06:19:16.683 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.684 INFO:teuthology.orchestra.run.smithi070.stdout:4604 trunc from 0x2086739 to 0x3f971fd 2024-09-11T06:19:16.690 INFO:teuthology.orchestra.run.smithi070.stdout:4605 read 0x2152e43 thru 0x2162129 (0xf2e7 bytes) 2024-09-11T06:19:16.709 INFO:teuthology.orchestra.run.smithi070.stdout:4607 write 0xeac7906 thru 0xeacfdec (0x84e7 bytes) 2024-09-11T06:19:16.712 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.712 INFO:teuthology.orchestra.run.smithi070.stdout:4609 punch from 0xca44083 to 0xca4e538, (0xa4b5 bytes) 2024-09-11T06:19:16.712 INFO:teuthology.orchestra.run.smithi070.stdout:4611 write 0x688ca5f thru 0x6899b87 (0xd129 bytes) 2024-09-11T06:19:16.713 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:16.711+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:16.716 INFO:teuthology.orchestra.run.smithi070.stdout:4614 write 0x1a955c2 thru 0x1aa07b7 (0xb1f6 bytes) 2024-09-11T06:19:16.721 INFO:teuthology.orchestra.run.smithi070.stdout:4616 writesame 0x83488ab thru 0x834b24b data_size 0x1(0x29a1 bytes) 2024-09-11T06:19:16.729 INFO:teuthology.orchestra.run.smithi070.stdout:4617 punch from 0x280fc91 to 0x28197de, (0x9b4d bytes) 2024-09-11T06:19:16.729 INFO:teuthology.orchestra.run.smithi070.stdout:4618 write 0x9b03cc6 thru 0x9b0ea8d (0xadc8 bytes) 2024-09-11T06:19:16.732 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.732 INFO:teuthology.orchestra.run.smithi070.stdout:4620 write 0x71f69d1 thru 0x72065ab (0xfbdb bytes) 2024-09-11T06:19:16.737 INFO:teuthology.orchestra.run.smithi070.stdout:4621 writesame 0x8934d0e thru 0x8937a8a data_size 0x11(0x2d7d bytes) 2024-09-11T06:19:16.741 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.741 INFO:teuthology.orchestra.run.smithi070.stdout:4624 write 0x74e5870 thru 0x74f2401 (0xcb92 bytes) 2024-09-11T06:19:16.746 INFO:teuthology.orchestra.run.smithi070.stdout:4628 writesame 0x9c38d86 thru 0x9c42bc9 data_size 0xe(0x9e44 bytes) 2024-09-11T06:19:16.750 INFO:teuthology.orchestra.run.smithi070.stdout:4629 writesame 0x3b89c36 thru 0x3b8d291 data_size 0x1c(0x365c bytes) 2024-09-11T06:19:16.754 INFO:teuthology.orchestra.run.smithi070.stdout:4630 writesame 0x13db9e5 thru 0x13e43b8 data_size 0x2(0x89d4 bytes) 2024-09-11T06:19:16.765 INFO:teuthology.orchestra.run.smithi070.stdout:4631 read 0xcf91297 thru 0xcf972c6 (0x6030 bytes) 2024-09-11T06:19:16.765 INFO:teuthology.orchestra.run.smithi070.stdout:4634 punch from 0x577c5be to 0x57855e7, (0x9029 bytes) 2024-09-11T06:19:16.765 INFO:teuthology.orchestra.run.smithi070.stdout:4635 read 0x977700e thru 0x97847d7 (0xd7ca bytes) 2024-09-11T06:19:16.765 INFO:teuthology.orchestra.run.smithi070.stdout:4636 writesame 0x7c02312 thru 0x7c066eb data_size 0x2d(0x43da bytes) 2024-09-11T06:19:16.766 INFO:teuthology.orchestra.run.smithi070.stdout:4638 read 0x9a0c1e5 thru 0x9a1ad7e (0xeb9a bytes) 2024-09-11T06:19:16.766 INFO:teuthology.orchestra.run.smithi070.stdout:4639 write 0x3ded6be thru 0x3df5a50 (0x8393 bytes) 2024-09-11T06:19:16.769 INFO:teuthology.orchestra.run.smithi070.stdout:4640 write 0x5cc1f90 thru 0x5cc2669 (0x6da bytes) 2024-09-11T06:19:16.772 INFO:teuthology.orchestra.run.smithi070.stdout:4641 punch from 0x551b5fc to 0x551e576, (0x2f7a bytes) 2024-09-11T06:19:16.772 INFO:teuthology.orchestra.run.smithi070.stdout:4642 writesame 0x68992a1 thru 0x68a80d1 data_size 0x7(0xee31 bytes) 2024-09-11T06:19:16.777 INFO:teuthology.orchestra.run.smithi070.stdout:4643 write 0x82d038b thru 0x82d6b41 (0x67b7 bytes) 2024-09-11T06:19:16.779 INFO:teuthology.orchestra.run.smithi070.stdout:4645 punch from 0xdcb1df8 to 0xdcbda3f, (0xbc47 bytes) 2024-09-11T06:19:16.779 INFO:teuthology.orchestra.run.smithi070.stdout:4646 writesame 0xbabc76 thru 0xbbae92 data_size 0x1(0xf21d bytes) 2024-09-11T06:19:16.792 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:16.792 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:16.801 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:16.809 INFO:teuthology.orchestra.run.smithi070.stdout:4647 write 0x5b50a51 thru 0x5b5a8b7 (0x9e67 bytes) 2024-09-11T06:19:16.812 INFO:teuthology.orchestra.run.smithi070.stdout:4648 write 0xe735efb thru 0xe73c8e1 (0x69e7 bytes) 2024-09-11T06:19:16.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:16.812+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:16.815 INFO:teuthology.orchestra.run.smithi070.stdout:4649 punch from 0x871074f to 0x87198ce, (0x917f bytes) 2024-09-11T06:19:16.815 INFO:teuthology.orchestra.run.smithi070.stdout:4650 punch from 0x2f6e004 to 0x2f75902, (0x78fe bytes) 2024-09-11T06:19:16.822 INFO:teuthology.orchestra.run.smithi070.stdout:4652 trunc from 0xeacfded to 0x95d5d10 2024-09-11T06:19:16.833 INFO:teuthology.orchestra.run.smithi070.stdout:4657 punch from 0x3e317b9 to 0x3e395a0, (0x7de7 bytes) 2024-09-11T06:19:16.833 INFO:teuthology.orchestra.run.smithi070.stdout:4659 write 0x3002bd2 thru 0x30095d5 (0x6a04 bytes) 2024-09-11T06:19:16.836 INFO:teuthology.orchestra.run.smithi070.stdout:4660 read 0x673edea thru 0x6741284 (0x249b bytes) 2024-09-11T06:19:16.836 INFO:teuthology.orchestra.run.smithi070.stdout:4661 writesame 0x69c016b thru 0x69ce72d data_size 0x1(0xe5c3 bytes) 2024-09-11T06:19:16.865 INFO:teuthology.orchestra.run.smithi070.stdout:4662 write 0x638c776 thru 0x639248f (0x5d1a bytes) 2024-09-11T06:19:16.869 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.869 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.869 INFO:teuthology.orchestra.run.smithi070.stdout:4669 read 0x4728943 thru 0x472d536 (0x4bf4 bytes) 2024-09-11T06:19:16.878 INFO:teuthology.orchestra.run.smithi070.stdout:4670 write 0xc1edc67 thru 0xc1f9e13 (0xc1ad bytes) 2024-09-11T06:19:16.881 INFO:teuthology.orchestra.run.smithi070.stdout:4671 write 0x590c58c thru 0x5914eca (0x893f bytes) 2024-09-11T06:19:16.885 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.885 INFO:teuthology.orchestra.run.smithi070.stdout:4678 punch from 0x2b1a657 to 0x2b1db31, (0x34da bytes) 2024-09-11T06:19:16.885 INFO:teuthology.orchestra.run.smithi070.stdout:4679 read 0xf717ca thru 0xf74abb (0x32f2 bytes) 2024-09-11T06:19:16.886 INFO:teuthology.orchestra.run.smithi070.stdout:4680 punch from 0x184f0f3 to 0x18566b9, (0x75c6 bytes) 2024-09-11T06:19:16.888 INFO:teuthology.orchestra.run.smithi070.stdout:4682 trunc from 0xc1f9e14 to 0xe80047b 2024-09-11T06:19:16.894 INFO:teuthology.orchestra.run.smithi070.stdout:4683 read 0x35b9ef thru 0x360b28 (0x513a bytes) 2024-09-11T06:19:16.895 INFO:teuthology.orchestra.run.smithi070.stdout:4685 write 0x42c2359 thru 0x42c9224 (0x6ecc bytes) 2024-09-11T06:19:16.898 INFO:teuthology.orchestra.run.smithi070.stdout:4686 read 0x9c770dd thru 0x9c79c2e (0x2b52 bytes) 2024-09-11T06:19:16.898 INFO:teuthology.orchestra.run.smithi070.stdout:4687 punch from 0x319bd4e to 0x31ab739, (0xf9eb bytes) 2024-09-11T06:19:16.898 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.913 INFO:teuthology.orchestra.run.smithi070.stdout:4690 trunc from 0xe80047b to 0x1ee2279 2024-09-11T06:19:16.914 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:16.912+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:16.923 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:16.923 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:16.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:16.945 INFO:teuthology.orchestra.run.smithi070.stdout:4691 write 0x91507ce thru 0x91565a7 (0x5dda bytes) 2024-09-11T06:19:16.947 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:16.957 INFO:teuthology.orchestra.run.smithi070.stdout:4693 writesame 0xc28c3eb thru 0xc29a32f data_size 0x1(0xdf45 bytes) 2024-09-11T06:19:16.957 INFO:teuthology.orchestra.run.smithi070.stdout:4694 writesame 0xa69d681 thru 0xa6aa711 data_size 0x1(0xd091 bytes) 2024-09-11T06:19:16.984 INFO:teuthology.orchestra.run.smithi070.stdout:4697 read 0x38be785 thru 0x38cc870 (0xe0ec bytes) 2024-09-11T06:19:16.984 INFO:teuthology.orchestra.run.smithi070.stdout:4698 writesame 0x9cbf5a6 thru 0x9ccb3e8 data_size 0x1(0xbe43 bytes) 2024-09-11T06:19:17.010 INFO:teuthology.orchestra.run.smithi070.stdout:4699 write 0x96388ab thru 0x964402e (0xb784 bytes) 2024-09-11T06:19:17.015 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:17.012+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:17.021 INFO:teuthology.orchestra.run.smithi070.stdout:4700 trunc from 0xc29a330 to 0x5f58c7b 2024-09-11T06:19:17.032 INFO:teuthology.orchestra.run.smithi070.stdout:4701 read 0x2a25ff4 thru 0x2a31db9 (0xbdc6 bytes) 2024-09-11T06:19:17.032 INFO:teuthology.orchestra.run.smithi070.stdout:4702 writesame 0xa9dae8 thru 0xaad1d3 data_size 0x2(0xf6ec bytes) 2024-09-11T06:19:17.050 INFO:teuthology.orchestra.run.smithi070.stdout:4703 read 0x646360 thru 0x6521ce (0xbe6f bytes) 2024-09-11T06:19:17.050 INFO:teuthology.orchestra.run.smithi070.stdout:4704 read 0x41a4129 thru 0x41ae493 (0xa36b bytes) 2024-09-11T06:19:17.051 INFO:teuthology.orchestra.run.smithi070.stdout:4705 write 0x554d767 thru 0x555aa0c (0xd2a6 bytes) 2024-09-11T06:19:17.053 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:17.053 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:17.059 INFO:teuthology.orchestra.run.smithi070.stdout:4706 trunc from 0x5f58c7b to 0xa34c87f 2024-09-11T06:19:17.065 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:17.066 INFO:teuthology.orchestra.run.smithi070.stdout:4707 read 0x8956e6e thru 0x895ddd9 (0x6f6c bytes) 2024-09-11T06:19:17.073 INFO:teuthology.orchestra.run.smithi070.stdout:4708 write 0xb76953d thru 0xb76f30b (0x5dcf bytes) 2024-09-11T06:19:17.080 INFO:teuthology.orchestra.run.smithi070.stdout:4709 trunc from 0xb76f30c to 0x7dba480 2024-09-11T06:19:17.090 INFO:teuthology.orchestra.run.smithi070.stdout:4710 read 0x67d4b3a thru 0x67ddd49 (0x9210 bytes) 2024-09-11T06:19:17.090 INFO:teuthology.orchestra.run.smithi070.stdout:4711 trunc from 0x7dba480 to 0x7ac9eac 2024-09-11T06:19:17.096 INFO:teuthology.orchestra.run.smithi070.stdout:4712 read 0x6dd55e1 thru 0x6ddf15f (0x9b7f bytes) 2024-09-11T06:19:17.096 INFO:teuthology.orchestra.run.smithi070.stdout:4713 write 0x6ef9a40 thru 0x6f025d9 (0x8b9a bytes) 2024-09-11T06:19:17.099 INFO:teuthology.orchestra.run.smithi070.stdout:4714 read 0x24fbc02 thru 0x2507c2a (0xc029 bytes) 2024-09-11T06:19:17.099 INFO:teuthology.orchestra.run.smithi070.stdout:4715 clone 33 order 24 su 4194304 sc 9 2024-09-11T06:19:17.115 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:17.113+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:17.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:19:17.173 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:17.173 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:17.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:17.223 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:17.221+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:17.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:17.315+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:17.318 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:19:17.319 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:19:17.319 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-11T06:19:17.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-09-11T06:19:17.332 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:17.333 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:17.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:17.427 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:17.425+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:17.489 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:17.490 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:17.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:17.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:17.517+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:17.605 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:19:17.603+0000 7fc9676c7640 -1 mgr.server reply reply (2) No such file or directory no change 2024-09-11T06:19:17.605 INFO:teuthology.orchestra.run.smithi070.stdout:moved 3 / 82 (3.65854%) 2024-09-11T06:19:17.605 INFO:teuthology.orchestra.run.smithi070.stdout:avg 10.25 2024-09-11T06:19:17.605 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.33184 -> 3.19179 (expected baseline 2.99479) 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.7 with 7 -> 7 pgs (0.682927 -> 0.682927 * mean) 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.3 with 15 -> 16 pgs (1.46341 -> 1.56098 * mean) 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:oload 110 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 3 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0005 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0006 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 weight 1.0000 -> 0.7951 2024-09-11T06:19:17.606 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 weight 1.0000 -> 0.8363 2024-09-11T06:19:17.607 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-11T06:19:17.618 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-11T06:19:17.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-11T06:19:17.620 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:17.618+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:17.644 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:17.645 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:17.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:17.720 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:17.719+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:17.800 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:17.800 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:17.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:17.853 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:17.851+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:17.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:17.907 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-11T06:19:17.905+0000 7fc9676c7640 -1 mgr.server reply reply (2) No such file or directory no change 2024-09-11T06:19:17.907 INFO:teuthology.orchestra.run.smithi070.stdout:moved 2 / 82 (2.43902%) 2024-09-11T06:19:17.907 INFO:teuthology.orchestra.run.smithi070.stdout:avg 10.25 2024-09-11T06:19:17.907 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.33184 -> 2.90474 (expected baseline 2.99479) 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.7 with 7 -> 7 pgs (0.682927 -> 0.682927 * mean) 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.3 with 15 -> 16 pgs (1.46341 -> 1.56098 * mean) 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:oload 110 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 0.05 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0005 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0006 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 weight 1.0000 -> 0.9500 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 weight 1.0000 -> 0.9500 2024-09-11T06:19:17.908 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-11T06:19:17.914 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:17.915 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:17.920 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-11T06:19:17.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-11T06:19:17.921 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:17.920+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:17.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:17.993 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:17.993 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:18.023 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:18.022+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:18.026 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:18.026 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:18.057 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:18.057 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:18.074 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:18.092 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:18.092 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 138.475547713, 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:19:18.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:19:18.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:18.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 138.18111213500001, 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:19:18.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:19:18.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.914548941, 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:19:18.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.950866349999998, 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:19:18.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:19:18.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:18.118 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.950848923999999, 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:18.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:19:18.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.950831667999999, 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:19:18.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.976621471000001, 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:19:18.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.976528769000002, 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:19:18.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.976322959000001, 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:19:18.138 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:19:18.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:19:18.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.976237392000002, 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:19:18.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:19:18.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.976024133999999, 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:18.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.975940815000001, 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:18.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.975683931999999, 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:19:18.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:19:18.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.975622492999999, 2024-09-11T06:19:18.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:18.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.975376667999999, 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:19:18.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:19:18.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.975308541, 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:19:18.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.975040879000002, 2024-09-11T06:19:18.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.974968838999999, 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:19:18.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.191 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.974798079999999, 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:19:18.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:19:18.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.974692859000001, 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:18.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:19:18.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:19:18.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:18.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:18.202 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:18.203 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:18.203 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:18.204 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:18.204 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:18.204 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:18.205 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:18.205 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:18.206 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:18.202+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:19:18.304 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:18.302+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:18.321 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:18.321 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:18.321 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:18.321 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:18.329 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:18.406 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:18.405+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:18.473 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:18.473 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:18.473 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:18.473 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:18.473 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:18.481 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:18.526 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:18.524+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:18.585 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124090 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2588672~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.190105340000001, 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038606527000000002, 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124090 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3699999999999999e-07 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393921+0000", 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-06 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393924+0000", 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9809999999999999e-06 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393927+0000", 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.441e-06 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432404+0000", 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038477645999999997 2024-09-11T06:19:18.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432457+0000", 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2266999999999999e-05 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432526+0000", 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9871999999999998e-05 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124091 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.190095873000001, 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038834586999999997, 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124091 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.591 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393930+0000", 2024-09-11T06:19:18.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393931+0000", 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393934+0000", 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.055e-06 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393936+0000", 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432564+0000", 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038628026000000003 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432650+0000", 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5545999999999997e-05 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432764+0000", 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011411199999999999 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124092 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.190086392, 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039050738000000002, 2024-09-11T06:19:18.595 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124092 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393940+0000", 2024-09-11T06:19:18.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0699999999999999e-06 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393943+0000", 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393945+0000", 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.356e-06 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432796+0000", 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038850253000000001 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432883+0000", 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7287999999999995e-05 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432990+0000", 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106586 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124093 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.190076818, 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039266809999999999, 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.600 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124093 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393949+0000", 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4600000000000001e-07 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393950+0000", 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.105e-06 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393953+0000", 2024-09-11T06:19:18.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.959e-06 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393955+0000", 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.605e-06 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433033+0000", 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039077685000000001 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433095+0000", 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2451000000000002e-05 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433215+0000", 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119759 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124094 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2621440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.604 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.190067128000001, 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039472198, 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124094 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5499999999999999e-07 2024-09-11T06:19:18.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393964+0000", 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3510000000000001e-06 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393969+0000", 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6080000000000003e-06 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393974+0000", 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5560000000000001e-06 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433238+0000", 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039264518999999998 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433322+0000", 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3805000000000001e-05 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433430+0000", 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010810399999999999 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124095 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2629632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.190045168999999, 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039657393999999999, 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.609 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124095 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393981+0000", 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393983+0000", 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393988+0000", 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393992+0000", 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0679999999999998e-06 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433471+0000", 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039478924999999998 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433531+0000", 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9883000000000002e-05 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433637+0000", 2024-09-11T06:19:18.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106449 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124096 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2637824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.190027906999999, 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039912982999999999, 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124096 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:18.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393998+0000", 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393999+0000", 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.764e-06 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394004+0000", 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394008+0000", 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.092e-06 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433714+0000", 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039705419999999998 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433804+0000", 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0447999999999999e-05 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433910+0000", 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010616999999999999 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.618 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124097 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2646016~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.190010273, 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040088436999999998, 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124097 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:18.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394017+0000", 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394023+0000", 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9449999999999998e-06 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394028+0000", 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433952+0000", 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039924460000000002 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434009+0000", 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6860000000000001e-05 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434103+0000", 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4455000000000003e-05 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124098 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189992403, 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040258124999999999, 2024-09-11T06:19:18.623 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124098 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394035+0000", 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6780000000000001e-06 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394040+0000", 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1540000000000001e-06 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394044+0000", 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2189999999999998e-06 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434130+0000", 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040085549999999998 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434208+0000", 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7865000000000001e-05 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434291+0000", 2024-09-11T06:19:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3347e-05 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124099 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189976034000001, 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040461951000000003, 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124099 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394050+0000", 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.89e-07 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394052+0000", 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:19:18.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394057+0000", 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7529999999999998e-06 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394063+0000", 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434323+0000", 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040260038999999997 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434378+0000", 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5631999999999999e-05 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434511+0000", 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013283699999999999 2024-09-11T06:19:18.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124100 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189943059000001, 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040582739999999999, 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124100 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394083+0000", 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394087+0000", 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000004e-06 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394093+0000", 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394098+0000", 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9860000000000002e-06 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434548+0000", 2024-09-11T06:19:18.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040450016999999998 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434595+0000", 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6255999999999999e-05 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434665+0000", 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0338000000000003e-05 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124101 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189920161, 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040783649999999998, 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124101 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394107+0000", 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394113+0000", 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8440000000000003e-06 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394117+0000", 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.335e-06 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434695+0000", 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040577692999999998 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434783+0000", 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7538000000000001e-05 2024-09-11T06:19:18.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434889+0000", 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105989 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124102 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189901893, 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040992853000000003, 2024-09-11T06:19:18.642 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124102 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394124+0000", 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394126+0000", 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394131+0000", 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6879999999999996e-06 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394136+0000", 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5430000000000004e-06 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434919+0000", 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040782773000000001 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435005+0000", 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6594000000000005e-05 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435116+0000", 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110776 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.646 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124103 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189883495, 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041211651000000002, 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124103 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394144+0000", 2024-09-11T06:19:18.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7689999999999999e-06 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394150+0000", 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6699999999999999e-06 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394154+0000", 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435146+0000", 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040991684 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435239+0000", 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3428000000000001e-05 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435353+0000", 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114219 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124104 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189865382000001, 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041465574999999998, 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124104 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394162+0000", 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.776e-06 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394168+0000", 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7080000000000002e-06 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394172+0000", 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5059999999999997e-06 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435385+0000", 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041212998000000001 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435477+0000", 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1528999999999997e-05 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435625+0000", 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148677 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124105 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189847504999999, 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041619452000000001, 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.656 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124105 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394180+0000", 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0930000000000001e-06 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394186+0000", 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5389999999999998e-06 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394191+0000", 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7039999999999999e-06 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435663+0000", 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041471806 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435721+0000", 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7655999999999998e-05 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435797+0000", 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6247000000000004e-05 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.660 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124106 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189823713999999, 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041713447000000001, 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124106 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:19:18.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394204+0000", 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394210+0000", 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2269999999999998e-06 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394215+0000", 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:18.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435816+0000", 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041600683999999999 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435858+0000", 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2518999999999997e-05 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435915+0000", 2024-09-11T06:19:18.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6514000000000001e-05 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124107 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189803945, 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041835280000000002, 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124107 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394222+0000", 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394223+0000", 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.793e-06 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394229+0000", 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394233+0000", 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435931+0000", 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041697761 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435972+0000", 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0806000000000002e-05 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436057+0000", 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4602000000000001e-05 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124108 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189786224000001, 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042155791999999997, 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124108 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.670 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394241+0000", 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0109999999999999e-06 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394247+0000", 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8810000000000001e-06 2024-09-11T06:19:18.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394252+0000", 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436174+0000", 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041922012000000002 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436274+0000", 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100054 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436395+0000", 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012093499999999999 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124109 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.189767733, 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042294403000000001, 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124109 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.675 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:18.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394258+0000", 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394269+0000", 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0974e-05 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394275+0000", 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3450000000000002e-06 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394280+0000", 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.826e-06 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436426+0000", 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042146175000000001 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:18.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436472+0000", 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436552+0000", 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0075999999999997e-05 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:18.679 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:18.681 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:18.681 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:18.680+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:18.782 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:18.781+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:18.824 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:18.824 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:18.824 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:18.824 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:18.832 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:18.882 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:18.881+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:18.935 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:18.935 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:18.935 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:18.935 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:18.935 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:18.944 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:18.988 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:18.986+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:19.048 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:19:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:19.048 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 59.703050156000003, 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:19.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:19:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:19:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:19:19.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:19:19.054 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.599125969999999, 2024-09-11T06:19:19.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.056 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:19:19.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.061 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.59909962, 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.062 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:19:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:19:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.067 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.599079140000001, 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.599060425999999, 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:19:19.072 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:19:19.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:19:19.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:19:19.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590329592, 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.077 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:19:19.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:19:19.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590296007999999, 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.082 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:19:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:19:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:19:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590283179, 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:19:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:19:19.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590273042, 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.093 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:19.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:19.098 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590262224, 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:19:19.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:19:19.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.103 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590252344, 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.107 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590242613000001, 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.108 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:19:19.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.112 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590232995000001, 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:19:19.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.117 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590223181000001, 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590207813999999, 2024-09-11T06:19:19.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.590197512, 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.127 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:19:19.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:19:19.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.588497229, 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.132 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:19:19.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:19.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.58235223, 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:19.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:19.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.141 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.582342734000001, 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 14.582333175, 2024-09-11T06:19:19.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:19:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.151 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:19.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:19.153 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:19.151+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:19.218 INFO:teuthology.orchestra.run.smithi070.stdout:moved 3 / 82 (3.65854%) 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:avg 10.25 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.33184 -> 3.19179 (expected baseline 2.99479) 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.7 with 7 -> 7 pgs (0.682927 -> 0.682927 * mean) 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.3 with 15 -> 16 pgs (1.46341 -> 1.56098 * mean) 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:oload 110 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 1 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0005 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0006 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 weight 1.0000 -> 0.7943 2024-09-11T06:19:19.219 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 weight 1.0000 -> 0.8403 2024-09-11T06:19:19.238 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-11T06:19:19.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-09-11T06:19:19.280 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:19.279+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:19.297 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:19.298 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:19.298 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:19.298 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:19.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:19.355 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:19.353+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:19.409 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:19.409 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:19.409 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:19.410 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:19.410 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:19.418 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:19.459 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:19.457+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:19.556 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:19.554+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:19.559 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 82 (0%) 2024-09-11T06:19:19.559 INFO:teuthology.orchestra.run.smithi070.stdout:avg 10.25 2024-09-11T06:19:19.559 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 3.19179 -> 3.19179 (expected baseline 2.99479) 2024-09-11T06:19:19.559 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.0 with 6 -> 6 pgs (0.585366 -> 0.585366 * mean) 2024-09-11T06:19:19.560 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.3 with 16 -> 16 pgs (1.56098 -> 1.56098 * mean) 2024-09-11T06:19:19.560 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:19.560 INFO:teuthology.orchestra.run.smithi070.stdout:oload 1000 2024-09-11T06:19:19.560 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 1 2024-09-11T06:19:19.560 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-11T06:19:19.560 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0005 2024-09-11T06:19:19.560 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0051 2024-09-11T06:19:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443763035, 2024-09-11T06:19:19.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:19.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.569 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443705488999999, 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:19.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:19:19.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443679979999999, 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:19.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:19:19.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443456812000001, 2024-09-11T06:19:19.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:19.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:19:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:19:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443422146, 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:19:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443397984000001, 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:19:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443147433, 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:19:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:19:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443120052000001, 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:19:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:19:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.443096913000002, 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:19:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442868329, 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:19:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:19:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442831195, 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:19:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442804005999999, 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:19:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:19:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442535401000001, 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442494100000001, 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442468992999999, 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:19:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:19:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442228229000001, 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:19:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:19:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442193923000001, 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:19:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:19:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.442173155999999, 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:19:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.441942633, 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:19:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118795 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.441901465000001, 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99200256799999997, 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118795 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120454+0000", 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.06e-07 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120457+0000", 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459999999999998e-06 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120464+0000", 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1350000000000003e-06 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120470+0000", 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120511+0000", 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1316000000000002e-05 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120517+0000", 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6790000000000002e-06 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112451+0000", 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.991934078 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112456+0000", 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:19:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:19.667 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:19.669 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-11T06:19:19.669 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-11T06:19:19.669 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:19.667+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:19.669 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:19.769 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:19.768+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:19.812 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:19.813 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:19.813 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:19.822 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:19.870 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:19.869+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:19.924 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:19.924 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:19.924 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:19.924 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:19.924 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:19.933 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:19.971 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:19.970+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:20.036 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795291997999996, 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795279260000001, 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.042 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:19:20.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.046 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795268127, 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:19:20.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795257539000005, 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.051 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.055 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795247044000007, 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.059 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795236731000003, 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795226189000005, 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:19:20.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.068 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795215882999997, 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.069 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.073 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795200304999995, 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:20.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.077 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.795181299999996, 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.078 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:19:20.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:19:20.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:20.082 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735651927000006, 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:20.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:19:20.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:19:20.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735633456000002, 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:19:20.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735614966, 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.092 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:19:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:20.096 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735597897999995, 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:20.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:19:20.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735579866999998, 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:20.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.105 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735557682999996, 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:20.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735539691, 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:19:20.110 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:19:20.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735522036999996, 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:19:20.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:20.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:19:20.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:20.119 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735499121000004, 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:19:20.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:19:20.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 91.735480733000003, 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:20.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:20.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:19:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:19:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:20.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:20.128 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:moved 2 / 82 (2.43902%) 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:avg 10.25 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 3.19179 -> 3.7333 (expected baseline 2.99479) 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.0 with 6 -> 5 pgs (0.585366 -> 0.487805 * mean) 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.3 with 16 -> 17 pgs (1.56098 -> 1.65854 * mean) 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:oload 110 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 3 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-11T06:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0005 2024-09-11T06:19:20.131 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0006 2024-09-11T06:19:20.131 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 weight 0.7943 -> 0.6310 2024-09-11T06:19:20.131 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 weight 0.8403 -> 0.7061 2024-09-11T06:19:20.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:20.131 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:20.127+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:20.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:20.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:19:20.258 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:20.257+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:20.276 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:20.276 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:20.277 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:20.277 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:20.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:20.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:20.330+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:20.336 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:20.337 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:20.354 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:20.355 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:20.372 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:20.373 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:20.389 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:20.389 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:20.420 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:20.421 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:20.432 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:20.430+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:20.452 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:20.452 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:20.460 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:20.460 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:20.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:20.479 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:20.497 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:20.550 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:20.549+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:20.583 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:20.583 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:20.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:20.633 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:20.631+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:20.735 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:20.733+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:20.736 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:20.736 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:20.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:20.835 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:20.834+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:20.847 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:20.847 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:20.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:20.940 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:20.939+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:21.000 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:21.001 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:21.009 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:21.038 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:21.037+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:21.110 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:19:21.138 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:21.138+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:21.159 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:21.159 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:21.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:21.239 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:21.238+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:21.312 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:21.312 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:21.321 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:21.366 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:21.365+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:21.424 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:21.424 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:21.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:21.442 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:21.440+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:21.542 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:21.541+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:21.589 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-11T06:19:21.590 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:21.590 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:21.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:21.645 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:21.644+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:21.745 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:21.744+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:21.759 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:21.759 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:21.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:21.846 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:21.845+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:21.872 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:21.872 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:21.881 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:21.947 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:21.947+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:21.985 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:21.985 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:21.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:22.048 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:22.047+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:22.095 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:22.095 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:22.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:22.149 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:22.147+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:22.209 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:22.209 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:22.217 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:22.260 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:22.257+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:22.329 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:22.329 INFO:teuthology.orchestra.run.smithi070.stdout:4718 read 0x30f580 thru 0x31d4a9 (0xdf2a bytes) 2024-09-11T06:19:22.330 INFO:teuthology.orchestra.run.smithi070.stdout:4719 read 0x1446157 thru 0x1447eeb (0x1d95 bytes) 2024-09-11T06:19:22.330 INFO:teuthology.orchestra.run.smithi070.stdout:4720 read 0x79e4f43 thru 0x79e6ee4 (0x1fa2 bytes) 2024-09-11T06:19:22.350 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:22.348+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:22.363 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:22.363 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:22.372 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:22.455 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:22.454+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:22.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:22.516 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:22.516 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:22.525 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:22.553 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:22.553+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:22.630 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:22.630 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:22.646 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:22.646 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:22.652 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:22.652+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:22.662 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:22.662 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:22.669 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:22.669 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:22.678 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:22.679 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:22.679 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:22.694 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:22.695 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:22.710 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:22.711 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:22.727 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:22.727 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:22.743 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:22.743 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:22.754 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:22.752+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:22.783 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:22.783 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:22.783 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:22.783 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:22.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:22.877 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:22.875+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:22.935 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:22.936 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:22.936 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:22.936 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:22.936 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:22.944 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:22.954 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:22.954+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:23.056 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:23.055+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:23.088 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.968135092000001, 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.089 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:23.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:19:23.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.968077546, 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.094 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:23.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.968052037, 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967828869000002, 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.104 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:19:23.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:19:23.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967794203, 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.109 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:19:23.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:19:23.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967770041000001, 2024-09-11T06:19:23.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:19:23.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967519490000001, 2024-09-11T06:19:23.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:23.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967492108999998, 2024-09-11T06:19:23.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:19:23.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967468969999999, 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.129 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:19:23.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967240386, 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.134 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:19:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:19:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967203252000001, 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.139 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:19:23.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.967176063, 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:19:23.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.966907458000001, 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.149 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:19:23.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:19:23.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.966866156999998, 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:19:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.966841049999999, 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:19:23.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:19:23.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:19:23.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.966600285999998, 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:19:23.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:19:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.966565979999999, 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:19:23.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:19:23.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:19:23.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.173 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.966545213, 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.174 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.178 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.966314690000001, 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:19:23.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:19:23.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:19:23.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.183 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118795 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.966273522000002, 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99200256799999997, 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118795 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120454+0000", 2024-09-11T06:19:23.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.06e-07 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120457+0000", 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459999999999998e-06 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120464+0000", 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1350000000000003e-06 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120470+0000", 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120511+0000", 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1316000000000002e-05 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120517+0000", 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6790000000000002e-06 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112451+0000", 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.991934078 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112456+0000", 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.188 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.189 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:23.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:19:23.191 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:4721 write 0xb9460f1 thru 0xb94822d (0x213d bytes) 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:4722 trunc from 0xb94822e to 0xc3cbc41 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:4723 writesame 0xb1a27 thru 0xb704e data_size 0xc(0x5628 bytes) 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:4724 write 0xbc8d433 thru 0xbc92659 (0x5227 bytes) 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:4725 read 0x29fd353 thru 0x2a0a05b (0xcd09 bytes) 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:4726 writesame 0x8d97e9d thru 0x8d9f349 data_size 0x11(0x74ad bytes) 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:4729 trunc from 0xc3cbc41 to 0x17bf930 2024-09-11T06:19:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:4730 read 0x2cc199 thru 0x2d7c05 (0xba6d bytes) 2024-09-11T06:19:23.193 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:23.189+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:23.195 INFO:teuthology.orchestra.run.smithi070.stdout:4731 writesame 0x74b28ba thru 0x74bf44e data_size 0x13(0xcb95 bytes) 2024-09-11T06:19:23.196 INFO:teuthology.orchestra.run.smithi070.stdout:4732 read 0x2f9af21 thru 0x2fa2452 (0x7532 bytes) 2024-09-11T06:19:23.196 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.196 INFO:teuthology.orchestra.run.smithi070.stdout:4734 punch from 0x24e76f5 to 0x24ec44a, (0x4d55 bytes) 2024-09-11T06:19:23.197 INFO:teuthology.orchestra.run.smithi070.stdout:4735 writesame 0x2fe8a13 thru 0x2ff6072 data_size 0xa0(0xd660 bytes) 2024-09-11T06:19:23.198 INFO:teuthology.orchestra.run.smithi070.stdout:4736 read 0x6d6986c thru 0x6d7877b (0xef10 bytes) 2024-09-11T06:19:23.199 INFO:teuthology.orchestra.run.smithi070.stdout:4741 punch from 0x2f1e43f to 0x2f25c98, (0x7859 bytes) 2024-09-11T06:19:23.199 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.199 INFO:teuthology.orchestra.run.smithi070.stdout:4743 writesame 0x2dd60cc thru 0x2dd833e data_size 0x1(0x2273 bytes) 2024-09-11T06:19:23.203 INFO:teuthology.orchestra.run.smithi070.stdout:4744 writesame 0x41f0045 thru 0x41f1bf1 data_size 0xd(0x1bad bytes) 2024-09-11T06:19:23.207 INFO:teuthology.orchestra.run.smithi070.stdout:4745 punch from 0x28c4a31 to 0x28ce6c2, (0x9c91 bytes) 2024-09-11T06:19:23.207 INFO:teuthology.orchestra.run.smithi070.stdout:4746 read 0x69d4e17 thru 0x69e3917 (0xeb01 bytes) 2024-09-11T06:19:23.209 INFO:teuthology.orchestra.run.smithi070.stdout:4747 trunc from 0x74bf44f to 0x8b5520a 2024-09-11T06:19:23.215 INFO:teuthology.orchestra.run.smithi070.stdout:4750 trunc from 0x8b5520a to 0x9310ae8 2024-09-11T06:19:23.225 INFO:teuthology.orchestra.run.smithi070.stdout:4751 trunc from 0x9310ae8 to 0xdbe0d59 2024-09-11T06:19:23.231 INFO:teuthology.orchestra.run.smithi070.stdout:4752 read 0x46e3f35 thru 0x46eb94c (0x7a18 bytes) 2024-09-11T06:19:23.231 INFO:teuthology.orchestra.run.smithi070.stdout:4754 punch from 0xbcfdc88 to 0xbd04f51, (0x72c9 bytes) 2024-09-11T06:19:23.241 INFO:teuthology.orchestra.run.smithi070.stdout:4755 trunc from 0xdbe0d59 to 0x4e03a38 2024-09-11T06:19:23.248 INFO:teuthology.orchestra.run.smithi070.stdout:4756 punch from 0x3a71a38 to 0x3a79fe1, (0x85a9 bytes) 2024-09-11T06:19:23.248 INFO:teuthology.orchestra.run.smithi070.stdout:4758 writesame 0x2d6b867 thru 0x2d71c80 data_size 0x3(0x641a bytes) 2024-09-11T06:19:23.253 INFO:teuthology.orchestra.run.smithi070.stdout:4759 read 0x34cedfe thru 0x34db838 (0xca3b bytes) 2024-09-11T06:19:23.262 INFO:teuthology.orchestra.run.smithi070.stdout:4761 write 0x6fbb9e4 thru 0x6fbd98b (0x1fa8 bytes) 2024-09-11T06:19:23.263 INFO:teuthology.orchestra.run.smithi070.stdout:4762 write 0x5f6beb0 thru 0x5f74e0b (0x8f5c bytes) 2024-09-11T06:19:23.267 INFO:teuthology.orchestra.run.smithi070.stdout:4763 writesame 0x6535ae9 thru 0x6544fde data_size 0x5(0xf4f6 bytes) 2024-09-11T06:19:23.273 INFO:teuthology.orchestra.run.smithi070.stdout:4764 read 0x41a7b0c thru 0x41a80e2 (0x5d7 bytes) 2024-09-11T06:19:23.274 INFO:teuthology.orchestra.run.smithi070.stdout:4765 read 0x626a49a thru 0x626a555 (0xbc bytes) 2024-09-11T06:19:23.274 INFO:teuthology.orchestra.run.smithi070.stdout:4767 punch from 0x484b849 to 0x484c464, (0xc1b bytes) 2024-09-11T06:19:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:4768 write 0x7752a2d thru 0x7756c91 (0x4265 bytes) 2024-09-11T06:19:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:4770 write 0x6ed80f6 thru 0x6edb012 (0x2f1d bytes) 2024-09-11T06:19:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:4771 read 0x36d9a09 thru 0x36e361a (0x9c12 bytes) 2024-09-11T06:19:23.291 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:23.289+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:23.291 INFO:teuthology.orchestra.run.smithi070.stdout:4772 trunc from 0x7756c92 to 0xd49cd8c 2024-09-11T06:19:23.296 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.304 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:23.304 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:23.304 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:23.304 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:23.312 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:23.313 INFO:teuthology.orchestra.run.smithi070.stdout:4775 trunc from 0xd49cd8c to 0xadc7 2024-09-11T06:19:23.352 INFO:teuthology.orchestra.run.smithi070.stdout:4776 write 0xe387873 thru 0xe389edf (0x266d bytes) 2024-09-11T06:19:23.356 INFO:teuthology.orchestra.run.smithi070.stdout:4777 trunc from 0xe389ee0 to 0xdb37a80 2024-09-11T06:19:23.362 INFO:teuthology.orchestra.run.smithi070.stdout:4778 writesame 0xcb578bf thru 0xcb608e4 data_size 0x1(0x9026 bytes) 2024-09-11T06:19:23.381 INFO:teuthology.orchestra.run.smithi070.stdout:4780 punch from 0x1909702 to 0x190eb34, (0x5432 bytes) 2024-09-11T06:19:23.382 INFO:teuthology.orchestra.run.smithi070.stdout:4782 writesame 0x8f328aa thru 0x8f39a47 data_size 0x1(0x719e bytes) 2024-09-11T06:19:23.392 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:23.391+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:23.394 INFO:teuthology.orchestra.run.smithi070.stdout:4783 writesame 0xbea2548 thru 0xbeab522 data_size 0x1(0x8fdb bytes) 2024-09-11T06:19:23.412 INFO:teuthology.orchestra.run.smithi070.stdout:4784 writesame 0x3f784d7 thru 0x3f7e80b data_size 0x1(0x6335 bytes) 2024-09-11T06:19:23.427 INFO:teuthology.orchestra.run.smithi070.stdout:4785 trunc from 0xdb37a80 to 0xe077b02 2024-09-11T06:19:23.433 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.433 INFO:teuthology.orchestra.run.smithi070.stdout:4788 read 0xdfc7e7d thru 0xdfca3b5 (0x2539 bytes) 2024-09-11T06:19:23.433 INFO:teuthology.orchestra.run.smithi070.stdout:4789 read 0xd170383 thru 0xd175eaf (0x5b2d bytes) 2024-09-11T06:19:23.433 INFO:teuthology.orchestra.run.smithi070.stdout:4791 read 0x8bba357 thru 0x8bc1ac8 (0x7772 bytes) 2024-09-11T06:19:23.433 INFO:teuthology.orchestra.run.smithi070.stdout:4792 write 0x887b7 thru 0x8ed53 (0x659d bytes) 2024-09-11T06:19:23.434 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.434 INFO:teuthology.orchestra.run.smithi070.stdout:4795 read 0x4de5305 thru 0x4df4ab6 (0xf7b2 bytes) 2024-09-11T06:19:23.434 INFO:teuthology.orchestra.run.smithi070.stdout:4797 write 0x4175d03 thru 0x417fcb0 (0x9fae bytes) 2024-09-11T06:19:23.437 INFO:teuthology.orchestra.run.smithi070.stdout:4799 write 0x235d7c thru 0x241f40 (0xc1c5 bytes) 2024-09-11T06:19:23.439 INFO:teuthology.orchestra.run.smithi070.stdout:4801 write 0x461ae45 thru 0x4627937 (0xcaf3 bytes) 2024-09-11T06:19:23.441 INFO:teuthology.orchestra.run.smithi070.stdout:4802 write 0x77a1f7c thru 0x77a3a09 (0x1a8e bytes) 2024-09-11T06:19:23.444 INFO:teuthology.orchestra.run.smithi070.stdout:4803 read 0x905f57d thru 0x906edd2 (0xf856 bytes) 2024-09-11T06:19:23.444 INFO:teuthology.orchestra.run.smithi070.stdout:4804 write 0xdbfaa02 thru 0xdbfbbf9 (0x11f8 bytes) 2024-09-11T06:19:23.448 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.448 INFO:teuthology.orchestra.run.smithi070.stdout:4806 read 0x8691ae4 thru 0x86a1aaf (0xffcc bytes) 2024-09-11T06:19:23.449 INFO:teuthology.orchestra.run.smithi070.stdout:4808 read 0x6ba7e4f thru 0x6badecd (0x607f bytes) 2024-09-11T06:19:23.449 INFO:teuthology.orchestra.run.smithi070.stdout:4809 writesame 0x709d9d3 thru 0x70a30dc data_size 0xd(0x570a bytes) 2024-09-11T06:19:23.456 INFO:teuthology.orchestra.run.smithi070.stdout:4810 read 0xdb3fdb3 thru 0xdb44dc2 (0x5010 bytes) 2024-09-11T06:19:23.456 INFO:teuthology.orchestra.run.smithi070.stdout:4811 punch from 0x6432805 to 0x64410ea, (0xe8e5 bytes) 2024-09-11T06:19:23.456 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.456 INFO:teuthology.orchestra.run.smithi070.stdout:4813 read 0x396a17d thru 0x3975223 (0xb0a7 bytes) 2024-09-11T06:19:23.461 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:23.461 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:23.464 INFO:teuthology.orchestra.run.smithi070.stdout:4814 trunc from 0xe077b02 to 0x70b63eb 2024-09-11T06:19:23.470 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:23.497 INFO:teuthology.orchestra.run.smithi070.stdout:4815 write 0xed5c161 thru 0xed5d3f3 (0x1293 bytes) 2024-09-11T06:19:23.501 INFO:teuthology.orchestra.run.smithi070.stdout:4816 punch from 0x20f5c98 to 0x21023fd, (0xc765 bytes) 2024-09-11T06:19:23.501 INFO:teuthology.orchestra.run.smithi070.stdout:4817 writesame 0x4d18d78 thru 0x4d2625d data_size 0x11(0xd4e6 bytes) 2024-09-11T06:19:23.504 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.504 INFO:teuthology.orchestra.run.smithi070.stdout:4820 read 0x954500d thru 0x9554a90 (0xfa84 bytes) 2024-09-11T06:19:23.504 INFO:teuthology.orchestra.run.smithi070.stdout:4822 punch from 0xdfd3ad5 to 0xdfe0970, (0xce9b bytes) 2024-09-11T06:19:23.504 INFO:teuthology.orchestra.run.smithi070.stdout:4831 writesame 0x6a8e125 thru 0x6a917b8 data_size 0x4(0x3694 bytes) 2024-09-11T06:19:23.506 INFO:teuthology.orchestra.run.smithi070.stdout:4833 punch from 0xb0ca33b to 0xb0cae97, (0xb5c bytes) 2024-09-11T06:19:23.506 INFO:teuthology.orchestra.run.smithi070.stdout:4835 write 0xd9f2466 thru 0xd9ffa65 (0xd600 bytes) 2024-09-11T06:19:23.509 INFO:teuthology.orchestra.run.smithi070.stdout:4837 punch from 0x9f58797 to 0x9f5a939, (0x21a2 bytes) 2024-09-11T06:19:23.509 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.509 INFO:teuthology.orchestra.run.smithi070.stdout:4839 read 0xe9a4926 thru 0xe9a6903 (0x1fde bytes) 2024-09-11T06:19:23.509 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.510 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.510 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.510 INFO:teuthology.orchestra.run.smithi070.stdout:4845 read 0xd9fc7c1 thru 0xd9fdd53 (0x1593 bytes) 2024-09-11T06:19:23.510 INFO:teuthology.orchestra.run.smithi070.stdout:4846 read 0xa6374aa thru 0xa64206e (0xabc5 bytes) 2024-09-11T06:19:23.510 INFO:teuthology.orchestra.run.smithi070.stdout:4847 write 0x34b38de thru 0x34b6879 (0x2f9c bytes) 2024-09-11T06:19:23.514 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:23.513+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:23.515 INFO:teuthology.orchestra.run.smithi070.stdout:4848 read 0xb760f52 thru 0xb761835 (0x8e4 bytes) 2024-09-11T06:19:23.515 INFO:teuthology.orchestra.run.smithi070.stdout:4849 write 0xeb08cea thru 0xeb15422 (0xc739 bytes) 2024-09-11T06:19:23.519 INFO:teuthology.orchestra.run.smithi070.stdout:4852 read 0xbf03ab6 thru 0xbf03e88 (0x3d3 bytes) 2024-09-11T06:19:23.519 INFO:teuthology.orchestra.run.smithi070.stdout:4853 read 0xc4e46c thru 0xc5b3a2 (0xcf37 bytes) 2024-09-11T06:19:23.519 INFO:teuthology.orchestra.run.smithi070.stdout:4854 read 0xc73b9f0 thru 0xc743269 (0x787a bytes) 2024-09-11T06:19:23.520 INFO:teuthology.orchestra.run.smithi070.stdout:4857 write 0x978a528 thru 0x978da9f (0x3578 bytes) 2024-09-11T06:19:23.522 INFO:teuthology.orchestra.run.smithi070.stdout:4859 write 0xac712c2 thru 0xac80313 (0xf052 bytes) 2024-09-11T06:19:23.525 INFO:teuthology.orchestra.run.smithi070.stdout:4860 read 0xb008cbc thru 0xb017933 (0xec78 bytes) 2024-09-11T06:19:23.526 INFO:teuthology.orchestra.run.smithi070.stdout:4861 punch from 0xe62404b to 0xe62586f, (0x1824 bytes) 2024-09-11T06:19:23.526 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.526 INFO:teuthology.orchestra.run.smithi070.stdout:4863 punch from 0x66f8848 to 0x66fc850, (0x4008 bytes) 2024-09-11T06:19:23.527 INFO:teuthology.orchestra.run.smithi070.stdout:4865 trunc from 0xed5d3f4 to 0xd892421 2024-09-11T06:19:23.533 INFO:teuthology.orchestra.run.smithi070.stdout:4868 write 0x69aa7af thru 0x69b3d06 (0x9558 bytes) 2024-09-11T06:19:23.543 INFO:teuthology.orchestra.run.smithi070.stdout:4869 write 0xe435d7b thru 0xe44389e (0xdb24 bytes) 2024-09-11T06:19:23.546 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:23.546 INFO:teuthology.orchestra.run.smithi070.stdout:4871 writesame 0xc380c27 thru 0xc38fdf7 data_size 0x5(0xf1d1 bytes) 2024-09-11T06:19:23.553 INFO:teuthology.orchestra.run.smithi070.stdout:4873 trunc from 0xe44389f to 0xdbc767e 2024-09-11T06:19:23.561 INFO:teuthology.orchestra.run.smithi070.stdout:4874 read 0xcffcfb7 thru 0xd00b363 (0xe3ad bytes) 2024-09-11T06:19:23.564 INFO:teuthology.orchestra.run.smithi070.stdout:4875 trunc from 0xdbc767e to 0xbdedd16 2024-09-11T06:19:23.576 INFO:teuthology.orchestra.run.smithi070.stdout:4876 trunc from 0xbdedd16 to 0xe3db0e0 2024-09-11T06:19:23.581 INFO:teuthology.orchestra.run.smithi070.stdout:4877 writesame 0xcd33efa thru 0xcd40d55 data_size 0x5e(0xce5c bytes) 2024-09-11T06:19:23.583 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:23.583 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342348986999994, 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:19:23.588 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342336248999999, 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.589 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:19:23.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:19:23.593 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342325115999998, 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:19:23.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342314528000003, 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:23.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342304033000005, 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:19:23.603 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.607 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342293720000001, 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:19:23.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342283178000002, 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.612 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:19:23.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:19:23.616 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342272871999995, 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.617 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:19:23.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.621 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342257294000007, 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:19:23.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.342238288999994, 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.630 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282708916000004, 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:19:23.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282690445, 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.635 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.639 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282671954999998, 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:19:23.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282654887000007, 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:23.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282636855999996, 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:19:23.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282614671999994, 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:23.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.657 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282596679999997, 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:19:23.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:19:23.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:23.662 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282579025999993, 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:19:23.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282556110000002, 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.282537722000001, 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:19:23.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:19:23.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:19:23.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:19:23.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:23.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:23.676 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:4878 write 0x4ee891e thru 0x4eea3c9 (0x1aac bytes) 2024-09-11T06:19:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:4879 clone 34 order 24 su 1048576 sc 8 2024-09-11T06:19:23.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:23.678 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:23.676+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:23.778 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:23.777+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:23.781 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:23.781 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:23.781 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:23.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:23.879 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:23.878+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:23.932 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:23.933 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:23.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:23.985 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:23.984+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:24.045 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.045 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130410 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10993664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896807199000001, 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043187259999999998, 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130410 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:24.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146584+0000", 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146592+0000", 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5619999999999998e-06 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146598+0000", 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189643+0000", 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043045091000000001 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189704+0000", 2024-09-11T06:19:24.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0911e-05 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189769+0000", 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5745000000000002e-05 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130411 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 11001856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:24.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896785057999999, 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043307804999999998, 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130411 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146605+0000", 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146613+0000", 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6729999999999998e-06 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146621+0000", 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8849999999999999e-06 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146626+0000", 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9520000000000002e-06 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189802+0000", 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043175603 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189848+0000", 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6465999999999999e-05 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189912+0000", 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3835000000000001e-05 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130444 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10752000~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896756258, 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043428937000000001, 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130444 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:24.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146635+0000", 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146642+0000", 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8680000000000001e-06 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146649+0000", 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2319999999999998e-06 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189933+0000", 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043284979000000001 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189982+0000", 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8513000000000001e-05 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190062+0000", 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9929e-05 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130445 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10760192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.059 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896728734, 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043549156999999998, 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130445 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146663+0000", 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146678+0000", 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5201000000000001e-05 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146684+0000", 2024-09-11T06:19:24.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190086+0000", 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043401281 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190147+0000", 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1246000000000003e-05 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190210+0000", 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2720999999999998e-05 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130446 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10768384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896691652000001, 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043660235999999998, 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130446 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146700+0000", 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-06 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146709+0000", 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3520000000000007e-06 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146718+0000", 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6830000000000003e-06 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190233+0000", 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043514440000000001 2024-09-11T06:19:24.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190283+0000", 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0178e-05 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190358+0000", 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4796999999999996e-05 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130447 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10776576~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896627730999999, 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043732383999999999, 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130447 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.069 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:24.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146765+0000", 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146782+0000", 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7282000000000002e-05 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146789+0000", 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7279999999999998e-06 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190386+0000", 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043596843000000003 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190431+0000", 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5751999999999998e-05 2024-09-11T06:19:24.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190494+0000", 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2614999999999996e-05 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130448 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10784768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896585995999999, 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043831475000000002, 2024-09-11T06:19:24.073 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130448 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:24.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146811+0000", 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146814+0000", 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.543e-06 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146823+0000", 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8699999999999998e-06 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146828+0000", 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190522+0000", 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043694033 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190572+0000", 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0269999999999998e-05 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190635+0000", 2024-09-11T06:19:24.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2719999999999996e-05 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130449 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10792960~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.89654934, 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043926146999999999, 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130449 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8200000000000001e-07 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146842+0000", 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5910000000000001e-06 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146852+0000", 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0341e-05 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146855+0000", 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190655+0000", 2024-09-11T06:19:24.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043800258000000002 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190706+0000", 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0226999999999999e-05 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190766+0000", 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0517999999999999e-05 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130450 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10801152~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896530133999999, 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044072734000000002, 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130450 2024-09-11T06:19:24.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146861+0000", 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3379999999999999e-06 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146865+0000", 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3220000000000003e-06 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146868+0000", 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190792+0000", 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043923845000000003 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190853+0000", 2024-09-11T06:19:24.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1008999999999998e-05 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190932+0000", 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9326000000000006e-05 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130451 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10809344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:24.087 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896518100000002, 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044195328999999998, 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130451 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147086+0000", 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021491899999999999 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147096+0000", 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0217999999999999e-05 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147105+0000", 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147112+0000", 2024-09-11T06:19:24.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190954+0000", 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043842032000000003 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191004+0000", 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0482999999999998e-05 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191066+0000", 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2420000000000002e-05 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130452 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10817536~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.896269042, 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044100716999999998, 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130452 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147905+0000", 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078465999999999996 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147909+0000", 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2549999999999999e-06 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147919+0000", 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0236e-05 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147927+0000", 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8679999999999999e-06 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191092+0000", 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043164431000000003 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191142+0000", 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9923000000000003e-05 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191221+0000", 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9344000000000005e-05 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130453 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10825728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.895428484, 2024-09-11T06:19:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392063000000002, 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130453 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147963+0000", 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.795e-06 2024-09-11T06:19:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147967+0000", 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9979999999999997e-06 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147970+0000", 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191246+0000", 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043275980999999998 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191291+0000", 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5498999999999999e-05 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191353+0000", 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999994e-05 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130454 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10833920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.895415293999999, 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043530384999999998, 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130454 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5199999999999998e-07 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147975+0000", 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.195e-06 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147979+0000", 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.196e-06 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147981+0000", 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191374+0000", 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392673 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191441+0000", 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191504+0000", 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3602999999999994e-05 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130455 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10842112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.895404648, 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043653780000000003, 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130455 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:19:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147986+0000", 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.35e-06 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147989+0000", 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147992+0000", 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191525+0000", 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043533080000000002 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191577+0000", 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2506999999999997e-05 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191638+0000", 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0903999999999998e-05 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130456 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10850304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.895394207999999, 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.04379475, 2024-09-11T06:19:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130456 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149579+0000", 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001583877 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149584+0000", 2024-09-11T06:19:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9359999999999998e-06 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149593+0000", 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2429999999999994e-06 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149598+0000", 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0919999999999997e-06 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191663+0000", 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042064987999999998 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191714+0000", 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0506000000000001e-05 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191790+0000", 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:19:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130463 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10907648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.893715222000001, 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043098538999999998, 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130463 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.28e-07 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149679+0000", 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5449999999999997e-06 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149682+0000", 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.455e-06 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149685+0000", 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.526e-06 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192662+0000", 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042976939999999998 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192712+0000", 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0682e-05 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192773+0000", 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0163e-05 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130464 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10915840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.893701098000001, 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043257601999999999, 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130464 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149920+0000", 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023134100000000001 2024-09-11T06:19:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149923+0000", 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000001e-06 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149932+0000", 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7080000000000003e-06 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149939+0000", 2024-09-11T06:19:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6510000000000001e-06 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192802+0000", 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042862572000000002 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192861+0000", 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9077999999999999e-05 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192946+0000", 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4901999999999995e-05 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130465 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10924032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.893442101000002, 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043129278, 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130465 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149949+0000", 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.886e-06 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149953+0000", 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149956+0000", 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192970+0000", 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043013844000000002 2024-09-11T06:19:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193017+0000", 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6530999999999999e-05 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193076+0000", 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9824999999999997e-05 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130466 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10932224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.893429529999999, 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043272974999999998, 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130466 2024-09-11T06:19:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151901+0000", 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001941356 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151905+0000", 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000003e-06 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151912+0000", 2024-09-11T06:19:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0679999999999999e-06 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151916+0000", 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9829999999999998e-06 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193097+0000", 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041180814000000003 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193161+0000", 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3584000000000007e-05 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193233+0000", 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2074000000000001e-05 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130516 3.1c 3:3f6bd6e9:::rbd_object_map.116df114867d.000000000000003e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.890227047, 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043688850000000001, 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130516 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153163+0000", 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8299999999999996e-07 2024-09-11T06:19:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153168+0000", 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153176+0000", 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153181+0000", 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3539999999999999e-06 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194609+0000", 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041427972 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194661+0000", 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2308999999999997e-05 2024-09-11T06:19:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194883+0000", 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221466 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196734+0000", 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018515039999999999 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196752+0000", 2024-09-11T06:19:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7558e-05 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196812+0000", 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9639000000000003e-05 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196851+0000", 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9536999999999998e-05 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.140 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:24.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:19:24.142 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:24.140+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:24.241 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:24.241+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:24.284 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:24.284 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:24.284 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:24.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:24.378 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:24.377+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:24.437 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:24.437 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:24.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:24.442+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:24.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:24.545 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:24.544+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:24.591 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118743 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:24.591 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.470904572999999, 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99346091199999997, 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118743 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118559+0000", 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:24.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118568+0000", 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4279999999999996e-06 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118589+0000", 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1129999999999999e-05 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118599+0000", 2024-09-11T06:19:24.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8789999999999998e-06 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118670+0000", 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1087999999999994e-05 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118679+0000", 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.115e-06 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111727+0000", 2024-09-11T06:19:24.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99304786499999997 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111848+0000", 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121347 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112017+0000", 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016935499999999999 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118751 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.470603173000001, 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99440886299999998, 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118751 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.85e-07 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118863+0000", 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:24.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2741999999999999e-05 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118884+0000", 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7109999999999995e-06 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118951+0000", 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7347000000000004e-05 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:24.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118958+0000", 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0180000000000004e-06 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113102+0000", 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99414409999999998 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113179+0000", 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113267+0000", 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7745999999999996e-05 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118759 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.470295431, 2024-09-11T06:19:24.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99428308499999996, 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118759 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:24.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119167+0000", 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119173+0000", 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0859999999999998e-06 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119187+0000", 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4133e-05 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119194+0000", 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-06 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119251+0000", 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6063999999999997e-05 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119259+0000", 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9750000000000007e-06 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113295+0000", 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99403649000000005 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113370+0000", 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5266999999999996e-05 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113449+0000", 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8396e-05 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118767 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:24.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.469996555000002, 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99424699400000005, 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118767 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119465+0000", 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2500000000000004e-07 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119472+0000", 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3330000000000002e-06 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119485+0000", 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2782999999999999e-05 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9830000000000002e-06 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119548+0000", 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4274000000000002e-05 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113477+0000", 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99392198799999998 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113607+0000", 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012957600000000001 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113711+0000", 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104832 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118775 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.469679581000001, 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99457822699999998, 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118775 2024-09-11T06:19:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119782+0000", 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4e-07 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119787+0000", 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119800+0000", 2024-09-11T06:19:24.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3728e-05 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119808+0000", 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.661e-06 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119865+0000", 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7345000000000001e-05 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119876+0000", 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0393e-05 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114042+0000", 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99416629599999995 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114146+0000", 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104091 2024-09-11T06:19:24.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114360+0000", 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000213544 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118783 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.469361092, 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99444126499999996, 2024-09-11T06:19:24.618 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118783 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120101+0000", 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120105+0000", 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6269999999999999e-06 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120117+0000", 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1858999999999999e-05 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120122+0000", 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9439999999999996e-06 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1106999999999998e-05 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120168+0000", 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6870000000000002e-06 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114344+0000", 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.994176328 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114440+0000", 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6028999999999998e-05 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114541+0000", 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100813 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.469073081000001, 2024-09-11T06:19:24.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119572 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 14286848~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.461802154000001, 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018157623000000001, 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119572 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127661+0000", 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127669+0000", 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6380000000000004e-06 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127673+0000", 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7620000000000003e-06 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145694+0000", 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018020806 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145758+0000", 2024-09-11T06:19:24.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3770999999999996e-05 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145816+0000", 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8476000000000001e-05 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119573 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 15204352~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:24.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.461763063999999, 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018351035000000002, 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119573 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127699+0000", 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-07 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127718+0000", 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9667999999999999e-05 2024-09-11T06:19:24.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127727+0000", 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6999999999999997e-06 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127733+0000", 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145846+0000", 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018113073 2024-09-11T06:19:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145959+0000", 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011347 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146049+0000", 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9926000000000006e-05 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119574 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.461721154999999, 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018368603000000001, 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119574 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.637 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127742+0000", 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8109999999999999e-06 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127749+0000", 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5749999999999997e-06 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127764+0000", 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5361000000000001e-05 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146094+0000", 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01833015 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146108+0000", 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4265e-05 2024-09-11T06:19:24.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119575 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.461689067999998, 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018387018000000001, 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119575 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6899999999999998e-07 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127775+0000", 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1110000000000002e-06 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127781+0000", 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4969999999999998e-06 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127786+0000", 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146148+0000", 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018362195000000001 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146159+0000", 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0903e-05 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119576 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.461668294999999, 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018419563, 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119576 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127795+0000", 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:19:24.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127802+0000", 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.489e-06 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127806+0000", 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7430000000000002e-06 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146199+0000", 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018393093999999999 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146212+0000", 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2812e-05 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119577 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.649 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.461648099000001, 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018434368, 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119577 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127837+0000", 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3349999999999998e-05 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127844+0000", 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2080000000000003e-06 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127849+0000", 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:24.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146235+0000", 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018386120999999998 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146247+0000", 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119578 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.461604797, 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018438821000000001, 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119578 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127857+0000", 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127859+0000", 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127865+0000", 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127870+0000", 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8879999999999996e-06 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146285+0000", 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018414950999999999 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146295+0000", 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7650000000000005e-06 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119579 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.657 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.461584220999999, 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018456706999999999, 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119579 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127879+0000", 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8640000000000001e-06 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127886+0000", 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127891+0000", 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0080000000000002e-06 2024-09-11T06:19:24.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146323+0000", 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018431811999999999 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146334+0000", 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0814e-05 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119721 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.459082985999999, 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018040231, 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119721 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.662 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130397+0000", 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8663000000000001e-05 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130406+0000", 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9619999999999999e-06 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130412+0000", 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4210000000000003e-06 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148411+0000", 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017999004999999998 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148418+0000", 2024-09-11T06:19:24.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7519999999999996e-06 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119722 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.459030726999998, 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018031229999999999, 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119722 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130431+0000", 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1800000000000005e-07 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130434+0000", 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4450000000000001e-06 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130442+0000", 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130448+0000", 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4519999999999996e-06 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148451+0000", 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01800295 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148462+0000", 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0828e-05 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119723 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.459004987, 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018050743000000001, 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119723 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130457+0000", 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000001e-07 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130459+0000", 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0549999999999998e-06 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130466+0000", 2024-09-11T06:19:24.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130477+0000", 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878999999999999e-05 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148496+0000", 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018784999999999 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148507+0000", 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0550000000000001e-05 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119724 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.458975383999999, 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038285000000001, 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119724 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5699999999999998e-07 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130488+0000", 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3709999999999998e-06 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130495+0000", 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9260000000000003e-06 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130500+0000", 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9400000000000001e-06 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148519+0000", 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018688000000001 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148524+0000", 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.677 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:140527 3.e 3:706ab4c5:::rbd_header.116d341f54e3:head [watch ping cookie 139721594455552 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:22.723309+0000", 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.866151565, 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.39742399, 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 140527 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.678 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723309+0000", 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723309+0000", 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723310+0000", 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3300000000000003e-07 2024-09-11T06:19:24.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723313+0000", 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5829999999999998e-06 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723320+0000", 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0809999999999999e-06 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723326+0000", 2024-09-11T06:19:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723401+0000", 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4895999999999996e-05 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723413+0000", 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2322e-05 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:23.120563+0000", 2024-09-11T06:19:24.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.39715022900000002 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:23.120640+0000", 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6773999999999994e-05 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:23.120733+0000", 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3401999999999998e-05 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:24.682 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:24.684 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:24.683+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:24.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:24.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:24.812 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:24.811+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:24.829 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:24.829 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:24.830 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:24.830 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:24.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:24.885 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:24.884+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:24.888 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:24.888 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:24.906 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:24.906 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:24.923 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:24.924 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:24.941 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:24.941 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:24.958 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:24.958 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:24.975 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:24.975 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:24.986 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:24.985+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:24.987 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:24.987 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:24.992 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:24.992 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:24.996 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:25.009 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:25.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:25.086+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:25.113 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:25.113 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:25.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:25.132 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:19:25.133 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:19:25.133 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T06:19:25.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:19:25.188 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:25.186+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:25.234 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:25.234 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:25.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:25.289 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:25.289+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:25.358 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:25.358 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:25.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:25.411 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:25.410+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:25.466 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 157, 2024-09-11T06:19:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:19:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:19:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:19:25.108498+0000", 2024-09-11T06:19:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:18:57.153745+0000", 2024-09-11T06:19:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:16:42.356322+0000", 2024-09-11T06:19:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:19:25.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5806080, 2024-09-11T06:19:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:19:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T06:19:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2024-09-11T06:19:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:19:25.468 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:19:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:19:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:19:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 7, 2024-09-11T06:19:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:19:25.469 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:19:25.471 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:19:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:19:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:19:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:19:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:19:25.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T06:19:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:19:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:19:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:19:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:19:25.473 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:19:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:19:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:19:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:19:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:25.474 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:25.475 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:19:25.476 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:19:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:19:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:19:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:19:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:25.477 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.478 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:19:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:25.479 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:25.480 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:25.481 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:25.482 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:25.483 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.484 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:25.485 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:25.486 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:25.487 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:25.489 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:19:25.490 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:25.491 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:19:25.492 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "157", 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:25.493 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 70, 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 157, 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:25.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:25.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:25.496 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:19:25.497 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:25.498 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0.630950927734375, 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 155, 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:25.501 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:25.502 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:19:25.503 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.6932525634765625, 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:19:25.504 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 54, 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 92, 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 154, 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 56, 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:25.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:25.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/747530186", 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/747530186", 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/747530186", 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/747530186", 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:19:25.509 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 109, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 130, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 154, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 110, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:25.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/4176263936", 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/4176263936", 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/4176263936", 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/4176263936", 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:25.515 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 133, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:19:25.519 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:25.520 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 154, 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:19:25.522 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:25.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:25.526 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 130, 2024-09-11T06:19:25.527 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:19:25.528 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.529 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:19:25.531 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:19:25.532 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0.7060699462890625, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:19:25.533 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 142, 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:25.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:19:25.538 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.019287109375, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 110, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.539 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.540 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:25.541 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.542 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.543 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:25.544 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:25.545 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 56 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 110 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:25.547 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:25.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:25.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.550 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.3", 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: 6, 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: 3 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.f", 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: 7, 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.551 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.12", 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 3, 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 4 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:25.552 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 68, 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:25.554 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [ 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 66, 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:19:25.555 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:19:25.556 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:19:25.556 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:19:25.556 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:19:25.556 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:19:25.556 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:19:25.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:25.556 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:25.557 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:25.557 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:25.558 INFO:tasks.thrashosds.thrasher:j is {'epoch': 157, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:19:25.108498+0000', 'last_up_change': '2024-09-11T06:18:57.153745+0000', 'last_in_change': '2024-09-11T06:16:42.356322+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 70, 'snap_epoch': 157, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 0.630950927734375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 155, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6932525634765625, 'last_clean_begin': 15, 'last_clean_end': 54, 'up_from': 92, 'up_thru': 154, 'down_at': 56, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 747530186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 747530186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 747530186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 747530186}]}, 'public_addr': '172.21.15.70:6817/747530186', 'cluster_addr': '172.21.15.70:6819/747530186', 'heartbeat_back_addr': '172.21.15.70:6823/747530186', 'heartbeat_front_addr': '172.21.15.70:6821/747530186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 109, 'up_from': 130, 'up_thru': 154, 'down_at': 110, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 4176263936}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4176263936}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4176263936}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4176263936}]}, 'public_addr': '172.21.15.70:6809/4176263936', 'cluster_addr': '172.21.15.70:6811/4176263936', 'heartbeat_back_addr': '172.21.15.70:6815/4176263936', 'heartbeat_front_addr': '172.21.15.70:6813/4176263936', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 154, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 0.7060699462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 142, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.019287109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 110, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 56}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 110}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.3', 'osds': [6, 3]}, {'pgid': '3.f', 'osds': [7, 2]}], 'pg_upmap_items': [{'pgid': '3.12', 'mappings': [{'from': 3, 'to': 4}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 68, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 66, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:19:25.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:19:25.560 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:25.560 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:25.556+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:25.658 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:25.656+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:25.668 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:25.668 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:25.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:25.758 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:25.757+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:25.819 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:25.819 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:25.827 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:25.860 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:25.859+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:25.877 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:25.878 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:19:25.888 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-09-11T06:19:25.110226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1487941319,"num_objects":965,"num_object_clones":0,"num_object_copies":1930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":965,"num_whiteouts":0,"num_read":135428,"num_read_kb":1083259,"num_write":18745,"num_write_kb":732947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":98107159,"num_keys_recovered":247,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13028,"ondisk_log_size":13028,"up":82,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":408608,"kb_used_data":97252,"kb_used_omap":37,"kb_used_meta":311130,"kb_avail":754566112,"statfs":{"total":773094113280,"available":772675698688,"internally_reserved":0,"allocated":99586048,"data_stored":748403887,"data_compressed":21820160,"data_compressed_allocated":65925120,"data_compressed_original":726181873,"omap_allocated":38504,"internal_metadata":318597528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1,0,2],"upper_bound":4096},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34567160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":278,"num_read_kb":8976,"num_write":81,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":28789276,"num_keys_recovered":90,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.999713"},"pg_stats":[{"pgid":"3.1f","version":"148'251","reported_seq":2679,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.114848+0000","last_change":"2024-09-11T06:19:19.222204+0000","last_active":"2024-09-11T06:19:22.114848+0000","last_peered":"2024-09-11T06:19:22.114848+0000","last_clean":"2024-09-11T06:19:22.114848+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:19:22.114848+0000","last_undegraded":"2024-09-11T06:19:22.114848+0000","last_fullsized":"2024-09-11T06:19:22.114848+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:16:44.507617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000484826,"stat_sum":{"num_bytes":56055224,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2140,"num_read_kb":25315,"num_write":413,"num_write_kb":24967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.1e","version":"148'369","reported_seq":4999,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115310+0000","last_change":"2024-09-11T06:19:19.222119+0000","last_active":"2024-09-11T06:19:22.115310+0000","last_peered":"2024-09-11T06:19:22.115310+0000","last_clean":"2024-09-11T06:19:22.115310+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:19:22.115310+0000","last_undegraded":"2024-09-11T06:19:22.115310+0000","last_fullsized":"2024-09-11T06:19:22.115310+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:41.688670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048398899999999999,"stat_sum":{"num_bytes":15350105,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5236,"num_read_kb":19828,"num_write":559,"num_write_kb":13962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.1d","version":"144'742","reported_seq":5516,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115666+0000","last_change":"2024-09-11T06:19:19.224021+0000","last_active":"2024-09-11T06:19:22.115666+0000","last_peered":"2024-09-11T06:19:22.115666+0000","last_clean":"2024-09-11T06:19:22.115666+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:19:22.115666+0000","last_undegraded":"2024-09-11T06:19:22.115666+0000","last_fullsized":"2024-09-11T06:19:22.115666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:28.108239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096114400000000004,"stat_sum":{"num_bytes":112371308,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":6824,"num_read_kb":76233,"num_write":1215,"num_write_kb":34174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.1c","version":"149'471","reported_seq":10209,"reported_epoch":153,"state":"peering","last_fresh":"2024-09-11T06:19:21.607056+0000","last_change":"2024-09-11T06:19:22.113206+0000","last_active":"2024-09-11T06:19:22.113206+0000","last_peered":"2024-09-11T06:19:21.607056+0000","last_clean":"2024-09-11T06:19:18.217935+0000","last_became_active":"2024-09-11T06:19:21.477140+0000","last_became_peered":"2024-09-11T06:19:21.477140+0000","last_unstale":"2024-09-11T06:19:21.607056+0000","last_undegraded":"2024-09-11T06:19:21.607056+0000","last_fullsized":"2024-09-11T06:19:21.112034+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036621499999999998,"stat_sum":{"num_bytes":59774568,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":11171,"num_read_kb":45733,"num_write":758,"num_write_kb":13479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":5117157,"num_keys_recovered":128,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"42","length":"1"}]},{"pgid":"3.1b","version":"149'404","reported_seq":2836,"reported_epoch":153,"state":"peering","last_fresh":"2024-09-11T06:19:21.571652+0000","last_change":"2024-09-11T06:19:22.113349+0000","last_active":"2024-09-11T06:19:22.113349+0000","last_peered":"2024-09-11T06:19:21.571652+0000","last_clean":"2024-09-11T06:19:18.262022+0000","last_became_active":"2024-09-11T06:19:21.127127+0000","last_became_peered":"2024-09-11T06:19:21.127127+0000","last_unstale":"2024-09-11T06:19:21.571652+0000","last_undegraded":"2024-09-11T06:19:21.571652+0000","last_fullsized":"2024-09-11T06:19:21.115203+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013586539999999999,"stat_sum":{"num_bytes":25423430,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2671,"num_read_kb":29179,"num_write":601,"num_write_kb":23369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":12656084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"42","length":"1"}]},{"pgid":"3.1a","version":"153'435","reported_seq":9028,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.114779+0000","last_change":"2024-09-11T06:19:19.221933+0000","last_active":"2024-09-11T06:19:22.114779+0000","last_peered":"2024-09-11T06:19:22.114779+0000","last_clean":"2024-09-11T06:19:22.114779+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:19:22.114779+0000","last_undegraded":"2024-09-11T06:19:22.114779+0000","last_fullsized":"2024-09-11T06:19:22.114779+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:49:15.036414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038541299999999998,"stat_sum":{"num_bytes":56580926,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":9249,"num_read_kb":63688,"num_write":585,"num_write_kb":25250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.19","version":"153'312","reported_seq":3005,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.112864+0000","last_change":"2024-09-11T06:19:19.220120+0000","last_active":"2024-09-11T06:19:22.112864+0000","last_peered":"2024-09-11T06:19:22.112864+0000","last_clean":"2024-09-11T06:19:22.112864+0000","last_became_active":"2024-09-11T06:18:19.336396+0000","last_became_peered":"2024-09-11T06:18:19.336396+0000","last_unstale":"2024-09-11T06:19:22.112864+0000","last_undegraded":"2024-09-11T06:19:22.112864+0000","last_fullsized":"2024-09-11T06:19:22.112864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:45.768762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044131299999999998,"stat_sum":{"num_bytes":22382478,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3227,"num_read_kb":22327,"num_write":412,"num_write_kb":13902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2873672,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.18","version":"148'955","reported_seq":4868,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.114836+0000","last_change":"2024-09-11T06:19:19.222376+0000","last_active":"2024-09-11T06:19:22.114836+0000","last_peered":"2024-09-11T06:19:22.114836+0000","last_clean":"2024-09-11T06:19:22.114836+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:19:22.114836+0000","last_undegraded":"2024-09-11T06:19:22.114836+0000","last_fullsized":"2024-09-11T06:19:22.114836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:42.246248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052161899999999997,"stat_sum":{"num_bytes":22677066,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":8555,"num_read_kb":26082,"num_write":1439,"num_write_kb":22643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.17","version":"148'208","reported_seq":3439,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.114849+0000","last_change":"2024-09-11T06:19:19.222337+0000","last_active":"2024-09-11T06:19:22.114849+0000","last_peered":"2024-09-11T06:19:22.114849+0000","last_clean":"2024-09-11T06:19:22.114849+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:19:22.114849+0000","last_undegraded":"2024-09-11T06:19:22.114849+0000","last_fullsized":"2024-09-11T06:19:22.114849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:43.664200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056581800000000005,"stat_sum":{"num_bytes":57396400,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":2727,"num_read_kb":33148,"num_write":310,"num_write_kb":19611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.16","version":"148'413","reported_seq":2901,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T06:19:21.112123+0000","last_change":"2024-09-11T06:19:19.221042+0000","last_active":"2024-09-11T06:19:21.112123+0000","last_peered":"2024-09-11T06:19:21.112123+0000","last_clean":"2024-09-11T06:19:21.112123+0000","last_became_active":"2024-09-11T06:18:58.166467+0000","last_became_peered":"2024-09-11T06:18:58.166467+0000","last_unstale":"2024-09-11T06:19:21.112123+0000","last_undegraded":"2024-09-11T06:19:21.112123+0000","last_fullsized":"2024-09-11T06:19:21.112123+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:16:49.389848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184921,"stat_sum":{"num_bytes":49655885,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":3513,"num_read_kb":26676,"num_write":575,"num_write_kb":25645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":319665,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.15","version":"149'259","reported_seq":3346,"reported_epoch":154,"state":"active+undersized+remapped","last_fresh":"2024-09-11T06:19:22.237393+0000","last_change":"2024-09-11T06:19:22.237608+0000","last_active":"2024-09-11T06:19:22.237393+0000","last_peered":"2024-09-11T06:19:22.237393+0000","last_clean":"2024-09-11T06:19:19.218576+0000","last_became_active":"2024-09-11T06:19:22.120661+0000","last_became_peered":"2024-09-11T06:19:22.120661+0000","last_unstale":"2024-09-11T06:19:22.237393+0000","last_undegraded":"2024-09-11T06:19:22.237393+0000","last_fullsized":"2024-09-11T06:19:22.114927+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062144399999999997,"stat_sum":{"num_bytes":67847821,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2571,"num_read_kb":33419,"num_write":366,"num_write_kb":32854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":12639011,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0],"avail_no_missing":["0","3","6"],"object_location_counts":[{"shards":"0","objects":30}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.14","version":"148'327","reported_seq":3750,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115549+0000","last_change":"2024-09-11T06:19:19.224819+0000","last_active":"2024-09-11T06:19:22.115549+0000","last_peered":"2024-09-11T06:19:22.115549+0000","last_clean":"2024-09-11T06:19:22.115549+0000","last_became_active":"2024-09-11T06:19:01.108590+0000","last_became_peered":"2024-09-11T06:19:01.108590+0000","last_unstale":"2024-09-11T06:19:22.115549+0000","last_undegraded":"2024-09-11T06:19:22.115549+0000","last_fullsized":"2024-09-11T06:19:22.115549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:24.144747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012190969999999999,"stat_sum":{"num_bytes":61717734,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2954,"num_read_kb":59487,"num_write":344,"num_write_kb":36278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":100858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":283,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115542+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:19:22.115542+0000","last_peered":"2024-09-11T06:19:22.115542+0000","last_clean":"2024-09-11T06:19:22.115542+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:19:22.115542+0000","last_undegraded":"2024-09-11T06:19:22.115542+0000","last_fullsized":"2024-09-11T06:19:22.115542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"148'204","reported_seq":4215,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.112965+0000","last_change":"2024-09-11T06:19:19.219845+0000","last_active":"2024-09-11T06:19:22.112965+0000","last_peered":"2024-09-11T06:19:22.112965+0000","last_clean":"2024-09-11T06:19:22.112965+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:19:22.112965+0000","last_undegraded":"2024-09-11T06:19:22.112965+0000","last_fullsized":"2024-09-11T06:19:22.112965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:32.130748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040433599999999999,"stat_sum":{"num_bytes":39517524,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3550,"num_read_kb":42024,"num_write":326,"num_write_kb":25777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":289,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.113019+0000","last_change":"2024-09-11T06:19:21.477260+0000","last_active":"2024-09-11T06:19:22.113019+0000","last_peered":"2024-09-11T06:19:22.113019+0000","last_clean":"2024-09-11T06:19:22.113019+0000","last_became_active":"2024-09-11T06:19:21.476924+0000","last_became_peered":"2024-09-11T06:19:21.476924+0000","last_unstale":"2024-09-11T06:19:22.113019+0000","last_undegraded":"2024-09-11T06:19:22.113019+0000","last_fullsized":"2024-09-11T06:19:22.113019+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:59.530860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"148'266","reported_seq":2942,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.113056+0000","last_change":"2024-09-11T06:19:19.220037+0000","last_active":"2024-09-11T06:19:22.113056+0000","last_peered":"2024-09-11T06:19:22.113056+0000","last_clean":"2024-09-11T06:19:22.113056+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:19:22.113056+0000","last_undegraded":"2024-09-11T06:19:22.113056+0000","last_fullsized":"2024-09-11T06:19:22.113056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:04:43.512232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056790900000000001,"stat_sum":{"num_bytes":25713098,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2868,"num_read_kb":27355,"num_write":345,"num_write_kb":19976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":283,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115859+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:19:22.115859+0000","last_peered":"2024-09-11T06:19:22.115859+0000","last_clean":"2024-09-11T06:19:22.115859+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:19:22.115859+0000","last_undegraded":"2024-09-11T06:19:22.115859+0000","last_fullsized":"2024-09-11T06:19:22.115859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"150'522","reported_seq":4904,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T06:19:21.112270+0000","last_change":"2024-09-11T06:19:19.499998+0000","last_active":"2024-09-11T06:19:21.112270+0000","last_peered":"2024-09-11T06:19:21.112270+0000","last_clean":"2024-09-11T06:19:21.112270+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:19:21.112270+0000","last_undegraded":"2024-09-11T06:19:21.112270+0000","last_fullsized":"2024-09-11T06:19:21.112270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:39.974311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068444199999999995,"stat_sum":{"num_bytes":93484379,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5605,"num_read_kb":53676,"num_write":865,"num_write_kb":31604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":284,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115243+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:19:22.115243+0000","last_peered":"2024-09-11T06:19:22.115243+0000","last_clean":"2024-09-11T06:19:22.115243+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:19:22.115243+0000","last_undegraded":"2024-09-11T06:19:22.115243+0000","last_fullsized":"2024-09-11T06:19:22.115243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"142'648","reported_seq":3536,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T06:19:21.111919+0000","last_change":"2024-09-11T06:19:19.220795+0000","last_active":"2024-09-11T06:19:21.111919+0000","last_peered":"2024-09-11T06:19:21.111919+0000","last_clean":"2024-09-11T06:19:21.111919+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:19:21.111919+0000","last_undegraded":"2024-09-11T06:19:21.111919+0000","last_fullsized":"2024-09-11T06:19:21.111919+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:26.137198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064430800000000001,"stat_sum":{"num_bytes":23660556,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":4930,"num_read_kb":26499,"num_write":870,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.3","version":"150'545","reported_seq":4667,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T06:19:21.112257+0000","last_change":"2024-09-11T06:19:19.499831+0000","last_active":"2024-09-11T06:19:21.112257+0000","last_peered":"2024-09-11T06:19:21.112257+0000","last_clean":"2024-09-11T06:19:21.112257+0000","last_became_active":"2024-09-11T06:19:11.115318+0000","last_became_peered":"2024-09-11T06:19:11.115318+0000","last_unstale":"2024-09-11T06:19:21.112257+0000","last_undegraded":"2024-09-11T06:19:21.112257+0000","last_fullsized":"2024-09-11T06:19:21.112257+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:48.726978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079223200000000003,"stat_sum":{"num_bytes":55570513,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":6163,"num_read_kb":30612,"num_write":671,"num_write_kb":25279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":12761178,"num_keys_recovered":55,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":285,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115479+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:19:22.115479+0000","last_peered":"2024-09-11T06:19:22.115479+0000","last_clean":"2024-09-11T06:19:22.115479+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:19:22.115479+0000","last_undegraded":"2024-09-11T06:19:22.115479+0000","last_fullsized":"2024-09-11T06:19:22.115479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"148'462","reported_seq":5083,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.114718+0000","last_change":"2024-09-11T06:19:19.222033+0000","last_active":"2024-09-11T06:19:22.114718+0000","last_peered":"2024-09-11T06:19:22.114718+0000","last_clean":"2024-09-11T06:19:22.114718+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:19:22.114718+0000","last_undegraded":"2024-09-11T06:19:22.114718+0000","last_fullsized":"2024-09-11T06:19:22.114718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:20:39.803676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000473692,"stat_sum":{"num_bytes":57426779,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4835,"num_read_kb":31249,"num_write":657,"num_write_kb":28676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.114767+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:19:22.114767+0000","last_peered":"2024-09-11T06:19:22.114767+0000","last_clean":"2024-09-11T06:19:22.114767+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:19:22.114767+0000","last_undegraded":"2024-09-11T06:19:22.114767+0000","last_fullsized":"2024-09-11T06:19:22.114767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"148'691","reported_seq":2900,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T06:19:21.112161+0000","last_change":"2024-09-11T06:19:19.499496+0000","last_active":"2024-09-11T06:19:21.112161+0000","last_peered":"2024-09-11T06:19:21.112161+0000","last_clean":"2024-09-11T06:19:21.112161+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:19:21.112161+0000","last_undegraded":"2024-09-11T06:19:21.112161+0000","last_fullsized":"2024-09-11T06:19:21.112161+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:40.345091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046507900000000002,"stat_sum":{"num_bytes":86871626,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3099,"num_read_kb":22268,"num_write":910,"num_write_kb":23164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":283,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115430+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:19:22.115430+0000","last_peered":"2024-09-11T06:19:22.115430+0000","last_clean":"2024-09-11T06:19:22.115430+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:19:22.115430+0000","last_undegraded":"2024-09-11T06:19:22.115430+0000","last_fullsized":"2024-09-11T06:19:22.115430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"148'298","reported_seq":3459,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.112882+0000","last_change":"2024-09-11T06:19:19.219691+0000","last_active":"2024-09-11T06:19:22.112882+0000","last_peered":"2024-09-11T06:19:22.112882+0000","last_clean":"2024-09-11T06:19:22.112882+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:19:22.112882+0000","last_undegraded":"2024-09-11T06:19:22.112882+0000","last_fullsized":"2024-09-11T06:19:22.112882+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:32:23.731220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038158300000000001,"stat_sum":{"num_bytes":44042893,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3165,"num_read_kb":22525,"num_write":449,"num_write_kb":20213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":291,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.116338+0000","last_change":"2024-09-11T06:18:58.163978+0000","last_active":"2024-09-11T06:19:22.116338+0000","last_peered":"2024-09-11T06:19:22.116338+0000","last_clean":"2024-09-11T06:19:22.116338+0000","last_became_active":"2024-09-11T06:18:58.163649+0000","last_became_peered":"2024-09-11T06:18:58.163649+0000","last_unstale":"2024-09-11T06:19:22.116338+0000","last_undegraded":"2024-09-11T06:19:22.116338+0000","last_fullsized":"2024-09-11T06:19:22.116338+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:31.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":295,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.112752+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:19:22.112752+0000","last_peered":"2024-09-11T06:19:22.112752+0000","last_clean":"2024-09-11T06:19:22.112752+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:19:22.112752+0000","last_undegraded":"2024-09-11T06:19:22.112752+0000","last_fullsized":"2024-09-11T06:19:22.112752+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"154'432","reported_seq":5213,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.159130+0000","last_change":"2024-09-11T06:19:19.219580+0000","last_active":"2024-09-11T06:19:22.159130+0000","last_peered":"2024-09-11T06:19:22.159130+0000","last_clean":"2024-09-11T06:19:22.159130+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:19:22.159130+0000","last_undegraded":"2024-09-11T06:19:22.159130+0000","last_fullsized":"2024-09-11T06:19:22.159130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:46.370201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040864900000000002,"stat_sum":{"num_bytes":31006453,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6192,"num_read_kb":35326,"num_write":519,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.9","version":"148'249","reported_seq":4453,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115534+0000","last_change":"2024-09-11T06:19:19.225402+0000","last_active":"2024-09-11T06:19:22.115534+0000","last_peered":"2024-09-11T06:19:22.115534+0000","last_clean":"2024-09-11T06:19:22.115534+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:19:22.115534+0000","last_undegraded":"2024-09-11T06:19:22.115534+0000","last_fullsized":"2024-09-11T06:19:22.115534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:27:29.745223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001636569,"stat_sum":{"num_bytes":55551507,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3991,"num_read_kb":40047,"num_write":433,"num_write_kb":25966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.a","version":"148'202","reported_seq":3699,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115421+0000","last_change":"2024-09-11T06:19:19.225314+0000","last_active":"2024-09-11T06:19:22.115421+0000","last_peered":"2024-09-11T06:19:22.115421+0000","last_clean":"2024-09-11T06:19:22.115421+0000","last_became_active":"2024-09-11T06:18:19.333935+0000","last_became_peered":"2024-09-11T06:18:19.333935+0000","last_unstale":"2024-09-11T06:19:22.115421+0000","last_undegraded":"2024-09-11T06:19:22.115421+0000","last_fullsized":"2024-09-11T06:19:22.115421+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:13:14.275459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015953930000000001,"stat_sum":{"num_bytes":38350575,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3240,"num_read_kb":32360,"num_write":285,"num_write_kb":18415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":9995151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.b","version":"148'465","reported_seq":2687,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T06:19:21.112367+0000","last_change":"2024-09-11T06:19:19.499746+0000","last_active":"2024-09-11T06:19:21.112367+0000","last_peered":"2024-09-11T06:19:21.112367+0000","last_clean":"2024-09-11T06:19:21.112367+0000","last_became_active":"2024-09-11T06:18:01.255735+0000","last_became_peered":"2024-09-11T06:18:01.255735+0000","last_unstale":"2024-09-11T06:19:21.112367+0000","last_undegraded":"2024-09-11T06:19:21.112367+0000","last_fullsized":"2024-09-11T06:19:21.112367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:02.153692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057838699999999998,"stat_sum":{"num_bytes":16756436,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2861,"num_read_kb":14779,"num_write":787,"num_write_kb":23764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.c","version":"148'483","reported_seq":2494,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115260+0000","last_change":"2024-09-11T06:19:19.218564+0000","last_active":"2024-09-11T06:19:22.115260+0000","last_peered":"2024-09-11T06:19:22.115260+0000","last_clean":"2024-09-11T06:19:22.115260+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:19:22.115260+0000","last_undegraded":"2024-09-11T06:19:22.115260+0000","last_fullsized":"2024-09-11T06:19:22.115260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:56.703146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086659699999999998,"stat_sum":{"num_bytes":16173380,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2997,"num_read_kb":15157,"num_write":696,"num_write_kb":12824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.d","version":"148'422","reported_seq":2537,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115766+0000","last_change":"2024-09-11T06:19:19.225068+0000","last_active":"2024-09-11T06:19:22.115766+0000","last_peered":"2024-09-11T06:19:22.115766+0000","last_clean":"2024-09-11T06:19:22.115766+0000","last_became_active":"2024-09-11T06:18:19.334462+0000","last_became_peered":"2024-09-11T06:18:19.334462+0000","last_unstale":"2024-09-11T06:19:22.115766+0000","last_undegraded":"2024-09-11T06:19:22.115766+0000","last_fullsized":"2024-09-11T06:19:22.115766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:12:16.360420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001771754,"stat_sum":{"num_bytes":24533336,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2795,"num_read_kb":27958,"num_write":739,"num_write_kb":19150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":7078861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.e","version":"150'469","reported_seq":3318,"reported_epoch":153,"state":"activating+undersized+remapped","last_fresh":"2024-09-11T06:19:21.112309+0000","last_change":"2024-09-11T06:19:21.113486+0000","last_active":"2024-09-11T06:19:19.220324+0000","last_peered":"2024-09-11T06:19:18.276159+0000","last_clean":"2024-09-11T06:19:18.276159+0000","last_became_active":"2024-09-11T06:19:01.110586+0000","last_became_peered":"2024-09-11T06:19:01.110586+0000","last_unstale":"2024-09-11T06:19:21.112309+0000","last_undegraded":"2024-09-11T06:19:21.112309+0000","last_fullsized":"2024-09-11T06:19:21.112309+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033508099999999999,"stat_sum":{"num_bytes":50452816,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3358,"num_read_kb":37326,"num_write":613,"num_write_kb":24655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":230114,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[{"shards":"2","objects":28}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"42","length":"1"}]},{"pgid":"3.f","version":"141'280","reported_seq":3834,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T06:19:21.112024+0000","last_change":"2024-09-11T06:19:19.220374+0000","last_active":"2024-09-11T06:19:21.112024+0000","last_peered":"2024-09-11T06:19:21.112024+0000","last_clean":"2024-09-11T06:19:21.112024+0000","last_became_active":"2024-09-11T06:18:58.166147+0000","last_became_peered":"2024-09-11T06:18:58.166147+0000","last_unstale":"2024-09-11T06:19:21.112024+0000","last_undegraded":"2024-09-11T06:19:21.112024+0000","last_fullsized":"2024-09-11T06:19:21.112024+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:26:50.560982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053830900000000005,"stat_sum":{"num_bytes":48527556,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":3576,"num_read_kb":29007,"num_write":335,"num_write_kb":16410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1241504,"num_keys_recovered":9,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.10","version":"148'303","reported_seq":2622,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.112604+0000","last_change":"2024-09-11T06:19:19.218060+0000","last_active":"2024-09-11T06:19:22.112604+0000","last_peered":"2024-09-11T06:19:22.112604+0000","last_clean":"2024-09-11T06:19:22.112604+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:19:22.112604+0000","last_undegraded":"2024-09-11T06:19:22.112604+0000","last_fullsized":"2024-09-11T06:19:22.112604+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:07:05.767363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000984726,"stat_sum":{"num_bytes":66164270,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3846,"num_read_kb":38690,"num_write":350,"num_write_kb":26852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.11","version":"148'322","reported_seq":3145,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.115356+0000","last_change":"2024-09-11T06:19:19.223998+0000","last_active":"2024-09-11T06:19:22.115356+0000","last_peered":"2024-09-11T06:19:22.115356+0000","last_clean":"2024-09-11T06:19:22.115356+0000","last_became_active":"2024-09-11T06:18:58.166199+0000","last_became_peered":"2024-09-11T06:18:58.166199+0000","last_unstale":"2024-09-11T06:19:22.115356+0000","last_undegraded":"2024-09-11T06:19:22.115356+0000","last_fullsized":"2024-09-11T06:19:22.115356+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:13:01.772687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001420417,"stat_sum":{"num_bytes":36356218,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3034,"num_read_kb":41244,"num_write":395,"num_write_kb":24271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.12","version":"148'182","reported_seq":2163,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T06:19:21.112150+0000","last_change":"2024-09-11T06:19:19.499474+0000","last_active":"2024-09-11T06:19:21.112150+0000","last_peered":"2024-09-11T06:19:21.112150+0000","last_clean":"2024-09-11T06:19:21.112150+0000","last_became_active":"2024-09-11T06:17:37.166037+0000","last_became_peered":"2024-09-11T06:17:37.166037+0000","last_unstale":"2024-09-11T06:19:21.112150+0000","last_undegraded":"2024-09-11T06:19:21.112150+0000","last_fullsized":"2024-09-11T06:19:21.112150+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:31:07.397791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000411109,"stat_sum":{"num_bytes":20595257,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":1440,"num_read_kb":21094,"num_write":289,"num_write_kb":18445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":771314,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]},{"pgid":"3.13","version":"150'317","reported_seq":3279,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-11T06:19:22.116286+0000","last_change":"2024-09-11T06:19:19.224351+0000","last_active":"2024-09-11T06:19:22.116286+0000","last_peered":"2024-09-11T06:19:22.116286+0000","last_clean":"2024-09-11T06:19:22.116286+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:19:22.116286+0000","last_undegraded":"2024-09-11T06:19:22.116286+0000","last_fullsized":"2024-09-11T06:19:22.116286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:24.100272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012775550000000001,"stat_sum":{"num_bytes":49362815,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2929,"num_read_kb":32848,"num_write":473,"num_write_kb":23711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"42","length":"1"},{"start":"44","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1487350932,"num_objects":961,"num_object_clones":0,"num_object_copies":1922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":66,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":961,"num_whiteouts":0,"num_read":135312,"num_read_kb":1083159,"num_write":18584,"num_write_kb":730529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":98107159,"num_keys_recovered":247,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86282240,"data_stored":752686734,"data_compressed":22197966,"data_compressed_allocated":66985984,"data_compressed_original":737400817,"omap_allocated":25754,"internal_metadata":0},"log_size":12908,"ondisk_log_size":12908,"up":64,"acting":62,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59276,"kb_used_data":14196,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312564,"statfs":{"total":96636764160,"available":96576065536,"internally_reserved":0,"allocated":14536704,"data_stored":109118882,"data_compressed":3392597,"data_compressed_allocated":9859072,"data_compressed_original":105986212,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49540,"kb_used_data":10032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322300,"statfs":{"total":96636764160,"available":96586035200,"internally_reserved":0,"allocated":10272768,"data_stored":77937002,"data_compressed":2063955,"data_compressed_allocated":6680576,"data_compressed_original":75664696,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46000,"kb_used_data":18964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94325840,"statfs":{"total":96636764160,"available":96589660160,"internally_reserved":0,"allocated":19419136,"data_stored":157732753,"data_compressed":4819939,"data_compressed_allocated":14065664,"data_compressed_original":154002870,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748486,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42112,"kb_used_data":13100,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94329728,"statfs":{"total":96636764160,"available":96593641472,"internally_reserved":0,"allocated":13414400,"data_stored":102674608,"data_compressed":3116838,"data_compressed_allocated":9089024,"data_compressed_original":99811998,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1,0,2],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991246,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46772,"kb_used_data":9888,"kb_used_omap":10,"kb_used_meta":36853,"kb_avail":94325068,"statfs":{"total":96636764160,"available":96588869632,"internally_reserved":0,"allocated":10125312,"data_stored":76649388,"data_compressed":2204666,"data_compressed_allocated":6717440,"data_compressed_original":74544707,"omap_allocated":10357,"internal_metadata":37738379},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60352,"kb_used_data":11112,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311488,"statfs":{"total":96636764160,"available":96574963712,"internally_reserved":0,"allocated":11378688,"data_stored":85960456,"data_compressed":2174784,"data_compressed_allocated":7245824,"data_compressed_original":83222321,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11816,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12099584,"data_stored":85394921,"data_compressed":2613584,"data_compressed_allocated":7663616,"data_compressed_original":82405788,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47652,"kb_used_data":8144,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324188,"statfs":{"total":96636764160,"available":96587968512,"internally_reserved":0,"allocated":8339456,"data_stored":52935877,"data_compressed":1433797,"data_compressed_allocated":4603904,"data_compressed_original":50543281,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9547776,"data_stored":85064265,"data_compressed":2174784,"data_compressed_allocated":7245824,"data_compressed_original":83222321,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8237056,"data_stored":75162829,"data_compressed":2195997,"data_compressed_allocated":6680576,"data_compressed_original":73971267,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11595776,"data_stored":101784510,"data_compressed":3116838,"data_compressed_allocated":9089024,"data_compressed_original":99811998,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19054592,"data_stored":169475554,"data_compressed":5215083,"data_compressed_allocated":15200256,"data_compressed_original":166368694,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":77034755,"data_compressed":2063955,"data_compressed_allocated":6680576,"data_compressed_original":75664696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12648448,"data_stored":107632323,"data_compressed":3383928,"data_compressed_allocated":9822208,"data_compressed_original":105412772,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10276864,"data_stored":84504804,"data_compressed":2613584,"data_compressed_allocated":7663616,"data_compressed_original":82405788,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6492160,"data_stored":52027694,"data_compressed":1433797,"data_compressed_allocated":4603904,"data_compressed_original":50543281,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:19:25.890 INFO:tasks.thrashosds.thrasher:Setting 3.19 to [4, 2, 1, 3] 2024-09-11T06:19:25.891 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.19', '4', '2', '1', '3'] 2024-09-11T06:19:25.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.19 4 2 1 3 2024-09-11T06:19:25.930 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:25.930 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:25.939 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:25.973 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:25.972+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:26.042 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:26.042 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:26.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:26.095 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:26.093+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:26.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:19:26.158 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:26.158 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:26.167 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:26.189 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:26.188+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:26.262 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-11T06:19:26.263 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:26.262+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:26.313 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:26.313 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:26.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:26.363 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:26.362+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:26.399 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.399 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.399 INFO:teuthology.orchestra.run.smithi070.stdout:4884 writesame 0xdf70876 thru 0xdf75e5c data_size 0x1(0x55e7 bytes) 2024-09-11T06:19:26.414 INFO:teuthology.orchestra.run.smithi070.stdout:4885 read 0x6babfbd thru 0x6baf182 (0x31c6 bytes) 2024-09-11T06:19:26.415 INFO:teuthology.orchestra.run.smithi070.stdout:4886 punch from 0x798ba86 to 0x799315e, (0x76d8 bytes) 2024-09-11T06:19:26.415 INFO:teuthology.orchestra.run.smithi070.stdout:4887 read 0x4767633 thru 0x47687eb (0x11b9 bytes) 2024-09-11T06:19:26.418 INFO:teuthology.orchestra.run.smithi070.stdout:4888 trunc from 0xe3db0e0 to 0xc1c9d6c 2024-09-11T06:19:26.433 INFO:teuthology.orchestra.run.smithi070.stdout:4889 read 0x72a3ac5 thru 0x72a66aa (0x2be6 bytes) 2024-09-11T06:19:26.433 INFO:teuthology.orchestra.run.smithi070.stdout:4891 write 0x62b394 thru 0x633a1e (0x868b bytes) 2024-09-11T06:19:26.435 INFO:teuthology.orchestra.run.smithi070.stdout:4893 write 0x5c84d20 thru 0x5c94174 (0xf455 bytes) 2024-09-11T06:19:26.436 INFO:teuthology.orchestra.run.smithi070.stdout:4894 read 0xce2d8c thru 0xcede6f (0xb0e4 bytes) 2024-09-11T06:19:26.437 INFO:teuthology.orchestra.run.smithi070.stdout:4895 read 0x5573f79 thru 0x557dd0e (0x9d96 bytes) 2024-09-11T06:19:26.451 INFO:teuthology.orchestra.run.smithi070.stdout:4896 trunc from 0xc1c9d6c to 0xd5ee26 2024-09-11T06:19:26.464 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:26.463+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:26.475 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:26.475 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:26.478 INFO:teuthology.orchestra.run.smithi070.stdout:4897 write 0x2dcd302 thru 0x2dd53c5 (0x80c4 bytes) 2024-09-11T06:19:26.485 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:26.489 INFO:teuthology.orchestra.run.smithi070.stdout:4898 write 0x51fa3da thru 0x52071f6 (0xce1d bytes) 2024-09-11T06:19:26.491 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.491 INFO:teuthology.orchestra.run.smithi070.stdout:4900 punch from 0x387d8ce to 0x38805e6, (0x2d18 bytes) 2024-09-11T06:19:26.491 INFO:teuthology.orchestra.run.smithi070.stdout:4901 write 0x33b94a5 thru 0x33c563b (0xc197 bytes) 2024-09-11T06:19:26.498 INFO:teuthology.orchestra.run.smithi070.stdout:4902 write 0x58fabe7 thru 0x58fd6ef (0x2b09 bytes) 2024-09-11T06:19:26.516 INFO:teuthology.orchestra.run.smithi070.stdout:4903 write 0xe6d152d thru 0xe6e14e9 (0xffbd bytes) 2024-09-11T06:19:26.519 INFO:teuthology.orchestra.run.smithi070.stdout:4904 punch from 0xdcdfd25 to 0xdce8e84, (0x915f bytes) 2024-09-11T06:19:26.519 INFO:teuthology.orchestra.run.smithi070.stdout:4905 write 0xcfe50ed thru 0xcfe7b21 (0x2a35 bytes) 2024-09-11T06:19:26.523 INFO:teuthology.orchestra.run.smithi070.stdout:4906 write 0x6720b14 thru 0x67277a5 (0x6c92 bytes) 2024-09-11T06:19:26.538 INFO:teuthology.orchestra.run.smithi070.stdout:4907 trunc from 0xe6e14ea to 0x2927d97 2024-09-11T06:19:26.551 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.564 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:26.564+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:26.566 INFO:teuthology.orchestra.run.smithi070.stdout:4909 writesame 0x8d01aa7 thru 0x8d0f51a data_size 0x52(0xda74 bytes) 2024-09-11T06:19:26.566 INFO:teuthology.orchestra.run.smithi070.stdout:4910 writesame 0xafa012 thru 0xb07db0 data_size 0x7(0xdd9f bytes) 2024-09-11T06:19:26.570 INFO:teuthology.orchestra.run.smithi070.stdout:4911 writesame 0x5ae7d5c thru 0x5af7a51 data_size 0x6(0xfcf6 bytes) 2024-09-11T06:19:26.590 INFO:teuthology.orchestra.run.smithi070.stdout:4912 writesame 0xed82ab8 thru 0xed8f95a data_size 0x21(0xcea3 bytes) 2024-09-11T06:19:26.590 INFO:teuthology.orchestra.run.smithi070.stdout:4913 punch from 0xb3011b0 to 0xb30536d, (0x41bd bytes) 2024-09-11T06:19:26.590 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.590 INFO:teuthology.orchestra.run.smithi070.stdout:4915 read 0xc086140 thru 0xc09245f (0xc320 bytes) 2024-09-11T06:19:26.594 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:26.594 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:26.598 INFO:teuthology.orchestra.run.smithi070.stdout:4916 trunc from 0xed8f95b to 0x72b0b9b 2024-09-11T06:19:26.604 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:26.608 INFO:teuthology.orchestra.run.smithi070.stdout:4917 trunc from 0x72b0b9b to 0x7e6ac93 2024-09-11T06:19:26.613 INFO:teuthology.orchestra.run.smithi070.stdout:4918 read 0x650a76d thru 0x650fd81 (0x5615 bytes) 2024-09-11T06:19:26.622 INFO:teuthology.orchestra.run.smithi070.stdout:4919 write 0xa01cd77 thru 0xa028d83 (0xc00d bytes) 2024-09-11T06:19:26.632 INFO:teuthology.orchestra.run.smithi070.stdout:4920 trunc from 0xa028d84 to 0x39acb4f 2024-09-11T06:19:26.658 INFO:teuthology.orchestra.run.smithi070.stdout:4922 write 0x9ecc3ce thru 0x9ed0426 (0x4059 bytes) 2024-09-11T06:19:26.661 INFO:teuthology.orchestra.run.smithi070.stdout:4923 read 0x78e5477 thru 0x78e6a52 (0x15dc bytes) 2024-09-11T06:19:26.661 INFO:teuthology.orchestra.run.smithi070.stdout:4924 read 0x974ca25 thru 0x975a07b (0xd657 bytes) 2024-09-11T06:19:26.661 INFO:teuthology.orchestra.run.smithi070.stdout:4925 punch from 0x1b4a87a to 0x1b5002b, (0x57b1 bytes) 2024-09-11T06:19:26.666 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:26.665+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:26.671 INFO:teuthology.orchestra.run.smithi070.stdout:4926 write 0xdef652c thru 0xdf03888 (0xd35d bytes) 2024-09-11T06:19:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:4927 write 0x699b0a6 thru 0x699e98d (0x38e8 bytes) 2024-09-11T06:19:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:4928 write 0x595fe68 thru 0x596124b (0x13e4 bytes) 2024-09-11T06:19:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:4930 read 0x1814d63 thru 0x181f6bc (0xa95a bytes) 2024-09-11T06:19:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:4932 write 0x91f7305 thru 0x91fc7f0 (0x54ec bytes) 2024-09-11T06:19:26.682 INFO:teuthology.orchestra.run.smithi070.stdout:4933 read 0x3364b4d thru 0x336784f (0x2d03 bytes) 2024-09-11T06:19:26.682 INFO:teuthology.orchestra.run.smithi070.stdout:4935 write 0x2151a9e thru 0x215bfd6 (0xa539 bytes) 2024-09-11T06:19:26.684 INFO:teuthology.orchestra.run.smithi070.stdout:4938 punch from 0xa14db81 to 0xa14debd, (0x33c bytes) 2024-09-11T06:19:26.684 INFO:teuthology.orchestra.run.smithi070.stdout:4939 write 0xd250d03 thru 0xd2589f9 (0x7cf7 bytes) 2024-09-11T06:19:26.687 INFO:teuthology.orchestra.run.smithi070.stdout:4940 writesame 0xc81e214 thru 0xc81e42a data_size 0x1(0x217 bytes) 2024-09-11T06:19:26.690 INFO:teuthology.orchestra.run.smithi070.stdout:4942 writesame 0x49df454 thru 0x49e427e data_size 0x1(0x4e2b bytes) 2024-09-11T06:19:26.700 INFO:teuthology.orchestra.run.smithi070.stdout:4943 punch from 0x2df6281 to 0x2e03311, (0xd090 bytes) 2024-09-11T06:19:26.706 INFO:teuthology.orchestra.run.smithi070.stdout:4944 write 0xe348258 thru 0xe351148 (0x8ef1 bytes) 2024-09-11T06:19:26.709 INFO:teuthology.orchestra.run.smithi070.stdout:4945 writesame 0xb03f732 thru 0xb048b51 data_size 0x9e(0x9420 bytes) 2024-09-11T06:19:26.711 INFO:teuthology.orchestra.run.smithi070.stdout:4948 punch from 0xc28077d to 0xc28e198, (0xda1b bytes) 2024-09-11T06:19:26.711 INFO:teuthology.orchestra.run.smithi070.stdout:4949 read 0x216f58e thru 0x216ff7f (0x9f2 bytes) 2024-09-11T06:19:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:4950 read 0x63793c7 thru 0x63851ae (0xbde8 bytes) 2024-09-11T06:19:26.712 INFO:teuthology.orchestra.run.smithi070.stdout:4951 writesame 0x73bcde8 thru 0x73c6d9e data_size 0x63(0x9fb7 bytes) 2024-09-11T06:19:26.713 INFO:teuthology.orchestra.run.smithi070.stdout:4953 punch from 0xdb85019 to 0xdb85400, (0x3e7 bytes) 2024-09-11T06:19:26.714 INFO:teuthology.orchestra.run.smithi070.stdout:4954 write 0x7a41109 thru 0x7a50fb8 (0xfeb0 bytes) 2024-09-11T06:19:26.727 INFO:teuthology.orchestra.run.smithi070.stdout:4955 trunc from 0xe351149 to 0x3e6a217 2024-09-11T06:19:26.741 INFO:teuthology.orchestra.run.smithi070.stdout:4957 read 0x112549b thru 0x1129ccb (0x4831 bytes) 2024-09-11T06:19:26.741 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.747 INFO:teuthology.orchestra.run.smithi070.stdout:4960 trunc from 0x3e6a217 to 0x8eb8343 2024-09-11T06:19:26.753 INFO:teuthology.orchestra.run.smithi070.stdout:4961 punch from 0x746aee1 to 0x747493c, (0x9a5b bytes) 2024-09-11T06:19:26.753 INFO:teuthology.orchestra.run.smithi070.stdout:4963 punch from 0x196bcd2 to 0x19775be, (0xb8ec bytes) 2024-09-11T06:19:26.753 INFO:teuthology.orchestra.run.smithi070.stdout:4966 writesame 0x89e911f thru 0x89f2271 data_size 0x1(0x9153 bytes) 2024-09-11T06:19:26.755 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:26.755 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:26.764 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:26.767 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:26.766+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:26.772 INFO:teuthology.orchestra.run.smithi070.stdout:4967 read 0x461f7d6 thru 0x462d045 (0xd870 bytes) 2024-09-11T06:19:26.772 INFO:teuthology.orchestra.run.smithi070.stdout:4968 punch from 0x85cc899 to 0x85d2a69, (0x61d0 bytes) 2024-09-11T06:19:26.773 INFO:teuthology.orchestra.run.smithi070.stdout:4969 trunc from 0x8eb8343 to 0xa5b8579 2024-09-11T06:19:26.779 INFO:teuthology.orchestra.run.smithi070.stdout:4970 punch from 0x26ccb29 to 0x26d9acf, (0xcfa6 bytes) 2024-09-11T06:19:26.779 INFO:teuthology.orchestra.run.smithi070.stdout:4971 punch from 0x3020b16 to 0x3030135, (0xf61f bytes) 2024-09-11T06:19:26.779 INFO:teuthology.orchestra.run.smithi070.stdout:4972 punch from 0x1dc3043 to 0x1dc6494, (0x3451 bytes) 2024-09-11T06:19:26.780 INFO:teuthology.orchestra.run.smithi070.stdout:4974 read 0x66fa56d thru 0x670447f (0x9f13 bytes) 2024-09-11T06:19:26.780 INFO:teuthology.orchestra.run.smithi070.stdout:4977 write 0x9490c59 thru 0x94934a1 (0x2849 bytes) 2024-09-11T06:19:26.783 INFO:teuthology.orchestra.run.smithi070.stdout:4978 write 0x23057f6 thru 0x23075d7 (0x1de2 bytes) 2024-09-11T06:19:26.784 INFO:teuthology.orchestra.run.smithi070.stdout:4980 writesame 0x26d55a3 thru 0x26d97eb data_size 0x1(0x4249 bytes) 2024-09-11T06:19:26.793 INFO:teuthology.orchestra.run.smithi070.stdout:4981 read 0x57d5c2d thru 0x57e1608 (0xb9dc bytes) 2024-09-11T06:19:26.793 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.793 INFO:teuthology.orchestra.run.smithi070.stdout:4984 read 0x9b5c2bb thru 0x9b6579b (0x94e1 bytes) 2024-09-11T06:19:26.793 INFO:teuthology.orchestra.run.smithi070.stdout:4986 write 0x851867d thru 0x8521b61 (0x94e5 bytes) 2024-09-11T06:19:26.796 INFO:teuthology.orchestra.run.smithi070.stdout:4987 write 0xd337b3 thru 0xd34c18 (0x1466 bytes) 2024-09-11T06:19:26.797 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.802 INFO:teuthology.orchestra.run.smithi070.stdout:4990 trunc from 0xa5b8579 to 0x6c81354 2024-09-11T06:19:26.821 INFO:teuthology.orchestra.run.smithi070.stdout:4991 punch from 0x19bef06 to 0x19c4176, (0x5270 bytes) 2024-09-11T06:19:26.821 INFO:teuthology.orchestra.run.smithi070.stdout:4992 punch from 0x5ece058 to 0x5edab1c, (0xcac4 bytes) 2024-09-11T06:19:26.826 INFO:teuthology.orchestra.run.smithi070.stdout:4994 write 0x6ee45ae thru 0x6ef1a3b (0xd48e bytes) 2024-09-11T06:19:26.827 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.827 INFO:teuthology.orchestra.run.smithi070.stdout:5000 writesame 0x465e2f9 thru 0x4669954 data_size 0x16(0xb65c bytes) 2024-09-11T06:19:26.829 INFO:teuthology.orchestra.run.smithi070.stdout:5002 read 0x257458f thru 0x2574749 (0x1bb bytes) 2024-09-11T06:19:26.829 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.830 INFO:teuthology.orchestra.run.smithi070.stdout:5006 punch from 0x6dbc2d7 to 0x6dbec7d, (0x29a6 bytes) 2024-09-11T06:19:26.842 INFO:teuthology.orchestra.run.smithi070.stdout:5008 writesame 0xbb7ea86 thru 0xbb85dad data_size 0x58(0x7328 bytes) 2024-09-11T06:19:26.842 INFO:teuthology.orchestra.run.smithi070.stdout:5009 punch from 0x5c6cc47 to 0x5c72c6e, (0x6027 bytes) 2024-09-11T06:19:26.842 INFO:teuthology.orchestra.run.smithi070.stdout:5010 writesame 0x45caf62 thru 0x45d3b2a data_size 0x11(0x8bc9 bytes) 2024-09-11T06:19:26.843 INFO:teuthology.orchestra.run.smithi070.stdout:5011 write 0xb093180 thru 0xb09c2e8 (0x9169 bytes) 2024-09-11T06:19:26.847 INFO:teuthology.orchestra.run.smithi070.stdout:5012 read 0x815c792 thru 0x8164df5 (0x8664 bytes) 2024-09-11T06:19:26.847 INFO:teuthology.orchestra.run.smithi070.stdout:5013 read 0x957f7a7 thru 0x9589521 (0x9d7b bytes) 2024-09-11T06:19:26.847 INFO:teuthology.orchestra.run.smithi070.stdout:5014 read 0x3aa324a thru 0x3aa63de (0x3195 bytes) 2024-09-11T06:19:26.847 INFO:teuthology.orchestra.run.smithi070.stdout:5015 writesame 0xb4ad73d thru 0xb4bb5eb data_size 0x1(0xdeaf bytes) 2024-09-11T06:19:26.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:26.867+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:26.875 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:26.876 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:26.876 INFO:teuthology.orchestra.run.smithi070.stdout:5016 punch from 0x258cc83 to 0x258e186, (0x1503 bytes) 2024-09-11T06:19:26.876 INFO:teuthology.orchestra.run.smithi070.stdout:5017 read 0x376168c thru 0x3770516 (0xee8b bytes) 2024-09-11T06:19:26.876 INFO:teuthology.orchestra.run.smithi070.stdout:5018 punch from 0x1d17c00 to 0x1d2745d, (0xf85d bytes) 2024-09-11T06:19:26.877 INFO:teuthology.orchestra.run.smithi070.stdout:5020 write 0x28e1942 thru 0x28e8df2 (0x74b1 bytes) 2024-09-11T06:19:26.878 INFO:teuthology.orchestra.run.smithi070.stdout:5021 writesame 0x9ab101 thru 0x9ba5f7 data_size 0x1(0xf4f7 bytes) 2024-09-11T06:19:26.886 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:26.909 INFO:teuthology.orchestra.run.smithi070.stdout:5022 trunc from 0xbb85dae to 0xb05ba0a 2024-09-11T06:19:26.978 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:26.978 INFO:teuthology.orchestra.run.smithi070.stdout:5024 trunc from 0xb05ba0a to 0x967ef19 2024-09-11T06:19:26.978 INFO:teuthology.orchestra.run.smithi070.stdout:5025 write 0x27931fe thru 0x27999ba (0x67bd bytes) 2024-09-11T06:19:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:5028 writesame 0x59937b7 thru 0x599ad76 data_size 0x20(0x75c0 bytes) 2024-09-11T06:19:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:5029 read 0x2014eab thru 0x20160fa (0x1250 bytes) 2024-09-11T06:19:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:5030 writesame 0x311521c thru 0x311c424 data_size 0x25(0x7209 bytes) 2024-09-11T06:19:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:5031 write 0xe36eb1e thru 0xe37488a (0x5d6d bytes) 2024-09-11T06:19:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:5033 trunc from 0xe37488b to 0x7994726 2024-09-11T06:19:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:5034 trunc from 0x7994726 to 0x71a74c5 2024-09-11T06:19:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:5035 punch from 0x29f473e to 0x29fa848, (0x610a bytes) 2024-09-11T06:19:26.980 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:26.977+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:26.988 INFO:teuthology.orchestra.run.smithi070.stdout:5036 write 0xd3cf830 thru 0xd3d1cba (0x248b bytes) 2024-09-11T06:19:26.991 INFO:teuthology.orchestra.run.smithi070.stdout:5037 read 0x8a99e33 thru 0x8aa101a (0x71e8 bytes) 2024-09-11T06:19:26.991 INFO:teuthology.orchestra.run.smithi070.stdout:5038 write 0x89cb7a8 thru 0x89d1e4b (0x66a4 bytes) 2024-09-11T06:19:26.995 INFO:teuthology.orchestra.run.smithi070.stdout:5039 writesame 0x1d305a9 thru 0x1d3b936 data_size 0x6(0xb38e bytes) 2024-09-11T06:19:27.000 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:27.000 INFO:teuthology.orchestra.run.smithi070.stdout:5043 clone 35 order 23 su 262144 sc 9 2024-09-11T06:19:27.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:27.078 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:27.077+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:27.080 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:27.081 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:27.089 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:19:27.115 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.19 pg_upmap_items mapping to [4->2,1->3] 2024-09-11T06:19:27.147 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:27.147 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:27.165 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:27.165 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:27.180 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:27.178+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:27.180 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:27.181 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:27.196 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:27.196 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:27.213 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:27.213 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:27.229 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:27.229 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:27.235 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:27.236 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:27.245 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:27.246 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:27.246 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:27.263 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:27.263 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:27.315 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:27.314+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:27.350 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:27.351 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:27.351 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:27.351 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:27.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:27.401 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:27.400+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:27.481 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:27.480+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:27.504 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:27.505 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:27.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:27.582 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:27.581+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:27.618 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:27.618 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:27.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:27.618 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:27.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.618 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130410 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10993664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469786396, 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043187259999999998, 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130410 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:27.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146584+0000", 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146592+0000", 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5619999999999998e-06 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146598+0000", 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189643+0000", 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043045091000000001 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189704+0000", 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0911e-05 2024-09-11T06:19:27.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189769+0000", 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5745000000000002e-05 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130411 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 11001856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469764255000001, 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043307804999999998, 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130411 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146605+0000", 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146613+0000", 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6729999999999998e-06 2024-09-11T06:19:27.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146621+0000", 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8849999999999999e-06 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146626+0000", 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9520000000000002e-06 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189802+0000", 2024-09-11T06:19:27.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043175603 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189848+0000", 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6465999999999999e-05 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189912+0000", 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3835000000000001e-05 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130444 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10752000~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469735454999999, 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043428937000000001, 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130444 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146635+0000", 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146642+0000", 2024-09-11T06:19:27.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8680000000000001e-06 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146649+0000", 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2319999999999998e-06 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189933+0000", 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043284979000000001 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189982+0000", 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8513000000000001e-05 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190062+0000", 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9929e-05 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130445 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10760192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469707930999999, 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043549156999999998, 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130445 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.633 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146663+0000", 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146678+0000", 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5201000000000001e-05 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146684+0000", 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190086+0000", 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043401281 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190147+0000", 2024-09-11T06:19:27.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1246000000000003e-05 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190210+0000", 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2720999999999998e-05 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130446 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10768384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.637 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469670849, 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043660235999999998, 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130446 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.638 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:27.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146700+0000", 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-06 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146709+0000", 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3520000000000007e-06 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146718+0000", 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6830000000000003e-06 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190233+0000", 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043514440000000001 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190283+0000", 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0178e-05 2024-09-11T06:19:27.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190358+0000", 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4796999999999996e-05 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130447 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10776576~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469606928000001, 2024-09-11T06:19:27.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043732383999999999, 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130447 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146765+0000", 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146782+0000", 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7282000000000002e-05 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146789+0000", 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7279999999999998e-06 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190386+0000", 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043596843000000003 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190431+0000", 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5751999999999998e-05 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190494+0000", 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2614999999999996e-05 2024-09-11T06:19:27.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130448 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10784768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469565193000001, 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043831475000000002, 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130448 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146811+0000", 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146814+0000", 2024-09-11T06:19:27.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.543e-06 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146823+0000", 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8699999999999998e-06 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146828+0000", 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190522+0000", 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043694033 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190572+0000", 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0269999999999998e-05 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190635+0000", 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2719999999999996e-05 2024-09-11T06:19:27.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130449 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10792960~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469528536999999, 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043926146999999999, 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130449 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8200000000000001e-07 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146842+0000", 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5910000000000001e-06 2024-09-11T06:19:27.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146852+0000", 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0341e-05 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146855+0000", 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190655+0000", 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043800258000000002 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190706+0000", 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0226999999999999e-05 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190766+0000", 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0517999999999999e-05 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.656 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130450 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10801152~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469509331000001, 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044072734000000002, 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130450 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146861+0000", 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3379999999999999e-06 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146865+0000", 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3220000000000003e-06 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146868+0000", 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190792+0000", 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043923845000000003 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190853+0000", 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1008999999999998e-05 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190932+0000", 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9326000000000006e-05 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130451 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10809344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.661 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469497297, 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044195328999999998, 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130451 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147086+0000", 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021491899999999999 2024-09-11T06:19:27.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147096+0000", 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0217999999999999e-05 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147105+0000", 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147112+0000", 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190954+0000", 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043842032000000003 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191004+0000", 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0482999999999998e-05 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191066+0000", 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2420000000000002e-05 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130452 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10817536~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.469248238999999, 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044100716999999998, 2024-09-11T06:19:27.666 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130452 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147905+0000", 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078465999999999996 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147909+0000", 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2549999999999999e-06 2024-09-11T06:19:27.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147919+0000", 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0236e-05 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147927+0000", 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8679999999999999e-06 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191092+0000", 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043164431000000003 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191142+0000", 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9923000000000003e-05 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191221+0000", 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9344000000000005e-05 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130453 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10825728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.468407680999999, 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392063000000002, 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130453 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147963+0000", 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.795e-06 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147967+0000", 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9979999999999997e-06 2024-09-11T06:19:27.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147970+0000", 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191246+0000", 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043275980999999998 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191291+0000", 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5498999999999999e-05 2024-09-11T06:19:27.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191353+0000", 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999994e-05 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130454 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10833920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.468394491000002, 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043530384999999998, 2024-09-11T06:19:27.675 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130454 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5199999999999998e-07 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147975+0000", 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.195e-06 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147979+0000", 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.196e-06 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147981+0000", 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191374+0000", 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392673 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191441+0000", 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191504+0000", 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3602999999999994e-05 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130455 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10842112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.468383845000002, 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043653780000000003, 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130455 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147986+0000", 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.35e-06 2024-09-11T06:19:27.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147989+0000", 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147992+0000", 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191525+0000", 2024-09-11T06:19:27.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043533080000000002 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191577+0000", 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2506999999999997e-05 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191638+0000", 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0903999999999998e-05 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130456 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10850304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.468373405000001, 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.04379475, 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130456 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149579+0000", 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001583877 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149584+0000", 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9359999999999998e-06 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149593+0000", 2024-09-11T06:19:27.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2429999999999994e-06 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149598+0000", 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0919999999999997e-06 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191663+0000", 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042064987999999998 2024-09-11T06:19:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191714+0000", 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0506000000000001e-05 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191790+0000", 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130463 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10907648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.466694419, 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043098538999999998, 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130463 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.28e-07 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149679+0000", 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5449999999999997e-06 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149682+0000", 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.455e-06 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149685+0000", 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.526e-06 2024-09-11T06:19:27.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192662+0000", 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042976939999999998 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192712+0000", 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0682e-05 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192773+0000", 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0163e-05 2024-09-11T06:19:27.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130464 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10915840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.466680295, 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043257601999999999, 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130464 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149920+0000", 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023134100000000001 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149923+0000", 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000001e-06 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149932+0000", 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7080000000000003e-06 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149939+0000", 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6510000000000001e-06 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192802+0000", 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042862572000000002 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192861+0000", 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9077999999999999e-05 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192946+0000", 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4901999999999995e-05 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130465 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10924032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.466421298, 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043129278, 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130465 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149949+0000", 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.886e-06 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149953+0000", 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149956+0000", 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192970+0000", 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043013844000000002 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193017+0000", 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6530999999999999e-05 2024-09-11T06:19:27.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193076+0000", 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9824999999999997e-05 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130466 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10932224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.466408727000001, 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043272974999999998, 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130466 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:27.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151901+0000", 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001941356 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151905+0000", 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000003e-06 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151912+0000", 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0679999999999999e-06 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151916+0000", 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9829999999999998e-06 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193097+0000", 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041180814000000003 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193161+0000", 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3584000000000007e-05 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193233+0000", 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2074000000000001e-05 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130516 3.1c 3:3f6bd6e9:::rbd_object_map.116df114867d.000000000000003e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.463206243999998, 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043688850000000001, 2024-09-11T06:19:27.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130516 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153163+0000", 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8299999999999996e-07 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153168+0000", 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153176+0000", 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153181+0000", 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3539999999999999e-06 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194609+0000", 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041427972 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194661+0000", 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2308999999999997e-05 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194883+0000", 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221466 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196734+0000", 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018515039999999999 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196752+0000", 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7558e-05 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196812+0000", 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9639000000000003e-05 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196851+0000", 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9536999999999998e-05 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:27.712 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:27.713 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:27.714 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:27.712+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:27.814 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:27.813+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:27.816 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:27.816 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:27.816 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:27.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:27.916 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:27.915+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:27.928 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:27.928 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:27.928 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:27.928 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:27.929 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:27.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:28.016 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:28.016+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:28.041 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:28.041 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:28.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:28.041 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:28.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.041 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118743 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:28.041 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.920845957000001, 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99346091199999997, 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118743 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118559+0000", 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:28.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118568+0000", 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4279999999999996e-06 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118589+0000", 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1129999999999999e-05 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118599+0000", 2024-09-11T06:19:28.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8789999999999998e-06 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118670+0000", 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1087999999999994e-05 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118679+0000", 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.115e-06 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111727+0000", 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99304786499999997 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111848+0000", 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121347 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112017+0000", 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016935499999999999 2024-09-11T06:19:28.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118751 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.920544556999999, 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99440886299999998, 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118751 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118858+0000", 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.85e-07 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118863+0000", 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:28.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2741999999999999e-05 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118884+0000", 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7109999999999995e-06 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118951+0000", 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7347000000000004e-05 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:28.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118958+0000", 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0180000000000004e-06 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113102+0000", 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99414409999999998 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113179+0000", 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6614999999999997e-05 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113267+0000", 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7745999999999996e-05 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118759 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.920236814999999, 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99428308499999996, 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118759 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119166+0000", 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119167+0000", 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119173+0000", 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0859999999999998e-06 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119187+0000", 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4133e-05 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119194+0000", 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-06 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119251+0000", 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6063999999999997e-05 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119259+0000", 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9750000000000007e-06 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113295+0000", 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99403649000000005 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113370+0000", 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5266999999999996e-05 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113449+0000", 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8396e-05 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118767 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.919937939, 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99424699400000005, 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118767 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119464+0000", 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119465+0000", 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2500000000000004e-07 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119472+0000", 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3330000000000002e-06 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119485+0000", 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2782999999999999e-05 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9830000000000002e-06 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119548+0000", 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4274000000000002e-05 2024-09-11T06:19:28.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3000000000000004e-06 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113477+0000", 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99392198799999998 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113607+0000", 2024-09-11T06:19:28.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012957600000000001 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.113711+0000", 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104832 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118775 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.919620965, 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99457822699999998, 2024-09-11T06:19:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118775 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119781+0000", 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119782+0000", 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4e-07 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119787+0000", 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:28.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119800+0000", 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3728e-05 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119808+0000", 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.661e-06 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119865+0000", 2024-09-11T06:19:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7345000000000001e-05 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119876+0000", 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0393e-05 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114042+0000", 2024-09-11T06:19:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99416629599999995 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114146+0000", 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104091 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114360+0000", 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000213544 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118783 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.919302475999999, 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99444126499999996, 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118783 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120100+0000", 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120101+0000", 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120105+0000", 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6269999999999999e-06 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120117+0000", 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1858999999999999e-05 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120122+0000", 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9439999999999996e-06 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1106999999999998e-05 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120168+0000", 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6870000000000002e-06 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114344+0000", 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.994176328 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114440+0000", 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6028999999999998e-05 2024-09-11T06:19:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.114541+0000", 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100813 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.919014465, 2024-09-11T06:19:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:19:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119572 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 14286848~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.911743538, 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018157623000000001, 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119572 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127659+0000", 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.53e-07 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127661+0000", 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8169999999999999e-06 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127669+0000", 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6380000000000004e-06 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127673+0000", 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7620000000000003e-06 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145694+0000", 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018020806 2024-09-11T06:19:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145758+0000", 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3770999999999996e-05 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145816+0000", 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8476000000000001e-05 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119573 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:3b [sparse-read 15204352~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.911704447999998, 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018351035000000002, 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119573 2024-09-11T06:19:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127698+0000", 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127699+0000", 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4799999999999998e-07 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127718+0000", 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9667999999999999e-05 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127727+0000", 2024-09-11T06:19:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6999999999999997e-06 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127733+0000", 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5500000000000002e-06 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145846+0000", 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018113073 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.145959+0000", 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011347 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146049+0000", 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9926000000000006e-05 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119574 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.911662539000002, 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018368603000000001, 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119574 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127740+0000", 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4099999999999999e-07 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127742+0000", 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8109999999999999e-06 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127749+0000", 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5749999999999997e-06 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127764+0000", 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5361000000000001e-05 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146094+0000", 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01833015 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146108+0000", 2024-09-11T06:19:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4265e-05 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119575 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.911630452000001, 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018387018000000001, 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119575 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127772+0000", 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6899999999999998e-07 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127775+0000", 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1110000000000002e-06 2024-09-11T06:19:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127781+0000", 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4969999999999998e-06 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127786+0000", 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.843e-06 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146148+0000", 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018362195000000001 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146159+0000", 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0903e-05 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119576 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.911609679000001, 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018419563, 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119576 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127793+0000", 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127795+0000", 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0020000000000001e-06 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127802+0000", 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.489e-06 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127806+0000", 2024-09-11T06:19:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7430000000000002e-06 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146199+0000", 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018393093999999999 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146212+0000", 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2812e-05 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119577 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.911589483, 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018434368, 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119577 2024-09-11T06:19:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127813+0000", 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127837+0000", 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3349999999999998e-05 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127844+0000", 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2080000000000003e-06 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127849+0000", 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146235+0000", 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018386120999999998 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146247+0000", 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2281e-05 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119578 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.911546180999999, 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018438821000000001, 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119578 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127856+0000", 2024-09-11T06:19:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127857+0000", 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.34e-07 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127859+0000", 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0839999999999999e-06 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127865+0000", 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127870+0000", 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8879999999999996e-06 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146285+0000", 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018414950999999999 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146295+0000", 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7650000000000005e-06 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119579 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.911525605000001, 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018456706999999999, 2024-09-11T06:19:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119579 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127877+0000", 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127879+0000", 2024-09-11T06:19:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8640000000000001e-06 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127886+0000", 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8109999999999997e-06 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.127891+0000", 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0080000000000002e-06 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146323+0000", 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018431811999999999 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.146334+0000", 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0814e-05 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119721 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.909024370000001, 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018040231, 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119721 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130378+0000", 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130397+0000", 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8663000000000001e-05 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130406+0000", 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9619999999999999e-06 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130412+0000", 2024-09-11T06:19:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4210000000000003e-06 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148411+0000", 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017999004999999998 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148418+0000", 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7519999999999996e-06 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119722 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.908972111000001, 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018031229999999999, 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119722 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130430+0000", 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130431+0000", 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1800000000000005e-07 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130434+0000", 2024-09-11T06:19:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4450000000000001e-06 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130442+0000", 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8369999999999997e-06 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130448+0000", 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4519999999999996e-06 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148451+0000", 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01800295 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148462+0000", 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0828e-05 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119723 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.908946370999999, 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018050743000000001, 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119723 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130456+0000", 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130457+0000", 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000001e-07 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130459+0000", 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0549999999999998e-06 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130466+0000", 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130477+0000", 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1878999999999999e-05 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148496+0000", 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018784999999999 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148507+0000", 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0550000000000001e-05 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:119724 3.e 3.4751fdee (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e134)", 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.908916768000001, 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018038285000000001, 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 119724 2024-09-11T06:19:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130486+0000", 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5699999999999998e-07 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130488+0000", 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3709999999999998e-06 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130495+0000", 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9260000000000003e-06 2024-09-11T06:19:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.130500+0000", 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9400000000000001e-06 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148519+0000", 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018018688000000001 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.148524+0000", 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9030000000000003e-06 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:140527 3.e 3:706ab4c5:::rbd_header.116d341f54e3:head [watch ping cookie 139721594455552 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e154)", 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:22.723309+0000", 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.3160929489999997, 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.39742399, 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 140527 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723309+0000", 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723309+0000", 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723310+0000", 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3300000000000003e-07 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723313+0000", 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5829999999999998e-06 2024-09-11T06:19:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723320+0000", 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0809999999999999e-06 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723326+0000", 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723401+0000", 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4895999999999996e-05 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:22.723413+0000", 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2322e-05 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:23.120563+0000", 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.39715022900000002 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:23.120640+0000", 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6773999999999994e-05 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:23.120733+0000", 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3401999999999998e-05 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.138 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:28.139 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:28.138+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:28.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:28.239 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:28.239+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:28.284 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:28.284 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:28.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:28.377 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:28.376+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:28.436 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:28.436 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:28.436 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:28.441 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:28.441+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:28.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:28.542 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:28.542+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:28.590 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:19:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 128.78501621300001, 2024-09-11T06:19:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:19:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:19:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:19:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.448662276, 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:19:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.448642935999999, 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:19:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.448624586999998, 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:19:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.448606402999999, 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.448587617000001, 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:19:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.448568618000003, 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:19:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.448540029, 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:19:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.448326903000002, 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:19:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445772015999999, 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445748324999997, 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:19:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445728299000002, 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:19:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:19:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445686744, 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:19:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445662800999997, 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:19:28.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:19:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:19:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:19:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:19:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:19:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:19:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:19:28.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:19:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.663 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445641393000002, 2024-09-11T06:19:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:19:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:19:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:28.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:19:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:19:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:19:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:19:28.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445620605000002, 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:19:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:19:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:19:28.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445600570000003, 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:19:28.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:19:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:19:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:19:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:19:28.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445580433000003, 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445558435999999, 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.687 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:28.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:19:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:19:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:19:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:19:28.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:19:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.445538370999998, 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:19:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:19:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:19:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:28.697 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:28.698 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:28.699 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:28.697+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:28.799 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:28.798+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:28.802 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:28.802 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:28.802 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:28.802 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:28.811 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:28.900 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:28.899+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:28.953 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:28.954 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:28.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:29.006 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:29.005+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:29.067 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 149.44602420000001, 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:29.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:19:29.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:29.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:19:29.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:19:29.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 149.15158862199999, 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:19:29.075 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:19:29.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:29.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.885025427999999, 2024-09-11T06:19:29.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:19:29.081 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:19:29.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.921342836999997, 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.087 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.921325410999998, 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.092 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:19:29.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.921308154999998, 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:29.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:19:29.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:19:29.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.947097958000001, 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:19:29.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:19:29.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.947005256000001, 2024-09-11T06:19:29.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:29.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:19:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:19:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.946799446, 2024-09-11T06:19:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:19:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:19:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:19:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:19:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:19:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:19:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:19:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:19:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:19:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:19:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:19:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.946713879000001, 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:19:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:19:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:19:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:19:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.946500620999998, 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:19:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:19:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.946417302, 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.946160419000002, 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:19:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:19:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.946098979999999, 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:19:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.945853155000002, 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:19:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:19:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.945785028, 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:19:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.945517366000001, 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.945445326000002, 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:19:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.945274566999998, 2024-09-11T06:19:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:19:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:19:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.945169346, 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:19:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:19:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:19:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:29.184 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:29.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:19:29.186 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:29.184+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:29.186 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:29.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:29.296 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-11T06:19:29.296 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:29.295+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:29.298 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:29.299 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:29.299 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:29.308 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:29.387 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:29.386+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:29.415 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:29.415 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:29.415 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:29.415 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:29.415 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:29.424 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:29.452 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:29.481 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:29.481 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:29.488 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:29.487+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:29.507 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:29.507 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:29.524 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:29.524 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:29.529 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:29.529 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:29.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:29.529 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:29.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.529 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124090 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2588672~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.529 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133708466000002, 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038606527000000002, 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124090 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3699999999999999e-07 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393921+0000", 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-06 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393924+0000", 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9809999999999999e-06 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393927+0000", 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.441e-06 2024-09-11T06:19:29.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432404+0000", 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038477645999999997 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432457+0000", 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2266999999999999e-05 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432526+0000", 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9871999999999998e-05 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124091 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133698999, 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038834586999999997, 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.534 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124091 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393930+0000", 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393931+0000", 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:29.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393934+0000", 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.055e-06 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393936+0000", 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432564+0000", 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038628026000000003 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432650+0000", 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5545999999999997e-05 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432764+0000", 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011411199999999999 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124092 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133689518000001, 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039050738000000002, 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.539 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124092 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393940+0000", 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0699999999999999e-06 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393943+0000", 2024-09-11T06:19:29.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393945+0000", 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.356e-06 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432796+0000", 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038850253000000001 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432883+0000", 2024-09-11T06:19:29.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7287999999999995e-05 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432990+0000", 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106586 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124093 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133679944000001, 2024-09-11T06:19:29.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039266809999999999, 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124093 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393949+0000", 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4600000000000001e-07 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393950+0000", 2024-09-11T06:19:29.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.105e-06 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393953+0000", 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.959e-06 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393955+0000", 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.605e-06 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433033+0000", 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039077685000000001 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433095+0000", 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2451000000000002e-05 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433215+0000", 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119759 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124094 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2621440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133670253999998, 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039472198, 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.548 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124094 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5499999999999999e-07 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393964+0000", 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3510000000000001e-06 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393969+0000", 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6080000000000003e-06 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393974+0000", 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5560000000000001e-06 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433238+0000", 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039264518999999998 2024-09-11T06:19:29.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433322+0000", 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3805000000000001e-05 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433430+0000", 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010810399999999999 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124095 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2629632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133648295, 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039657393999999999, 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124095 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.553 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393981+0000", 2024-09-11T06:19:29.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393983+0000", 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393988+0000", 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393992+0000", 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0679999999999998e-06 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433471+0000", 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039478924999999998 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433531+0000", 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9883000000000002e-05 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433637+0000", 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106449 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124096 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2637824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133631033, 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039912982999999999, 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.557 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124096 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:29.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393998+0000", 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393999+0000", 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.764e-06 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394004+0000", 2024-09-11T06:19:29.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394008+0000", 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.092e-06 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433714+0000", 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039705419999999998 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433804+0000", 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0447999999999999e-05 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433910+0000", 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010616999999999999 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124097 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2646016~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133613399000001, 2024-09-11T06:19:29.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040088436999999998, 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124097 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394017+0000", 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394023+0000", 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9449999999999998e-06 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394028+0000", 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:19:29.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433952+0000", 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039924460000000002 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434009+0000", 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6860000000000001e-05 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434103+0000", 2024-09-11T06:19:29.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4455000000000003e-05 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124098 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133595529000001, 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040258124999999999, 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.566 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124098 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394035+0000", 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6780000000000001e-06 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394040+0000", 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1540000000000001e-06 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394044+0000", 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2189999999999998e-06 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434130+0000", 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040085549999999998 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434208+0000", 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7865000000000001e-05 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434291+0000", 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3347e-05 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124099 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.13357916, 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040461951000000003, 2024-09-11T06:19:29.570 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124099 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394050+0000", 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.89e-07 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394052+0000", 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394057+0000", 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7529999999999998e-06 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394063+0000", 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434323+0000", 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040260038999999997 2024-09-11T06:19:29.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434378+0000", 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5631999999999999e-05 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434511+0000", 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013283699999999999 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.574 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124100 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133546185, 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040582739999999999, 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124100 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:29.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394083+0000", 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394087+0000", 2024-09-11T06:19:29.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000004e-06 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394093+0000", 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394098+0000", 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9860000000000002e-06 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434548+0000", 2024-09-11T06:19:29.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040450016999999998 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434595+0000", 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6255999999999999e-05 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434665+0000", 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0338000000000003e-05 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.578 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124101 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133523286999999, 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040783649999999998, 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124101 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394107+0000", 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394113+0000", 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8440000000000003e-06 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394117+0000", 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.335e-06 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434695+0000", 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040577692999999998 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434783+0000", 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7538000000000001e-05 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434889+0000", 2024-09-11T06:19:29.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105989 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124102 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133505019000001, 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040992853000000003, 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.583 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124102 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394124+0000", 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394126+0000", 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394131+0000", 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6879999999999996e-06 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394136+0000", 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5430000000000004e-06 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434919+0000", 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040782773000000001 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435005+0000", 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6594000000000005e-05 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435116+0000", 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110776 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124103 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133486620999999, 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041211651000000002, 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.587 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124103 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394144+0000", 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7689999999999999e-06 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394150+0000", 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6699999999999999e-06 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394154+0000", 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435146+0000", 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040991684 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435239+0000", 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3428000000000001e-05 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435353+0000", 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114219 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.591 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124104 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133468508, 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041465574999999998, 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124104 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:29.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394162+0000", 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.776e-06 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394168+0000", 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7080000000000002e-06 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394172+0000", 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5059999999999997e-06 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435385+0000", 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041212998000000001 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435477+0000", 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1528999999999997e-05 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435625+0000", 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148677 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124105 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133450630999999, 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041619452000000001, 2024-09-11T06:19:29.596 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124105 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394180+0000", 2024-09-11T06:19:29.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0930000000000001e-06 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394186+0000", 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5389999999999998e-06 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394191+0000", 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7039999999999999e-06 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435663+0000", 2024-09-11T06:19:29.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041471806 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435721+0000", 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7655999999999998e-05 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435797+0000", 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6247000000000004e-05 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124106 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133426839999998, 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041713447000000001, 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124106 2024-09-11T06:19:29.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394204+0000", 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394210+0000", 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2269999999999998e-06 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394215+0000", 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435816+0000", 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041600683999999999 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435858+0000", 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2518999999999997e-05 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435915+0000", 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6514000000000001e-05 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124107 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133407071000001, 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041835280000000002, 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.605 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124107 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394222+0000", 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394223+0000", 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.793e-06 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394229+0000", 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394233+0000", 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435931+0000", 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041697761 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435972+0000", 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0806000000000002e-05 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436057+0000", 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4602000000000001e-05 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124108 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133389350000002, 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042155791999999997, 2024-09-11T06:19:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124108 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394241+0000", 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0109999999999999e-06 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394247+0000", 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8810000000000001e-06 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394252+0000", 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436174+0000", 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041922012000000002 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436274+0000", 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100054 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436395+0000", 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012093499999999999 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124109 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 25.133370858999999, 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042294403000000001, 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124109 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394258+0000", 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394269+0000", 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0974e-05 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394275+0000", 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3450000000000002e-06 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394280+0000", 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.826e-06 2024-09-11T06:19:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436426+0000", 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042146175000000001 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436472+0000", 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436552+0000", 2024-09-11T06:19:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0075999999999997e-05 2024-09-11T06:19:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:29.618 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:29.619 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:29.619 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:29.619 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:29.620 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:29.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:29.621 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:29.621 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:5044 read 0x9811416 thru 0x9819624 (0x820f bytes) 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:5046 punch from 0x34e6c8f to 0x34e6f31, (0x2a2 bytes) 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:5047 read 0x56433c7 thru 0x56507ac (0xd3e6 bytes) 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:5048 writesame 0x79f84a3 thru 0x79fddbe data_size 0x6(0x591c bytes) 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:5049 read 0x851dfc1 thru 0x85230f3 (0x5133 bytes) 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:5050 writesame 0x75df2ef thru 0x75e591c data_size 0x3a(0x662e bytes) 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:5051 write 0xcc00e77 thru 0xcc0bafc (0xac86 bytes) 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:29.622 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:29.623 INFO:teuthology.orchestra.run.smithi070.stdout:5052 write 0xecbd4b7 thru 0xecbff61 (0x2aab bytes) 2024-09-11T06:19:29.623 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.624 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:29.618+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:29.626 INFO:teuthology.orchestra.run.smithi070.stdout:5056 trunc from 0xecbff62 to 0x886be83 2024-09-11T06:19:29.646 INFO:teuthology.orchestra.run.smithi070.stdout:5057 write 0x74141f7 thru 0x742314c (0xef56 bytes) 2024-09-11T06:19:29.648 INFO:teuthology.orchestra.run.smithi070.stdout:5059 read 0x9510c5 thru 0x9555c6 (0x4502 bytes) 2024-09-11T06:19:29.656 INFO:teuthology.orchestra.run.smithi070.stdout:5061 writesame 0x9b0db4b thru 0x9b0e1e2 data_size 0x4(0x698 bytes) 2024-09-11T06:19:29.656 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.656 INFO:teuthology.orchestra.run.smithi070.stdout:5063 punch from 0x22ec224 to 0x22f3f5a, (0x7d36 bytes) 2024-09-11T06:19:29.656 INFO:teuthology.orchestra.run.smithi070.stdout:5065 read 0x63b0a60 thru 0x63b63a0 (0x5941 bytes) 2024-09-11T06:19:29.657 INFO:teuthology.orchestra.run.smithi070.stdout:5066 read 0x95fb06e thru 0x9605310 (0xa2a3 bytes) 2024-09-11T06:19:29.657 INFO:teuthology.orchestra.run.smithi070.stdout:5067 write 0x4cf39ab thru 0x4cfc3a6 (0x89fc bytes) 2024-09-11T06:19:29.659 INFO:teuthology.orchestra.run.smithi070.stdout:5069 punch from 0x177e33b to 0x17861fe, (0x7ec3 bytes) 2024-09-11T06:19:29.659 INFO:teuthology.orchestra.run.smithi070.stdout:5070 writesame 0x374fb31 thru 0x3754536 data_size 0x19(0x4a06 bytes) 2024-09-11T06:19:29.660 INFO:teuthology.orchestra.run.smithi070.stdout:5071 write 0x513fdc6 thru 0x51453b4 (0x55ef bytes) 2024-09-11T06:19:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:5072 punch from 0x9ac3e8e to 0x9ad1c07, (0xdd79 bytes) 2024-09-11T06:19:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:5073 write 0x118170c thru 0x118bfe3 (0xa8d8 bytes) 2024-09-11T06:19:29.664 INFO:teuthology.orchestra.run.smithi070.stdout:5074 read 0x2edf195 thru 0x2eec23a (0xd0a6 bytes) 2024-09-11T06:19:29.674 INFO:teuthology.orchestra.run.smithi070.stdout:5075 write 0xc38141f thru 0xc390954 (0xf536 bytes) 2024-09-11T06:19:29.678 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.678 INFO:teuthology.orchestra.run.smithi070.stdout:5078 write 0x58cb527 thru 0x58ce6be (0x3198 bytes) 2024-09-11T06:19:29.687 INFO:teuthology.orchestra.run.smithi070.stdout:5079 write 0xca68342 thru 0xca756dd (0xd39c bytes) 2024-09-11T06:19:29.689 INFO:teuthology.orchestra.run.smithi070.stdout:5080 write 0xb071e80 thru 0xb07e2e5 (0xc466 bytes) 2024-09-11T06:19:29.692 INFO:teuthology.orchestra.run.smithi070.stdout:5081 write 0x2e7b3 thru 0x341bb (0x5a09 bytes) 2024-09-11T06:19:29.694 INFO:teuthology.orchestra.run.smithi070.stdout:5086 write 0x1e6046d thru 0x1e6855e (0x80f2 bytes) 2024-09-11T06:19:29.698 INFO:teuthology.orchestra.run.smithi070.stdout:5087 punch from 0x2773f5 to 0x285abd, (0xe6c8 bytes) 2024-09-11T06:19:29.698 INFO:teuthology.orchestra.run.smithi070.stdout:5088 punch from 0x82fe75d to 0x82fede5, (0x688 bytes) 2024-09-11T06:19:29.698 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.698 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.699 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.699 INFO:teuthology.orchestra.run.smithi070.stdout:5094 read 0x9cd075f thru 0x9ce0319 (0xfbbb bytes) 2024-09-11T06:19:29.699 INFO:teuthology.orchestra.run.smithi070.stdout:5095 write 0x598c123 thru 0x598f767 (0x3645 bytes) 2024-09-11T06:19:29.699 INFO:teuthology.orchestra.run.smithi070.stdout:5096 write 0xba32254 thru 0xba32a7f (0x82c bytes) 2024-09-11T06:19:29.703 INFO:teuthology.orchestra.run.smithi070.stdout:5097 write 0x72408f9 thru 0x72450d0 (0x47d8 bytes) 2024-09-11T06:19:29.704 INFO:teuthology.orchestra.run.smithi070.stdout:5098 writesame 0xc244b92 thru 0xc24cd0b data_size 0x1(0x817a bytes) 2024-09-11T06:19:29.720 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:29.719+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:29.721 INFO:teuthology.orchestra.run.smithi070.stdout:5099 write 0x1d09714 thru 0x1d0af07 (0x17f4 bytes) 2024-09-11T06:19:29.722 INFO:teuthology.orchestra.run.smithi070.stdout:5100 read 0x27284db thru 0x27359b2 (0xd4d8 bytes) 2024-09-11T06:19:29.723 INFO:teuthology.orchestra.run.smithi070.stdout:5101 read 0x57721e9 thru 0x577456f (0x2387 bytes) 2024-09-11T06:19:29.723 INFO:teuthology.orchestra.run.smithi070.stdout:5102 write 0xa07b3f1 thru 0xa08b2b3 (0xfec3 bytes) 2024-09-11T06:19:29.726 INFO:teuthology.orchestra.run.smithi070.stdout:5103 write 0x7741fb5 thru 0x774de96 (0xbee2 bytes) 2024-09-11T06:19:29.728 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.729 INFO:teuthology.orchestra.run.smithi070.stdout:5106 read 0xbd8d44f thru 0xbd8e228 (0xdda bytes) 2024-09-11T06:19:29.729 INFO:teuthology.orchestra.run.smithi070.stdout:5107 punch from 0x74aff82 to 0x74b837f, (0x83fd bytes) 2024-09-11T06:19:29.729 INFO:teuthology.orchestra.run.smithi070.stdout:5108 read 0xad616c thru 0xae4ec4 (0xed59 bytes) 2024-09-11T06:19:29.729 INFO:teuthology.orchestra.run.smithi070.stdout:5109 read 0x7b48660 thru 0x7b4e14a (0x5aeb bytes) 2024-09-11T06:19:29.737 INFO:teuthology.orchestra.run.smithi070.stdout:5110 write 0xdd034ae thru 0xdd07e55 (0x49a8 bytes) 2024-09-11T06:19:29.743 INFO:teuthology.orchestra.run.smithi070.stdout:5111 trunc from 0xdd07e56 to 0xc031356 2024-09-11T06:19:29.753 INFO:teuthology.orchestra.run.smithi070.stdout:5115 read 0x418bf8 thru 0x425369 (0xc772 bytes) 2024-09-11T06:19:29.754 INFO:teuthology.orchestra.run.smithi070.stdout:5116 writesame 0xa31b4c2 thru 0xa328b6d data_size 0x16(0xd6ac bytes) 2024-09-11T06:19:29.759 INFO:teuthology.orchestra.run.smithi070.stdout:5119 trunc from 0xc031356 to 0xb4672ad 2024-09-11T06:19:29.769 INFO:teuthology.orchestra.run.smithi070.stdout:5120 write 0xb36e717 thru 0xb37249b (0x3d85 bytes) 2024-09-11T06:19:29.771 INFO:teuthology.orchestra.run.smithi070.stdout:5121 write 0x44770d7 thru 0x4483934 (0xc85e bytes) 2024-09-11T06:19:29.774 INFO:teuthology.orchestra.run.smithi070.stdout:5122 punch from 0xa10aad to 0xa1e933, (0xde86 bytes) 2024-09-11T06:19:29.775 INFO:teuthology.orchestra.run.smithi070.stdout:5123 writesame 0x688c024 thru 0x6898fcc data_size 0x1(0xcfa9 bytes) 2024-09-11T06:19:29.775 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:29.775 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:29.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:29.800 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.800 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.800 INFO:teuthology.orchestra.run.smithi070.stdout:5126 trunc from 0xb4672ad to 0xb0afc8b 2024-09-11T06:19:29.808 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.808 INFO:teuthology.orchestra.run.smithi070.stdout:5128 writesame 0x3323f4b thru 0x332ac57 data_size 0x1(0x6d0d bytes) 2024-09-11T06:19:29.820 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:29.819+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:29.822 INFO:teuthology.orchestra.run.smithi070.stdout:5129 write 0x87d6efc thru 0x87d9932 (0x2a37 bytes) 2024-09-11T06:19:29.824 INFO:teuthology.orchestra.run.smithi070.stdout:5130 punch from 0x61ae82d to 0x61b69c8, (0x819b bytes) 2024-09-11T06:19:29.829 INFO:teuthology.orchestra.run.smithi070.stdout:5131 trunc from 0xb0afc8b to 0x73d8838 2024-09-11T06:19:29.847 INFO:teuthology.orchestra.run.smithi070.stdout:5132 write 0x18ae6ff thru 0x18bb77a (0xd07c bytes) 2024-09-11T06:19:29.850 INFO:teuthology.orchestra.run.smithi070.stdout:5133 trunc from 0x73d8838 to 0x84d637c 2024-09-11T06:19:29.864 INFO:teuthology.orchestra.run.smithi070.stdout:5134 trunc from 0x84d637c to 0xdd7e605 2024-09-11T06:19:29.882 INFO:teuthology.orchestra.run.smithi070.stdout:5135 trunc from 0xdd7e605 to 0x6a93b77 2024-09-11T06:19:29.896 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:29.896 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:29.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:29.910 INFO:teuthology.orchestra.run.smithi070.stdout:5136 write 0xb917030 thru 0xb91e67b (0x764c bytes) 2024-09-11T06:19:29.913 INFO:teuthology.orchestra.run.smithi070.stdout:5137 writesame 0x16615d8 thru 0x1663449 data_size 0x9(0x1e72 bytes) 2024-09-11T06:19:29.921 INFO:teuthology.orchestra.run.smithi070.stdout:5139 trunc from 0xb91e67c to 0x6c79638 2024-09-11T06:19:29.921 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:29.920+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:29.934 INFO:teuthology.orchestra.run.smithi070.stdout:5140 punch from 0x43e166e to 0x43f0ae9, (0xf47b bytes) 2024-09-11T06:19:29.934 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.934 INFO:teuthology.orchestra.run.smithi070.stdout:5143 writesame 0x960096 thru 0x962b2d data_size 0x1d(0x2a98 bytes) 2024-09-11T06:19:29.935 INFO:teuthology.orchestra.run.smithi070.stdout:5144 read 0x4eb396a thru 0x4eb61b1 (0x2848 bytes) 2024-09-11T06:19:29.946 INFO:teuthology.orchestra.run.smithi070.stdout:5145 write 0x9d1bf5f thru 0x9d23b78 (0x7c1a bytes) 2024-09-11T06:19:29.960 INFO:teuthology.orchestra.run.smithi070.stdout:5146 write 0xe322fa5 thru 0xe3256b6 (0x2712 bytes) 2024-09-11T06:19:29.964 INFO:teuthology.orchestra.run.smithi070.stdout:5147 read 0x3a61061 thru 0x3a67a8f (0x6a2f bytes) 2024-09-11T06:19:29.964 INFO:teuthology.orchestra.run.smithi070.stdout:5150 writesame 0x4bcd117 thru 0x4bd545a data_size 0x4(0x8344 bytes) 2024-09-11T06:19:29.969 INFO:teuthology.orchestra.run.smithi070.stdout:5158 punch from 0xbfaf38a to 0xbfb2acc, (0x3742 bytes) 2024-09-11T06:19:29.969 INFO:teuthology.orchestra.run.smithi070.stdout:5159 writesame 0xaf99a30 thru 0xaf9f6f2 data_size 0x1(0x5cc3 bytes) 2024-09-11T06:19:29.983 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:29.984 INFO:teuthology.orchestra.run.smithi070.stdout:5161 write 0x570aea thru 0x57184b (0xd62 bytes) 2024-09-11T06:19:29.997 INFO:teuthology.orchestra.run.smithi070.stdout:5162 trunc from 0xe3256b7 to 0x416e540 2024-09-11T06:19:30.018 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:30.018 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:30.022 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:30.021+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:30.028 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:30.031 INFO:teuthology.orchestra.run.smithi070.stdout:5163 writesame 0xc665c95 thru 0xc667e00 data_size 0xc(0x216c bytes) 2024-09-11T06:19:30.031 INFO:teuthology.orchestra.run.smithi070.stdout:5164 read 0x455f43e thru 0x456da8d (0xe650 bytes) 2024-09-11T06:19:30.032 INFO:teuthology.orchestra.run.smithi070.stdout:5165 read 0x8a4a073 thru 0x8a4b80f (0x179d bytes) 2024-09-11T06:19:30.032 INFO:teuthology.orchestra.run.smithi070.stdout:5166 read 0x8277a3e thru 0x82814ff (0x9ac2 bytes) 2024-09-11T06:19:30.032 INFO:teuthology.orchestra.run.smithi070.stdout:5168 punch from 0x4789c40 to 0x4798fe0, (0xf3a0 bytes) 2024-09-11T06:19:30.032 INFO:teuthology.orchestra.run.smithi070.stdout:5170 trunc from 0xc667e01 to 0xbe98da7 2024-09-11T06:19:30.037 INFO:teuthology.orchestra.run.smithi070.stdout:5173 writesame 0x6a34d6c thru 0x6a41dbc data_size 0x1(0xd051 bytes) 2024-09-11T06:19:30.065 INFO:teuthology.orchestra.run.smithi070.stdout:5175 write 0x1105ba6 thru 0x11087b6 (0x2c11 bytes) 2024-09-11T06:19:30.070 INFO:teuthology.orchestra.run.smithi070.stdout:5176 trunc from 0xbe98da7 to 0x8e49e97 2024-09-11T06:19:30.078 INFO:teuthology.orchestra.run.smithi070.stdout:5177 write 0x7affb1e thru 0x7b01d9d (0x2280 bytes) 2024-09-11T06:19:30.083 INFO:teuthology.orchestra.run.smithi070.stdout:5179 read 0x7faa1b7 thru 0x7fb2444 (0x828e bytes) 2024-09-11T06:19:30.083 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:30.083 INFO:teuthology.orchestra.run.smithi070.stdout:5183 punch from 0x20e323 to 0x21447f, (0x615c bytes) 2024-09-11T06:19:30.083 INFO:teuthology.orchestra.run.smithi070.stdout:5184 read 0x69e860f thru 0x69eaac6 (0x24b8 bytes) 2024-09-11T06:19:30.083 INFO:teuthology.orchestra.run.smithi070.stdout:5185 read 0x7940c9d thru 0x794c9a2 (0xbd06 bytes) 2024-09-11T06:19:30.083 INFO:teuthology.orchestra.run.smithi070.stdout:5186 read 0x85df32d thru 0x85ecfce (0xdca2 bytes) 2024-09-11T06:19:30.084 INFO:teuthology.orchestra.run.smithi070.stdout:5187 read 0x487a62f thru 0x4880f73 (0x6945 bytes) 2024-09-11T06:19:30.084 INFO:teuthology.orchestra.run.smithi070.stdout:5188 read 0x647974d thru 0x647b556 (0x1e0a bytes) 2024-09-11T06:19:30.084 INFO:teuthology.orchestra.run.smithi070.stdout:5189 punch from 0x867846d to 0x8680975, (0x8508 bytes) 2024-09-11T06:19:30.084 INFO:teuthology.orchestra.run.smithi070.stdout:5190 read 0x4fe4c12 thru 0x4fef3b8 (0xa7a7 bytes) 2024-09-11T06:19:30.085 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:30.086 INFO:teuthology.orchestra.run.smithi070.stdout:5192 trunc from 0x8e49e97 to 0x6ed81df 2024-09-11T06:19:30.095 INFO:teuthology.orchestra.run.smithi070.stdout:5194 trunc from 0x6ed81df to 0x82c1e67 2024-09-11T06:19:30.101 INFO:teuthology.orchestra.run.smithi070.stdout:5195 read 0x2e3782d thru 0x2e3fdab (0x857f bytes) 2024-09-11T06:19:30.101 INFO:teuthology.orchestra.run.smithi070.stdout:5196 read 0x7fc225b thru 0x7fccb1f (0xa8c5 bytes) 2024-09-11T06:19:30.114 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:19:30.117 INFO:teuthology.orchestra.run.smithi070.stdout:5197 writesame 0xa3f34dd thru 0xa4032bd data_size 0x1(0xfde1 bytes) 2024-09-11T06:19:30.117 INFO:teuthology.orchestra.run.smithi070.stdout:5198 punch from 0x8ec0b64 to 0x8ecb17d, (0xa619 bytes) 2024-09-11T06:19:30.118 INFO:teuthology.orchestra.run.smithi070.stdout:5200 trunc from 0xa4032be to 0x974c910 2024-09-11T06:19:30.123 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:30.122+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:30.128 INFO:teuthology.orchestra.run.smithi070.stdout:5201 read 0x7fb8824 thru 0x7fc2196 (0x9973 bytes) 2024-09-11T06:19:30.129 INFO:teuthology.orchestra.run.smithi070.stdout:5202 read 0x8782055 thru 0x878dcdd (0xbc89 bytes) 2024-09-11T06:19:30.130 INFO:teuthology.orchestra.run.smithi070.stdout:5204 trunc from 0x974c910 to 0x8b4ac04 2024-09-11T06:19:30.141 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:30.141 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:30.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:30.224 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:30.223+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:30.253 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:30.253 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:30.262 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:30.325 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:30.325+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:30.406 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:30.406 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:30.414 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:30.459 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:30.459+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:30.518 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:30.518 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:30.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:30.527 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:30.526+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:30.628 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:30.627+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:30.670 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:30.671 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:30.679 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:30.729 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:30.728+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:30.823 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:30.823 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:30.829 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:30.829+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:30.832 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:30.931 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:30.930+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:30.947 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:30.947 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:30.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:31.041 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:31.040+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:31.100 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:31.100 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:31.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:31.130 INFO:teuthology.orchestra.run.smithi070.stdout:5206 write 0x7c1412d thru 0x7c1e88e (0xa762 bytes) 2024-09-11T06:19:31.132 INFO:teuthology.orchestra.run.smithi070.stdout:5207 write 0x20d54d2 thru 0x20d9e47 (0x4976 bytes) 2024-09-11T06:19:31.133 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:31.132+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:31.133 INFO:teuthology.orchestra.run.smithi070.stdout:5208 write 0x3b0c70 thru 0x3b3c63 (0x2ff4 bytes) 2024-09-11T06:19:31.134 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.134 INFO:teuthology.orchestra.run.smithi070.stdout:5212 read 0x65c30da thru 0x65cb6e7 (0x860e bytes) 2024-09-11T06:19:31.134 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.135 INFO:teuthology.orchestra.run.smithi070.stdout:5215 read 0x6a7c6c thru 0x6aec58 (0x6fed bytes) 2024-09-11T06:19:31.135 INFO:teuthology.orchestra.run.smithi070.stdout:5216 write 0x92d10f thru 0x9314fe (0x43f0 bytes) 2024-09-11T06:19:31.137 INFO:teuthology.orchestra.run.smithi070.stdout:5217 read 0x898f3c1 thru 0x8991c07 (0x2847 bytes) 2024-09-11T06:19:31.137 INFO:teuthology.orchestra.run.smithi070.stdout:5218 writesame 0x722d1c3 thru 0x7239ca4 data_size 0x1(0xcae2 bytes) 2024-09-11T06:19:31.168 INFO:teuthology.orchestra.run.smithi070.stdout:5221 read 0x8963c92 thru 0x8972451 (0xe7c0 bytes) 2024-09-11T06:19:31.169 INFO:teuthology.orchestra.run.smithi070.stdout:5222 write 0x1e17ca5 thru 0x1e1c8f6 (0x4c52 bytes) 2024-09-11T06:19:31.170 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.171 INFO:teuthology.orchestra.run.smithi070.stdout:5226 read 0x7194b2b thru 0x71a0c87 (0xc15d bytes) 2024-09-11T06:19:31.177 INFO:teuthology.orchestra.run.smithi070.stdout:5228 trunc from 0x8b4ac04 to 0x2e9196e 2024-09-11T06:19:31.204 INFO:teuthology.orchestra.run.smithi070.stdout:5229 write 0x63e97c5 thru 0x63eb940 (0x217c bytes) 2024-09-11T06:19:31.215 INFO:teuthology.orchestra.run.smithi070.stdout:5230 write 0x6aa8321 thru 0x6ab243d (0xa11d bytes) 2024-09-11T06:19:31.217 INFO:teuthology.orchestra.run.smithi070.stdout:5231 read 0x2932717 thru 0x293e980 (0xc26a bytes) 2024-09-11T06:19:31.217 INFO:teuthology.orchestra.run.smithi070.stdout:5232 read 0x42534dc thru 0x4256604 (0x3129 bytes) 2024-09-11T06:19:31.226 INFO:teuthology.orchestra.run.smithi070.stdout:5234 write 0x910bd3d thru 0x911b968 (0xfc2c bytes) 2024-09-11T06:19:31.229 INFO:teuthology.orchestra.run.smithi070.stdout:5235 write 0x22cc0aa thru 0x22d3a5c (0x79b3 bytes) 2024-09-11T06:19:31.231 INFO:teuthology.orchestra.run.smithi070.stdout:5236 write 0x46c4171 thru 0x46cead4 (0xa964 bytes) 2024-09-11T06:19:31.233 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:31.232+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:31.233 INFO:teuthology.orchestra.run.smithi070.stdout:5237 write 0x4049013 thru 0x40492b5 (0x2a3 bytes) 2024-09-11T06:19:31.234 INFO:teuthology.orchestra.run.smithi070.stdout:5238 writesame 0x27294bc thru 0x2734b8d data_size 0x7(0xb6d2 bytes) 2024-09-11T06:19:31.238 INFO:teuthology.orchestra.run.smithi070.stdout:5239 read 0x8422e27 thru 0x8425356 (0x2530 bytes) 2024-09-11T06:19:31.238 INFO:teuthology.orchestra.run.smithi070.stdout:5240 read 0x371d909 thru 0x372316b (0x5863 bytes) 2024-09-11T06:19:31.241 INFO:teuthology.orchestra.run.smithi070.stdout:5241 trunc from 0x911b969 to 0xb382bc4 2024-09-11T06:19:31.241 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:31.241 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:31.246 INFO:teuthology.orchestra.run.smithi070.stdout:5242 writesame 0x5e9763f thru 0x5e9e4ba data_size 0x6(0x6e7c bytes) 2024-09-11T06:19:31.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:31.260 INFO:teuthology.orchestra.run.smithi070.stdout:5243 write 0xe9bf85f thru 0xe9c0670 (0xe12 bytes) 2024-09-11T06:19:31.267 INFO:teuthology.orchestra.run.smithi070.stdout:5245 read 0xecda44 thru 0xed78d0 (0x9e8d bytes) 2024-09-11T06:19:31.267 INFO:teuthology.orchestra.run.smithi070.stdout:5246 read 0x3103be3 thru 0x3105467 (0x1885 bytes) 2024-09-11T06:19:31.275 INFO:teuthology.orchestra.run.smithi070.stdout:5248 writesame 0xea1fcc5 thru 0xea25fdb data_size 0x1(0x6317 bytes) 2024-09-11T06:19:31.275 INFO:teuthology.orchestra.run.smithi070.stdout:5250 read 0xa451f3a thru 0xa45f9ff (0xdac6 bytes) 2024-09-11T06:19:31.275 INFO:teuthology.orchestra.run.smithi070.stdout:5251 punch from 0xc6907bc to 0xc69b02b, (0xa86f bytes) 2024-09-11T06:19:31.275 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.276 INFO:teuthology.orchestra.run.smithi070.stdout:5255 punch from 0x20ce1d5 to 0x20d3567, (0x5392 bytes) 2024-09-11T06:19:31.276 INFO:teuthology.orchestra.run.smithi070.stdout:5256 writesame 0x43d8352 thru 0x43e61a4 data_size 0x1(0xde53 bytes) 2024-09-11T06:19:31.303 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.303 INFO:teuthology.orchestra.run.smithi070.stdout:5258 punch from 0xbf7ecd to 0xc06fb5, (0xf0e8 bytes) 2024-09-11T06:19:31.303 INFO:teuthology.orchestra.run.smithi070.stdout:5259 read 0xddddc40 thru 0xdde90df (0xb4a0 bytes) 2024-09-11T06:19:31.303 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.303 INFO:teuthology.orchestra.run.smithi070.stdout:5261 write 0x3f0e83c thru 0x3f0f103 (0x8c8 bytes) 2024-09-11T06:19:31.304 INFO:teuthology.orchestra.run.smithi070.stdout:5262 punch from 0x4812c73 to 0x4822c54, (0xffe1 bytes) 2024-09-11T06:19:31.304 INFO:teuthology.orchestra.run.smithi070.stdout:5264 write 0x92a882a thru 0x92ae3c9 (0x5ba0 bytes) 2024-09-11T06:19:31.307 INFO:teuthology.orchestra.run.smithi070.stdout:5265 write 0xc11ed29 thru 0xc1236f2 (0x49ca bytes) 2024-09-11T06:19:31.311 INFO:teuthology.orchestra.run.smithi070.stdout:5266 read 0xc0fb88a thru 0xc10814f (0xc8c6 bytes) 2024-09-11T06:19:31.312 INFO:teuthology.orchestra.run.smithi070.stdout:5267 punch from 0x932933b to 0x932a253, (0xf18 bytes) 2024-09-11T06:19:31.312 INFO:teuthology.orchestra.run.smithi070.stdout:5268 read 0x1aff77d thru 0x1b0afc7 (0xb84b bytes) 2024-09-11T06:19:31.318 INFO:teuthology.orchestra.run.smithi070.stdout:5270 trunc from 0xea25fdc to 0xa021138 2024-09-11T06:19:31.330 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.330 INFO:teuthology.orchestra.run.smithi070.stdout:5272 read 0x36864cc thru 0x368e991 (0x84c6 bytes) 2024-09-11T06:19:31.330 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.330 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.333 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:31.332+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:31.338 INFO:teuthology.orchestra.run.smithi070.stdout:5275 write 0xc5b4281 thru 0xc5bdac9 (0x9849 bytes) 2024-09-11T06:19:31.340 INFO:teuthology.orchestra.run.smithi070.stdout:5276 read 0x88d687b thru 0x88e66b4 (0xfe3a bytes) 2024-09-11T06:19:31.340 INFO:teuthology.orchestra.run.smithi070.stdout:5278 read 0x9ea5bb1 thru 0x9eb10bb (0xb50b bytes) 2024-09-11T06:19:31.340 INFO:teuthology.orchestra.run.smithi070.stdout:5279 writesame 0x2837af7 thru 0x2839bcd data_size 0x1(0x20d7 bytes) 2024-09-11T06:19:31.344 INFO:teuthology.orchestra.run.smithi070.stdout:5280 read 0x7e2dde thru 0x7e4e91 (0x20b4 bytes) 2024-09-11T06:19:31.345 INFO:teuthology.orchestra.run.smithi070.stdout:5281 punch from 0x8486608 to 0x848daa4, (0x749c bytes) 2024-09-11T06:19:31.353 INFO:teuthology.orchestra.run.smithi070.stdout:5282 trunc from 0xc5bdaca to 0x5fa8032 2024-09-11T06:19:31.365 INFO:teuthology.orchestra.run.smithi070.stdout:5283 read 0x416b037 thru 0x4178002 (0xcfcc bytes) 2024-09-11T06:19:31.366 INFO:teuthology.orchestra.run.smithi070.stdout:5286 punch from 0x536738d to 0x53732de, (0xbf51 bytes) 2024-09-11T06:19:31.371 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:31.371 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:31.372 INFO:teuthology.orchestra.run.smithi070.stdout:5287 write 0x6966691 thru 0x696935f (0x2ccf bytes) 2024-09-11T06:19:31.376 INFO:teuthology.orchestra.run.smithi070.stdout:5289 read 0x66378f5 thru 0x664457f (0xcc8b bytes) 2024-09-11T06:19:31.376 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:31.376 INFO:teuthology.orchestra.run.smithi070.stdout:5293 punch from 0x1b736a8 to 0x1b7d46f, (0x9dc7 bytes) 2024-09-11T06:19:31.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:31.387 INFO:teuthology.orchestra.run.smithi070.stdout:5295 write 0xadd6a71 thru 0xade1b42 (0xb0d2 bytes) 2024-09-11T06:19:31.393 INFO:teuthology.orchestra.run.smithi070.stdout:5296 trunc from 0xade1b43 to 0x837a848 2024-09-11T06:19:31.405 INFO:teuthology.orchestra.run.smithi070.stdout:5297 write 0x3cd334e thru 0x3ce0689 (0xd33c bytes) 2024-09-11T06:19:31.406 INFO:teuthology.orchestra.run.smithi070.stdout:5298 clone 36 order 23 su 4194304 sc 7 2024-09-11T06:19:31.435 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:31.434+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:31.491 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:31.491 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:31.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:31.541 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:31.540+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:31.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:31.636 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:31.636+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:31.643 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:31.643 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:31.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:31.737 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:31.736+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:31.747 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:31.748 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:31.765 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:31.765 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:31.781 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:31.797 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:31.797 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:31.800 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:31.800 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:31.800 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:31.800 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:31.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:31.814 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:31.814 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:31.832 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:31.833 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:31.838 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:31.837+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:31.849 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:31.866 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:31.866 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:31.914 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:31.914 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:31.915 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:31.915 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:31.915 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:31.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:31.938 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:31.938+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:32.039 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:32.039+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:32.067 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:32.068 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:32.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:32.068 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:32.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.068 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:19:32.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:32.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 132.26199102499999, 2024-09-11T06:19:32.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:19:32.069 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:32.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:19:32.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:32.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:32.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:19:32.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:19:32.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:19:32.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:19:32.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:19:32.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:19:32.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:19:32.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:19:32.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:19:32.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:19:32.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:19:32.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:19:32.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:32.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:19:32.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:19:32.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:32.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:19:32.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:19:32.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:32.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:19:32.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:19:32.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:32.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:19:32.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:19:32.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:19:32.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:19:32.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.082 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.082 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.082 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:32.083 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.925637088000002, 2024-09-11T06:19:32.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:19:32.083 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:19:32.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.925617748000001, 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:19:32.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.925599398999999, 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:32.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:19:32.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.925581215000001, 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:19:32.101 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:19:32.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:19:32.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:19:32.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:19:32.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.925562429000003, 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:19:32.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.925543429999998, 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:32.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.925514841000002, 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.118 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:19:32.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:19:32.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:32.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.925301715000003, 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:32.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:19:32.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:19:32.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922746828000001, 2024-09-11T06:19:32.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:32.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:19:32.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922723136999998, 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:19:32.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:19:32.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:19:32.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:19:32.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:19:32.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922703110999997, 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:19:32.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:32.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:19:32.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922661556000001, 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:19:32.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:19:32.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:19:32.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:19:32.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922637612999999, 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:19:32.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922616204999997, 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:19:32.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:32.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:19:32.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922595416999997, 2024-09-11T06:19:32.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:32.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:19:32.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:19:32.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922575381999998, 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922555244999998, 2024-09-11T06:19:32.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:32.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:19:32.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:19:32.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:32.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922533248000001, 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:32.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:19:32.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:19:32.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:19:32.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:19:32.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.922513183, 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:19:32.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:19:32.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.183 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:32.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:19:32.184 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:19:32.184 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:19:32.185 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T06:19:32.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:19:32.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:32.187 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:32.185+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:32.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:32.286+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:32.381 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:32.381 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:32.388 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:32.387+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:32.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:32.489 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:32.488+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:32.521 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 164, 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:19:32.118904+0000", 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:18:57.153745+0000", 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:16:42.356322+0000", 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5799936, 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:19:32.522 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 7, 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:19:32.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:32.524 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:19:32.525 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:32.526 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:32.527 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:32.528 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:19:32.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:32.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:32.531 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:32.532 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:19:32.533 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:32.534 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:32.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:32.536 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:19:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:19:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:19:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:19:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:19:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:32.537 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:19:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:19:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:19:32.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:19:32.539 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "164", 2024-09-11T06:19:32.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 73, 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 164, 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:32.541 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:32.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:32.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:19:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:19:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:32.545 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:19:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:19:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:19:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:19:32.546 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:19:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.547 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:19:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:19:32.548 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0.630950927734375, 2024-09-11T06:19:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:32.549 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 155, 2024-09-11T06:19:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:19:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:19:32.551 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:19:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.553 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:19:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:32.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:19:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:19:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:19:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:19:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:19:32.558 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:19:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:19:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:19:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:19:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:19:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:32.560 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.6932525634765625, 2024-09-11T06:19:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:19:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 54, 2024-09-11T06:19:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 92, 2024-09-11T06:19:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 161, 2024-09-11T06:19:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 56, 2024-09-11T06:19:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:32.561 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:19:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:19:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:19:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:32.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:19:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:19:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:32.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:19:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.567 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:19:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/747530186", 2024-09-11T06:19:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/747530186", 2024-09-11T06:19:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/747530186", 2024-09-11T06:19:32.569 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/747530186", 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:19:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:19:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 109, 2024-09-11T06:19:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 130, 2024-09-11T06:19:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 162, 2024-09-11T06:19:32.571 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 110, 2024-09-11T06:19:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:32.573 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:32.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/4176263936", 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/4176263936", 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/4176263936", 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/4176263936", 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.577 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 133, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:32.578 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:32.579 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.579 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:19:32.579 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:32.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:32.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:32.583 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:32.584 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 154, 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:19:32.585 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.586 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:19:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:19:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:19:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:19:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:19:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:19:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:19:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 130, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:19:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0.7060699462890625, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 142, 2024-09-11T06:19:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:19:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.019287109375, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 110, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:19:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:19:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 56 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 110 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:19:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.3", 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: 6, 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: 3 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.f", 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: 7, 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.12", 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 3, 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 4 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.19", 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 4, 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 1, 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 3 2024-09-11T06:19:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:19:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 70, 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 72, 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.627 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:32.630 INFO:tasks.thrashosds.thrasher:j is {'epoch': 164, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:19:32.118904+0000', 'last_up_change': '2024-09-11T06:18:57.153745+0000', 'last_in_change': '2024-09-11T06:16:42.356322+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 73, 'snap_epoch': 164, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 0.630950927734375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 155, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6932525634765625, 'last_clean_begin': 15, 'last_clean_end': 54, 'up_from': 92, 'up_thru': 161, 'down_at': 56, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 747530186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 747530186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 747530186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 747530186}]}, 'public_addr': '172.21.15.70:6817/747530186', 'cluster_addr': '172.21.15.70:6819/747530186', 'heartbeat_back_addr': '172.21.15.70:6823/747530186', 'heartbeat_front_addr': '172.21.15.70:6821/747530186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 109, 'up_from': 130, 'up_thru': 162, 'down_at': 110, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 4176263936}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4176263936}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4176263936}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4176263936}]}, 'public_addr': '172.21.15.70:6809/4176263936', 'cluster_addr': '172.21.15.70:6811/4176263936', 'heartbeat_back_addr': '172.21.15.70:6815/4176263936', 'heartbeat_front_addr': '172.21.15.70:6813/4176263936', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 154, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 0.7060699462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 142, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.019287109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 110, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 56}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 110}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.3', 'osds': [6, 3]}, {'pgid': '3.f', 'osds': [7, 2]}], 'pg_upmap_items': [{'pgid': '3.12', 'mappings': [{'from': 3, 'to': 4}]}, {'pgid': '3.19', 'mappings': [{'from': 4, 'to': 2}, {'from': 1, 'to': 3}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 70, 'length': 1}, {'begin': 72, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:19:32.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:19:32.631 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:32.632 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:32.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:32.633 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:32.628+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:32.730 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:32.729+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 153.15836436999999, 2024-09-11T06:19:32.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:19:32.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:32.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:19:32.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 152.863928792, 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.597365597999996, 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:32.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:19:32.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 62.633683007000002, 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:19:32.800 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:32.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 62.633665581000002, 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:19:32.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:19:32.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:32.811 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 62.633648325000003, 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:19:32.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.659438127999998, 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:32.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:19:32.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:19:32.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:19:32.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.659345426000002, 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:19:32.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:19:32.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:19:32.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.659139615999997, 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:32.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:19:32.834 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.659054048999998, 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:32.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:19:32.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:19:32.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:19:32.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.658840791000003, 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:32.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.658757471999998, 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:19:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:19:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.658500588999999, 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:19:32.854 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:19:32.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:19:32.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:19:32.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.65843915, 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:32.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:19:32.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:19:32.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.658193324999999, 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:19:32.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:19:32.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.658125198, 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:32.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:19:32.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.657857536000002, 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:32.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:19:32.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.657785496000002, 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:19:32.885 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:32.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:19:32.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.657614737000003, 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:19:32.891 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:32.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:19:32.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.657509515999998, 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:32.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:32.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:19:32.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:32.904 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:32.904 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:32.905 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:32.906 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:32.904+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:32.951 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:32.952 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:19:32.963 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-11T06:19:32.443047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1719119305,"num_objects":997,"num_object_clones":0,"num_object_copies":1994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":997,"num_whiteouts":0,"num_read":139468,"num_read_kb":1090216,"num_write":19664,"num_write_kb":737790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":117172054,"num_keys_recovered":279,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13809,"ondisk_log_size":13809,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":420200,"kb_used_data":96252,"kb_used_omap":37,"kb_used_meta":323610,"kb_avail":754554520,"statfs":{"total":773094113280,"available":772663828480,"internally_reserved":0,"allocated":98562048,"data_stored":719313824,"data_compressed":20955585,"data_compressed_allocated":63283200,"data_compressed_original":695948119,"omap_allocated":38504,"internal_metadata":331377048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":60806240,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":2098,"num_read_kb":2338,"num_write":498,"num_write_kb":2006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":3874693,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000592"},"pg_stats":[{"pgid":"3.1f","version":"158'256","reported_seq":2702,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.125563+0000","last_change":"2024-09-11T06:19:26.125393+0000","last_active":"2024-09-11T06:19:27.125563+0000","last_peered":"2024-09-11T06:19:27.125563+0000","last_clean":"2024-09-11T06:19:27.125563+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:19:27.125563+0000","last_undegraded":"2024-09-11T06:19:27.125563+0000","last_fullsized":"2024-09-11T06:19:27.125563+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:27:15.714351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000770354,"stat_sum":{"num_bytes":56055224,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2140,"num_read_kb":25315,"num_write":418,"num_write_kb":25057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.1e","version":"158'378","reported_seq":5026,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.125713+0000","last_change":"2024-09-11T06:19:26.125293+0000","last_active":"2024-09-11T06:19:27.125713+0000","last_peered":"2024-09-11T06:19:27.125713+0000","last_clean":"2024-09-11T06:19:27.125713+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:19:27.125713+0000","last_undegraded":"2024-09-11T06:19:27.125713+0000","last_fullsized":"2024-09-11T06:19:27.125713+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:13:32.740916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000597297,"stat_sum":{"num_bytes":15350105,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":5236,"num_read_kb":19828,"num_write":567,"num_write_kb":14090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.1d","version":"144'742","reported_seq":5534,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114914+0000","last_change":"2024-09-11T06:19:26.113953+0000","last_active":"2024-09-11T06:19:27.114914+0000","last_peered":"2024-09-11T06:19:27.114914+0000","last_clean":"2024-09-11T06:19:27.114914+0000","last_became_active":"2024-09-11T06:17:09.684227+0000","last_became_peered":"2024-09-11T06:17:09.684227+0000","last_unstale":"2024-09-11T06:19:27.114914+0000","last_undegraded":"2024-09-11T06:19:27.114914+0000","last_fullsized":"2024-09-11T06:19:27.114914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:55.938909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000949229,"stat_sum":{"num_bytes":112371308,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":6824,"num_read_kb":76233,"num_write":1215,"num_write_kb":34174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.1c","version":"164'475","reported_seq":10273,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-11T06:19:32.145336+0000","last_change":"2024-09-11T06:19:29.119754+0000","last_active":"2024-09-11T06:19:32.145336+0000","last_peered":"2024-09-11T06:19:32.145336+0000","last_clean":"2024-09-11T06:19:32.145336+0000","last_became_active":"2024-09-11T06:19:23.119515+0000","last_became_peered":"2024-09-11T06:19:23.119515+0000","last_unstale":"2024-09-11T06:19:32.145336+0000","last_undegraded":"2024-09-11T06:19:32.145336+0000","last_fullsized":"2024-09-11T06:19:32.145336+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:50:23.992194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044549699999999999,"stat_sum":{"num_bytes":65283006,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":11192,"num_read_kb":45843,"num_write":762,"num_write_kb":13534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":5117157,"num_keys_recovered":128,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.1b","version":"155'414","reported_seq":2911,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.113922+0000","last_change":"2024-09-11T06:19:26.116784+0000","last_active":"2024-09-11T06:19:27.113922+0000","last_peered":"2024-09-11T06:19:27.113922+0000","last_clean":"2024-09-11T06:19:27.113922+0000","last_became_active":"2024-09-11T06:19:23.118229+0000","last_became_peered":"2024-09-11T06:19:23.118229+0000","last_unstale":"2024-09-11T06:19:27.113922+0000","last_undegraded":"2024-09-11T06:19:27.113922+0000","last_fullsized":"2024-09-11T06:19:27.113922+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:47.105464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001388135,"stat_sum":{"num_bytes":42947121,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2708,"num_read_kb":29315,"num_write":608,"num_write_kb":23502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":12656084,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.1a","version":"158'525","reported_seq":9219,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.138239+0000","last_change":"2024-09-11T06:19:26.126032+0000","last_active":"2024-09-11T06:19:27.138239+0000","last_peered":"2024-09-11T06:19:27.138239+0000","last_clean":"2024-09-11T06:19:27.138239+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:19:27.138239+0000","last_undegraded":"2024-09-11T06:19:27.138239+0000","last_fullsized":"2024-09-11T06:19:27.138239+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:33:43.879996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001435434,"stat_sum":{"num_bytes":72807622,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":9668,"num_read_kb":64147,"num_write":720,"num_write_kb":25678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.19","version":"163'336","reported_seq":3285,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.137817+0000","last_change":"2024-09-11T06:19:31.117682+0000","last_active":"2024-09-11T06:19:31.137817+0000","last_peered":"2024-09-11T06:19:31.137817+0000","last_clean":"2024-09-11T06:19:31.137817+0000","last_became_active":"2024-09-11T06:19:31.116157+0000","last_became_peered":"2024-09-11T06:19:31.116157+0000","last_unstale":"2024-09-11T06:19:31.137817+0000","last_undegraded":"2024-09-11T06:19:31.137817+0000","last_fullsized":"2024-09-11T06:19:31.137817+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:51:03.802495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038558400000000001,"stat_sum":{"num_bytes":38918395,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3292,"num_read_kb":22391,"num_write":433,"num_write_kb":14181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":6748365,"num_keys_recovered":33,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.18","version":"158'985","reported_seq":4921,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.125585+0000","last_change":"2024-09-11T06:19:26.126001+0000","last_active":"2024-09-11T06:19:27.125585+0000","last_peered":"2024-09-11T06:19:27.125585+0000","last_clean":"2024-09-11T06:19:27.125585+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:19:27.125585+0000","last_undegraded":"2024-09-11T06:19:27.125585+0000","last_fullsized":"2024-09-11T06:19:27.125585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":985,"log_dups_size":0,"ondisk_log_size":985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:41.937752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014030869999999999,"stat_sum":{"num_bytes":37357130,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":8642,"num_read_kb":26222,"num_write":1484,"num_write_kb":22805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.17","version":"148'208","reported_seq":3457,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.125594+0000","last_change":"2024-09-11T06:19:26.125658+0000","last_active":"2024-09-11T06:19:27.125594+0000","last_peered":"2024-09-11T06:19:27.125594+0000","last_clean":"2024-09-11T06:19:27.125594+0000","last_became_active":"2024-09-11T06:17:09.686720+0000","last_became_peered":"2024-09-11T06:17:09.686720+0000","last_unstale":"2024-09-11T06:19:27.125594+0000","last_undegraded":"2024-09-11T06:19:27.125594+0000","last_fullsized":"2024-09-11T06:19:27.125594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:06.311792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000767448,"stat_sum":{"num_bytes":57396400,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":2727,"num_read_kb":33148,"num_write":310,"num_write_kb":19611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.16","version":"159'414","reported_seq":2939,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.115167+0000","last_change":"2024-09-11T06:19:29.119373+0000","last_active":"2024-09-11T06:19:31.115167+0000","last_peered":"2024-09-11T06:19:31.115167+0000","last_clean":"2024-09-11T06:19:31.115167+0000","last_became_active":"2024-09-11T06:18:58.166467+0000","last_became_peered":"2024-09-11T06:18:58.166467+0000","last_unstale":"2024-09-11T06:19:31.115167+0000","last_undegraded":"2024-09-11T06:19:31.115167+0000","last_fullsized":"2024-09-11T06:19:31.115167+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:04:03.674213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019681759999999999,"stat_sum":{"num_bytes":49655923,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3518,"num_read_kb":26678,"num_write":576,"num_write_kb":25646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":319665,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.15","version":"156'260","reported_seq":3371,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.415651+0000","last_change":"2024-09-11T06:19:26.125232+0000","last_active":"2024-09-11T06:19:27.415651+0000","last_peered":"2024-09-11T06:19:27.415651+0000","last_clean":"2024-09-11T06:19:27.415651+0000","last_became_active":"2024-09-11T06:19:24.118147+0000","last_became_peered":"2024-09-11T06:19:24.118147+0000","last_unstale":"2024-09-11T06:19:27.415651+0000","last_undegraded":"2024-09-11T06:19:27.415651+0000","last_fullsized":"2024-09-11T06:19:27.415651+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:16.775070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037147999999999999,"stat_sum":{"num_bytes":67847860,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2575,"num_read_kb":33421,"num_write":367,"num_write_kb":32855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":12639011,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.14","version":"158'334","reported_seq":3775,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114500+0000","last_change":"2024-09-11T06:19:26.113551+0000","last_active":"2024-09-11T06:19:27.114500+0000","last_peered":"2024-09-11T06:19:27.114500+0000","last_clean":"2024-09-11T06:19:27.114500+0000","last_became_active":"2024-09-11T06:19:01.108590+0000","last_became_peered":"2024-09-11T06:19:01.108590+0000","last_unstale":"2024-09-11T06:19:27.114500+0000","last_undegraded":"2024-09-11T06:19:27.114500+0000","last_fullsized":"2024-09-11T06:19:27.114500+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:15.853710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071804900000000001,"stat_sum":{"num_bytes":61717734,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2954,"num_read_kb":59487,"num_write":349,"num_write_kb":36398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":100858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":293,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114786+0000","last_change":"2024-09-11T06:17:01.627923+0000","last_active":"2024-09-11T06:19:27.114786+0000","last_peered":"2024-09-11T06:19:27.114786+0000","last_clean":"2024-09-11T06:19:27.114786+0000","last_became_active":"2024-09-11T06:16:59.893359+0000","last_became_peered":"2024-09-11T06:16:59.893359+0000","last_unstale":"2024-09-11T06:19:27.114786+0000","last_undegraded":"2024-09-11T06:19:27.114786+0000","last_fullsized":"2024-09-11T06:19:27.114786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:46.350975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012648659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"148'204","reported_seq":4235,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114113+0000","last_change":"2024-09-11T06:19:26.116985+0000","last_active":"2024-09-11T06:19:27.114113+0000","last_peered":"2024-09-11T06:19:27.114113+0000","last_clean":"2024-09-11T06:19:27.114113+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:19:27.114113+0000","last_undegraded":"2024-09-11T06:19:27.114113+0000","last_fullsized":"2024-09-11T06:19:27.114113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:39:32.051347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00148073,"stat_sum":{"num_bytes":39517524,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3553,"num_read_kb":42025,"num_write":326,"num_write_kb":25777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":299,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.113872+0000","last_change":"2024-09-11T06:19:21.477260+0000","last_active":"2024-09-11T06:19:27.113872+0000","last_peered":"2024-09-11T06:19:27.113872+0000","last_clean":"2024-09-11T06:19:27.113872+0000","last_became_active":"2024-09-11T06:19:21.476924+0000","last_became_peered":"2024-09-11T06:19:21.476924+0000","last_unstale":"2024-09-11T06:19:27.113872+0000","last_undegraded":"2024-09-11T06:19:27.113872+0000","last_fullsized":"2024-09-11T06:19:27.113872+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:59.530860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"155'272","reported_seq":2966,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.113965+0000","last_change":"2024-09-11T06:19:26.117183+0000","last_active":"2024-09-11T06:19:27.113965+0000","last_peered":"2024-09-11T06:19:27.113965+0000","last_clean":"2024-09-11T06:19:27.113965+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:19:27.113965+0000","last_undegraded":"2024-09-11T06:19:27.113965+0000","last_fullsized":"2024-09-11T06:19:27.113965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:42.975550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001499207,"stat_sum":{"num_bytes":25713098,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2868,"num_read_kb":27355,"num_write":351,"num_write_kb":20043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":293,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.115010+0000","last_change":"2024-09-11T06:17:01.627167+0000","last_active":"2024-09-11T06:19:27.115010+0000","last_peered":"2024-09-11T06:19:27.115010+0000","last_clean":"2024-09-11T06:19:27.115010+0000","last_became_active":"2024-09-11T06:16:59.618666+0000","last_became_peered":"2024-09-11T06:16:59.618666+0000","last_unstale":"2024-09-11T06:19:27.115010+0000","last_undegraded":"2024-09-11T06:19:27.115010+0000","last_fullsized":"2024-09-11T06:19:27.115010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:31.303441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051827899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"163'734","reported_seq":5505,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.407049+0000","last_change":"2024-09-11T06:19:29.121394+0000","last_active":"2024-09-11T06:19:31.407049+0000","last_peered":"2024-09-11T06:19:31.407049+0000","last_clean":"2024-09-11T06:19:31.407049+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:19:31.407049+0000","last_undegraded":"2024-09-11T06:19:31.407049+0000","last_fullsized":"2024-09-11T06:19:31.407049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:40:36.752751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001517334,"stat_sum":{"num_bytes":115895754,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":7084,"num_read_kb":55211,"num_write":1151,"num_write_kb":32130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":294,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.125564+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:19:27.125564+0000","last_peered":"2024-09-11T06:19:27.125564+0000","last_clean":"2024-09-11T06:19:27.125564+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:19:27.125564+0000","last_undegraded":"2024-09-11T06:19:27.125564+0000","last_fullsized":"2024-09-11T06:19:27.125564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"158'655","reported_seq":3602,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.115178+0000","last_change":"2024-09-11T06:19:29.119356+0000","last_active":"2024-09-11T06:19:31.115178+0000","last_peered":"2024-09-11T06:19:31.115178+0000","last_clean":"2024-09-11T06:19:31.115178+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:19:31.115178+0000","last_undegraded":"2024-09-11T06:19:31.115178+0000","last_fullsized":"2024-09-11T06:19:31.115178+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:47:03.062339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019509760000000001,"stat_sum":{"num_bytes":25568856,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":4955,"num_read_kb":26525,"num_write":875,"num_write_kb":14288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.3","version":"163'579","reported_seq":4828,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.121741+0000","last_change":"2024-09-11T06:19:29.121431+0000","last_active":"2024-09-11T06:19:31.121741+0000","last_peered":"2024-09-11T06:19:31.121741+0000","last_clean":"2024-09-11T06:19:31.121741+0000","last_became_active":"2024-09-11T06:19:11.115318+0000","last_became_peered":"2024-09-11T06:19:11.115318+0000","last_unstale":"2024-09-11T06:19:31.121741+0000","last_undegraded":"2024-09-11T06:19:31.121741+0000","last_fullsized":"2024-09-11T06:19:31.121741+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:16:22.416387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001699926,"stat_sum":{"num_bytes":62194470,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6256,"num_read_kb":31060,"num_write":704,"num_write_kb":25782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":12761178,"num_keys_recovered":55,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":295,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114335+0000","last_change":"2024-09-11T06:17:01.627260+0000","last_active":"2024-09-11T06:19:27.114335+0000","last_peered":"2024-09-11T06:19:27.114335+0000","last_clean":"2024-09-11T06:19:27.114335+0000","last_became_active":"2024-09-11T06:16:59.987084+0000","last_became_peered":"2024-09-11T06:16:59.987084+0000","last_unstale":"2024-09-11T06:19:27.114335+0000","last_undegraded":"2024-09-11T06:19:27.114335+0000","last_fullsized":"2024-09-11T06:19:27.114335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:17.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"158'480","reported_seq":5123,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.125541+0000","last_change":"2024-09-11T06:19:26.125687+0000","last_active":"2024-09-11T06:19:27.125541+0000","last_peered":"2024-09-11T06:19:27.125541+0000","last_clean":"2024-09-11T06:19:27.125541+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:19:27.125541+0000","last_undegraded":"2024-09-11T06:19:27.125541+0000","last_fullsized":"2024-09-11T06:19:27.125541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:29.149428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085066899999999997,"stat_sum":{"num_bytes":73155419,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4839,"num_read_kb":31358,"num_write":677,"num_write_kb":28871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":180,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.125413+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:19:27.125413+0000","last_peered":"2024-09-11T06:19:27.125413+0000","last_clean":"2024-09-11T06:19:27.125413+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:19:27.125413+0000","last_undegraded":"2024-09-11T06:19:27.125413+0000","last_fullsized":"2024-09-11T06:19:27.125413+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"163'716","reported_seq":3013,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.376373+0000","last_change":"2024-09-11T06:19:29.120312+0000","last_active":"2024-09-11T06:19:31.376373+0000","last_peered":"2024-09-11T06:19:31.376373+0000","last_clean":"2024-09-11T06:19:31.376373+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:19:31.376373+0000","last_undegraded":"2024-09-11T06:19:31.376373+0000","last_fullsized":"2024-09-11T06:19:31.376373+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:58.885738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000607282,"stat_sum":{"num_bytes":111229350,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":3153,"num_read_kb":22696,"num_write":933,"num_write_kb":23463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":293,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114041+0000","last_change":"2024-09-11T06:17:01.627586+0000","last_active":"2024-09-11T06:19:27.114041+0000","last_peered":"2024-09-11T06:19:27.114041+0000","last_clean":"2024-09-11T06:19:27.114041+0000","last_became_active":"2024-09-11T06:16:59.621830+0000","last_became_peered":"2024-09-11T06:16:59.621830+0000","last_unstale":"2024-09-11T06:19:27.114041+0000","last_undegraded":"2024-09-11T06:19:27.114041+0000","last_fullsized":"2024-09-11T06:19:27.114041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.694083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094219499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"159'349","reported_seq":3772,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.134727+0000","last_change":"2024-09-11T06:19:26.116732+0000","last_active":"2024-09-11T06:19:27.134727+0000","last_peered":"2024-09-11T06:19:27.134727+0000","last_clean":"2024-09-11T06:19:27.134727+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:19:27.134727+0000","last_undegraded":"2024-09-11T06:19:27.134727+0000","last_fullsized":"2024-09-11T06:19:27.134727+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:11.888711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013054539999999999,"stat_sum":{"num_bytes":44042893,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3859,"num_read_kb":23132,"num_write":500,"num_write_kb":20256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":301,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114664+0000","last_change":"2024-09-11T06:18:58.163978+0000","last_active":"2024-09-11T06:19:27.114664+0000","last_peered":"2024-09-11T06:19:27.114664+0000","last_clean":"2024-09-11T06:19:27.114664+0000","last_became_active":"2024-09-11T06:18:58.163649+0000","last_became_peered":"2024-09-11T06:18:58.163649+0000","last_unstale":"2024-09-11T06:19:27.114664+0000","last_undegraded":"2024-09-11T06:19:27.114664+0000","last_fullsized":"2024-09-11T06:19:27.114664+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:31.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088263899999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":315,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-11T06:19:32.145171+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:19:32.145171+0000","last_peered":"2024-09-11T06:19:32.145171+0000","last_clean":"2024-09-11T06:19:32.145171+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:19:32.145171+0000","last_undegraded":"2024-09-11T06:19:32.145171+0000","last_fullsized":"2024-09-11T06:19:32.145171+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"154'432","reported_seq":5232,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.113897+0000","last_change":"2024-09-11T06:19:26.115726+0000","last_active":"2024-09-11T06:19:27.113897+0000","last_peered":"2024-09-11T06:19:27.113897+0000","last_clean":"2024-09-11T06:19:27.113897+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:19:27.113897+0000","last_undegraded":"2024-09-11T06:19:27.113897+0000","last_fullsized":"2024-09-11T06:19:27.113897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:39:01.364811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037825899999999998,"stat_sum":{"num_bytes":31006453,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":6193,"num_read_kb":35336,"num_write":519,"num_write_kb":21040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.9","version":"158'270","reported_seq":4497,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114273+0000","last_change":"2024-09-11T06:19:26.114218+0000","last_active":"2024-09-11T06:19:27.114273+0000","last_peered":"2024-09-11T06:19:27.114273+0000","last_clean":"2024-09-11T06:19:27.114273+0000","last_became_active":"2024-09-11T06:17:09.683443+0000","last_became_peered":"2024-09-11T06:17:09.683443+0000","last_unstale":"2024-09-11T06:19:27.114273+0000","last_undegraded":"2024-09-11T06:19:27.114273+0000","last_fullsized":"2024-09-11T06:19:27.114273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:44.880366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012147849999999999,"stat_sum":{"num_bytes":84911635,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":3996,"num_read_kb":40152,"num_write":454,"num_write_kb":26119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.a","version":"148'202","reported_seq":3718,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114235+0000","last_change":"2024-09-11T06:19:26.113855+0000","last_active":"2024-09-11T06:19:27.114235+0000","last_peered":"2024-09-11T06:19:27.114235+0000","last_clean":"2024-09-11T06:19:27.114235+0000","last_became_active":"2024-09-11T06:18:19.333935+0000","last_became_peered":"2024-09-11T06:18:19.333935+0000","last_unstale":"2024-09-11T06:19:27.114235+0000","last_undegraded":"2024-09-11T06:19:27.114235+0000","last_fullsized":"2024-09-11T06:19:27.114235+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:58:39.095974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099916200000000005,"stat_sum":{"num_bytes":38350575,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3241,"num_read_kb":32614,"num_write":285,"num_write_kb":18415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":9995151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.b","version":"161'480","reported_seq":2815,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.121716+0000","last_change":"2024-09-11T06:19:29.120651+0000","last_active":"2024-09-11T06:19:31.121716+0000","last_peered":"2024-09-11T06:19:31.121716+0000","last_clean":"2024-09-11T06:19:31.121716+0000","last_became_active":"2024-09-11T06:18:01.255735+0000","last_became_peered":"2024-09-11T06:18:01.255735+0000","last_unstale":"2024-09-11T06:19:31.121716+0000","last_undegraded":"2024-09-11T06:19:31.121716+0000","last_fullsized":"2024-09-11T06:19:31.121716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:58.044335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084988900000000005,"stat_sum":{"num_bytes":31436500,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2940,"num_read_kb":14865,"num_write":803,"num_write_kb":24027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.c","version":"158'504","reported_seq":2550,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.415694+0000","last_change":"2024-09-11T06:19:26.125085+0000","last_active":"2024-09-11T06:19:27.415694+0000","last_peered":"2024-09-11T06:19:27.415694+0000","last_clean":"2024-09-11T06:19:27.415694+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:19:27.415694+0000","last_undegraded":"2024-09-11T06:19:27.415694+0000","last_fullsized":"2024-09-11T06:19:27.415694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:26.492923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045239199999999997,"stat_sum":{"num_bytes":35047748,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3013,"num_read_kb":15228,"num_write":716,"num_write_kb":13181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.d","version":"159'434","reported_seq":2570,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.149850+0000","last_change":"2024-09-11T06:19:26.114247+0000","last_active":"2024-09-11T06:19:27.149850+0000","last_peered":"2024-09-11T06:19:27.149850+0000","last_clean":"2024-09-11T06:19:27.149850+0000","last_became_active":"2024-09-11T06:18:19.334462+0000","last_became_peered":"2024-09-11T06:18:19.334462+0000","last_unstale":"2024-09-11T06:19:27.149850+0000","last_undegraded":"2024-09-11T06:19:27.149850+0000","last_fullsized":"2024-09-11T06:19:27.149850+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:21.457425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010605829999999999,"stat_sum":{"num_bytes":24533352,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2800,"num_read_kb":27959,"num_write":749,"num_write_kb":19276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":7078861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.e","version":"162'520","reported_seq":3753,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.115274+0000","last_change":"2024-09-11T06:19:29.119693+0000","last_active":"2024-09-11T06:19:31.115274+0000","last_peered":"2024-09-11T06:19:31.115274+0000","last_clean":"2024-09-11T06:19:31.115274+0000","last_became_active":"2024-09-11T06:19:23.118414+0000","last_became_peered":"2024-09-11T06:19:23.118414+0000","last_unstale":"2024-09-11T06:19:31.115274+0000","last_undegraded":"2024-09-11T06:19:31.115274+0000","last_fullsized":"2024-09-11T06:19:31.115274+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:53.116523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026956520000000002,"stat_sum":{"num_bytes":66705744,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":3891,"num_read_kb":39306,"num_write":657,"num_write_kb":24802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":15420316,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.f","version":"161'365","reported_seq":3965,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.115210+0000","last_change":"2024-09-11T06:19:29.118788+0000","last_active":"2024-09-11T06:19:31.115210+0000","last_peered":"2024-09-11T06:19:31.115210+0000","last_clean":"2024-09-11T06:19:31.115210+0000","last_became_active":"2024-09-11T06:18:58.166147+0000","last_became_peered":"2024-09-11T06:18:58.166147+0000","last_unstale":"2024-09-11T06:19:31.115210+0000","last_undegraded":"2024-09-11T06:19:31.115210+0000","last_fullsized":"2024-09-11T06:19:31.115210+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:50:57.113324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018559780000000001,"stat_sum":{"num_bytes":48527609,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3905,"num_read_kb":29256,"num_write":452,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1241504,"num_keys_recovered":9,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.10","version":"163'317","reported_seq":2672,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-11T06:19:32.145255+0000","last_change":"2024-09-11T06:19:29.119764+0000","last_active":"2024-09-11T06:19:32.145255+0000","last_peered":"2024-09-11T06:19:32.145255+0000","last_clean":"2024-09-11T06:19:32.145255+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:19:32.145255+0000","last_undegraded":"2024-09-11T06:19:32.145255+0000","last_fullsized":"2024-09-11T06:19:32.145255+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:20.293759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036917599999999998,"stat_sum":{"num_bytes":66164270,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3847,"num_read_kb":38736,"num_write":360,"num_write_kb":27003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.11","version":"148'322","reported_seq":3163,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114121+0000","last_change":"2024-09-11T06:19:26.113211+0000","last_active":"2024-09-11T06:19:27.114121+0000","last_peered":"2024-09-11T06:19:27.114121+0000","last_clean":"2024-09-11T06:19:27.114121+0000","last_became_active":"2024-09-11T06:18:58.166199+0000","last_became_peered":"2024-09-11T06:18:58.166199+0000","last_unstale":"2024-09-11T06:19:27.114121+0000","last_undegraded":"2024-09-11T06:19:27.114121+0000","last_fullsized":"2024-09-11T06:19:27.114121+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:03.732807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045410300000000003,"stat_sum":{"num_bytes":36356218,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3034,"num_read_kb":41244,"num_write":395,"num_write_kb":24271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]},{"pgid":"3.12","version":"163'202","reported_seq":2286,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-11T06:19:31.356356+0000","last_change":"2024-09-11T06:19:29.120349+0000","last_active":"2024-09-11T06:19:31.356356+0000","last_peered":"2024-09-11T06:19:31.356356+0000","last_clean":"2024-09-11T06:19:31.356356+0000","last_became_active":"2024-09-11T06:17:37.166037+0000","last_became_peered":"2024-09-11T06:17:37.166037+0000","last_unstale":"2024-09-11T06:19:31.356356+0000","last_undegraded":"2024-09-11T06:19:31.356356+0000","last_fullsized":"2024-09-11T06:19:31.356356+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:37.078623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060150799999999995,"stat_sum":{"num_bytes":37183220,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":1508,"num_read_kb":21168,"num_write":308,"num_write_kb":18790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":771314,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"46","length":"1"},{"start":"48","length":"1"}]},{"pgid":"3.13","version":"155'325","reported_seq":3317,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-11T06:19:27.114576+0000","last_change":"2024-09-11T06:19:26.114514+0000","last_active":"2024-09-11T06:19:27.114576+0000","last_peered":"2024-09-11T06:19:27.114576+0000","last_clean":"2024-09-11T06:19:27.114576+0000","last_became_active":"2024-09-11T06:17:09.684244+0000","last_became_peered":"2024-09-11T06:17:09.684244+0000","last_unstale":"2024-09-11T06:19:27.114576+0000","last_undegraded":"2024-09-11T06:19:27.114576+0000","last_fullsized":"2024-09-11T06:19:27.114576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:55:08.468630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001159764,"stat_sum":{"num_bytes":43280402,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2941,"num_read_kb":32862,"num_write":479,"num_write_kb":23734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"44","length":"1"},{"start":"46","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1718528918,"num_objects":993,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":993,"num_whiteouts":0,"num_read":139352,"num_read_kb":1090116,"num_write":19503,"num_write_kb":735372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":593,"num_bytes_recovered":117172054,"num_keys_recovered":279,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83165184,"data_stored":710722887,"data_compressed":20938663,"data_compressed_allocated":63217664,"data_compressed_original":694870871,"omap_allocated":25754,"internal_metadata":0},"log_size":13689,"ondisk_log_size":13689,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59648,"kb_used_data":14504,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94312192,"statfs":{"total":96636764160,"available":96575684608,"internally_reserved":0,"allocated":14852096,"data_stored":109503089,"data_compressed":3412902,"data_compressed_allocated":9895936,"data_compressed_original":106154148,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49660,"kb_used_data":10144,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322180,"statfs":{"total":96636764160,"available":96585912320,"internally_reserved":0,"allocated":10387456,"data_stored":77962596,"data_compressed":2063807,"data_compressed_allocated":6680576,"data_compressed_original":75619640,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51736,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94320104,"statfs":{"total":96636764160,"available":96583786496,"internally_reserved":0,"allocated":21037056,"data_stored":170384209,"data_compressed":5214937,"data_compressed_allocated":15200256,"data_compressed_original":166298493,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748488,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46972,"kb_used_data":13744,"kb_used_omap":18,"kb_used_meta":33133,"kb_avail":94324868,"statfs":{"total":96636764160,"available":96588664832,"internally_reserved":0,"allocated":14073856,"data_stored":106786039,"data_compressed":3177906,"data_compressed_allocated":9396224,"data_compressed_original":103695006,"omap_allocated":18586,"internal_metadata":33929062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991248,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46800,"kb_used_data":9912,"kb_used_omap":10,"kb_used_meta":36853,"kb_avail":94325040,"statfs":{"total":96636764160,"available":96588840960,"internally_reserved":0,"allocated":10149888,"data_stored":73160686,"data_compressed":2163930,"data_compressed_allocated":6447104,"data_compressed_original":70821443,"omap_allocated":10357,"internal_metadata":37738379},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57100,"kb_used_data":7864,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94314740,"statfs":{"total":96636764160,"available":96578293760,"internally_reserved":0,"allocated":8052736,"data_stored":54763271,"data_compressed":1240166,"data_compressed_allocated":4456448,"data_compressed_original":52487117,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60272,"kb_used_data":11040,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311568,"statfs":{"total":96636764160,"available":96575045632,"internally_reserved":0,"allocated":11304960,"data_stored":73358045,"data_compressed":2227636,"data_compressed_allocated":6557696,"data_compressed_original":70120095,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48012,"kb_used_data":8500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323828,"statfs":{"total":96636764160,"available":96587599872,"internally_reserved":0,"allocated":8704000,"data_stored":53395889,"data_compressed":1454301,"data_compressed_allocated":4648960,"data_compressed_original":50752177,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":53836109,"data_compressed":1240166,"data_compressed_allocated":4456448,"data_compressed_original":52487117,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8138752,"data_stored":71611984,"data_compressed":2155261,"data_compressed_allocated":6410240,"data_compressed_original":70248003,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12177408,"data_stored":105876536,"data_compressed":3177906,"data_compressed_allocated":9396224,"data_compressed_original":103695006,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19148800,"data_stored":169492380,"data_compressed":5215137,"data_compressed_allocated":15204352,"data_compressed_original":166339453,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":77029086,"data_compressed":2063807,"data_compressed_allocated":6680576,"data_compressed_original":75619640,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12931072,"data_stored":108050641,"data_compressed":3404580,"data_compressed_allocated":9867264,"data_compressed_original":105633956,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9338880,"data_stored":72370141,"data_compressed":2227505,"data_compressed_allocated":6553600,"data_compressed_original":70095519,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6787072,"data_stored":52456010,"data_compressed":1454301,"data_compressed_allocated":4648960,"data_compressed_original":50752177,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:19:32.965 INFO:tasks.thrashosds.thrasher:Setting 3.b to [7, 4, 6, 2] 2024-09-11T06:19:32.965 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.b', '7', '4', '6', '2'] 2024-09-11T06:19:32.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.b 7 4 6 2 2024-09-11T06:19:33.009 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:33.008+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:33.020 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:33.020 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:33.021 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:33.021 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:33.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:33.107 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:33.106+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:33.123 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:19:33.138 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:33.138 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:33.149 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:33.208 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:33.207+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:33.258 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124090 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2588672~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.863051171999999, 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038606527000000002, 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.259 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124090 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3699999999999999e-07 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393921+0000", 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-06 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393924+0000", 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9809999999999999e-06 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393927+0000", 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.441e-06 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432404+0000", 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038477645999999997 2024-09-11T06:19:33.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432457+0000", 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2266999999999999e-05 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432526+0000", 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9871999999999998e-05 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124091 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.863041705000001, 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038834586999999997, 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124091 2024-09-11T06:19:33.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393930+0000", 2024-09-11T06:19:33.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393931+0000", 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393934+0000", 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.055e-06 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393936+0000", 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432564+0000", 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038628026000000003 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432650+0000", 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5545999999999997e-05 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432764+0000", 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011411199999999999 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124092 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.863032224000001, 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039050738000000002, 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.268 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124092 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393940+0000", 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0699999999999999e-06 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393943+0000", 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393945+0000", 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.356e-06 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432796+0000", 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038850253000000001 2024-09-11T06:19:33.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432883+0000", 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7287999999999995e-05 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432990+0000", 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106586 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124093 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.863022650000001, 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039266809999999999, 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124093 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393949+0000", 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4600000000000001e-07 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393950+0000", 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.105e-06 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393953+0000", 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.959e-06 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393955+0000", 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.605e-06 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433033+0000", 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039077685000000001 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433095+0000", 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2451000000000002e-05 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433215+0000", 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119759 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.276 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124094 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2621440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.863012959999999, 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039472198, 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.277 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124094 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5499999999999999e-07 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393964+0000", 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3510000000000001e-06 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393969+0000", 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6080000000000003e-06 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393974+0000", 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5560000000000001e-06 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433238+0000", 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039264518999999998 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433322+0000", 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3805000000000001e-05 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433430+0000", 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010810399999999999 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124095 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2629632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862991001000001, 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039657393999999999, 2024-09-11T06:19:33.281 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124095 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393981+0000", 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393983+0000", 2024-09-11T06:19:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393988+0000", 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393992+0000", 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0679999999999998e-06 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433471+0000", 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039478924999999998 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433531+0000", 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9883000000000002e-05 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433637+0000", 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106449 2024-09-11T06:19:33.285 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124096 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2637824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862973739000001, 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039912982999999999, 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124096 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393998+0000", 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393999+0000", 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.764e-06 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394004+0000", 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394008+0000", 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.092e-06 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433714+0000", 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039705419999999998 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433804+0000", 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0447999999999999e-05 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433910+0000", 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010616999999999999 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124097 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2646016~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.290 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862956104999999, 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040088436999999998, 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124097 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:33.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394017+0000", 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394023+0000", 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9449999999999998e-06 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394028+0000", 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433952+0000", 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039924460000000002 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434009+0000", 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6860000000000001e-05 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434103+0000", 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4455000000000003e-05 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124098 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862938235000001, 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040258124999999999, 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124098 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:33.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394035+0000", 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6780000000000001e-06 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394040+0000", 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1540000000000001e-06 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394044+0000", 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2189999999999998e-06 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434130+0000", 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040085549999999998 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434208+0000", 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7865000000000001e-05 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434291+0000", 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3347e-05 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124099 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.299 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862921866000001, 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040461951000000003, 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124099 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394050+0000", 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.89e-07 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394052+0000", 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394057+0000", 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7529999999999998e-06 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394063+0000", 2024-09-11T06:19:33.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434323+0000", 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040260038999999997 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434378+0000", 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5631999999999999e-05 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434511+0000", 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013283699999999999 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124100 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862888891000001, 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040582739999999999, 2024-09-11T06:19:33.304 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124100 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394083+0000", 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394087+0000", 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000004e-06 2024-09-11T06:19:33.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394093+0000", 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394098+0000", 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9860000000000002e-06 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434548+0000", 2024-09-11T06:19:33.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040450016999999998 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434595+0000", 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6255999999999999e-05 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434665+0000", 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0338000000000003e-05 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.308 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124101 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862865993, 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040783649999999998, 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.309 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124101 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394107+0000", 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394113+0000", 2024-09-11T06:19:33.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8440000000000003e-06 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394117+0000", 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.335e-06 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434695+0000", 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040577692999999998 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434783+0000", 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7538000000000001e-05 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434889+0000", 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105989 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124102 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:33.313 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862847725000002, 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040992853000000003, 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124102 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394124+0000", 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394126+0000", 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394131+0000", 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6879999999999996e-06 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394136+0000", 2024-09-11T06:19:33.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5430000000000004e-06 2024-09-11T06:19:33.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434919+0000", 2024-09-11T06:19:33.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040782773000000001 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435005+0000", 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6594000000000005e-05 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435116+0000", 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110776 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124103 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862829327, 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041211651000000002, 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.321 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124103 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394144+0000", 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7689999999999999e-06 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394150+0000", 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6699999999999999e-06 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394154+0000", 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435146+0000", 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040991684 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435239+0000", 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3428000000000001e-05 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435353+0000", 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114219 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.325 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124104 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862811214000001, 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041465574999999998, 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.326 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124104 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.327 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394162+0000", 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.776e-06 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394168+0000", 2024-09-11T06:19:33.328 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7080000000000002e-06 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394172+0000", 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5059999999999997e-06 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435385+0000", 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041212998000000001 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.329 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435477+0000", 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1528999999999997e-05 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435625+0000", 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148677 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124105 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.330 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862793336999999, 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041619452000000001, 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124105 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.331 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:33.332 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394180+0000", 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0930000000000001e-06 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394186+0000", 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5389999999999998e-06 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.333 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394191+0000", 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7039999999999999e-06 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435663+0000", 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041471806 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435721+0000", 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7655999999999998e-05 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.334 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435797+0000", 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6247000000000004e-05 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124106 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862769545999999, 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041713447000000001, 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.335 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124106 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394204+0000", 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394210+0000", 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2269999999999998e-06 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394215+0000", 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435816+0000", 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041600683999999999 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435858+0000", 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2518999999999997e-05 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435915+0000", 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6514000000000001e-05 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.339 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124107 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862749777000001, 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041835280000000002, 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124107 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.340 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394222+0000", 2024-09-11T06:19:33.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394223+0000", 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.793e-06 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394229+0000", 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394233+0000", 2024-09-11T06:19:33.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435931+0000", 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041697761 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435972+0000", 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0806000000000002e-05 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436057+0000", 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4602000000000001e-05 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124108 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862732055999999, 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042155791999999997, 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.344 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124108 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394241+0000", 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0109999999999999e-06 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.346 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394247+0000", 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8810000000000001e-06 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394252+0000", 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436174+0000", 2024-09-11T06:19:33.347 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041922012000000002 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436274+0000", 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100054 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436395+0000", 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012093499999999999 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124109 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 28.862713565, 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042294403000000001, 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124109 2024-09-11T06:19:33.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394258+0000", 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394269+0000", 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0974e-05 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394275+0000", 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3450000000000002e-06 2024-09-11T06:19:33.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394280+0000", 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.826e-06 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436426+0000", 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042146175000000001 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436472+0000", 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:19:33.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436552+0000", 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0075999999999997e-05 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.353 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:33.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:33.355 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:33.354+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:33.455 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:33.455+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:33.498 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:33.498 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:33.498 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:33.499 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:33.507 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:33.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:33.591+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:33.650 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:33.651 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:33.651 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:33.651 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:33.651 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:33.657 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:33.656+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:33.659 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:33.758 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:33.758+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:33.803 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.458730936999999, 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:19:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:19:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:19:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.354806751000002, 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:19:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.354780400999999, 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.816 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:19:33.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.354759920999999, 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:19:33.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:33.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.354741207, 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.827 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:33.832 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.346010372999999, 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:19:33.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345976789000002, 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.838 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:19:33.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:19:33.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.843 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345963959999999, 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.844 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:19:33.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:19:33.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345953822999999, 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.849 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:19:33.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.854 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345943004999999, 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:19:33.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:33.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345933124999998, 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:19:33.860 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:33.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:19:33.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.865 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345923394, 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.866 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:19:33.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:19:33.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345913776, 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.871 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:19:33.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.876 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345903962000001, 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.877 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:19:33.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:19:33.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345888595000002, 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:19:33.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:19:33.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:33.887 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.345878292999998, 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:19:33.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.34417801, 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.893 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.338033011, 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.899 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:19:33.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:19:33.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:33.904 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.338023515, 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:19:33.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:19:33.909 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.338013956000001, 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:33.910 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:33.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:33.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:33.915 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:33.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:33.917 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:33.916+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:33.918 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:34.018 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:34.017+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:34.037 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:34.037 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:34.054 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:34.054 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:34.062 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:34.062 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:34.070 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:34.070 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:34.071 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:34.086 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:34.086 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:34.102 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:34.118 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:34.118+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:34.120 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:34.120 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:34.131 INFO:teuthology.orchestra.run.smithi070.stderr:set 3.b pg_upmap_items mapping to [7->4,6->2] 2024-09-11T06:19:34.142 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:34.142 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:34.159 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:34.159 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:34.177 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:34.177 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:34.186 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:34.229 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:34.229+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:34.231 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-11T06:19:34.293 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:34.293 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:34.301 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:34.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:34.342+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:34.421 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:34.420+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:34.445 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:34.445 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:34.454 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:34.521 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:34.521+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:34.556 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:34.556 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:34.564 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:34.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:34.621+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:34.667 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:34.667 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:34.676 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:34.723 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:34.722+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:34.781 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:34.781 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:34.789 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:34.824 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:34.823+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:34.925 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:34.924+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:34.932 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:34.932 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:34.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:35.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:35.025+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:35.044 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:35.044 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:35.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:35.126 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:35.126+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:35.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:19:35.160 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:35.160 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:35.169 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:35.254 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:35.253+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:35.315 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:35.315 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:35.324 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:35.365 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:35.364+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:35.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:35.428+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:35.468 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:35.469 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:35.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:35.530 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:35.529+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:35.581 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:35.581 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:35.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:35.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:35.630+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:35.691 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:35.692 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:35.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:35.744 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:35.743+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:35.803 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:35.803 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:35.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:35.832 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:35.831+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:35.933 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:35.933+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:35.954 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:35.954 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:35.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:36.035 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:36.034+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:36.064 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:36.065 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:36.073 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:36.113 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:19:36.168 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:36.167+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:36.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:36.179 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:36.180 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:36.189 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:36.236 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:36.235+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:36.291 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:36.292 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:36.305 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:36.305 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:36.308 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:36.314 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:36.324 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:36.324 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:36.339 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:36.339 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:36.355 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:36.358 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:36.358+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:36.371 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:36.388 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:36.388 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:36.404 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:36.404 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:36.423 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:36.423 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:36.423 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:36.423 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:36.423 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:36.432 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:36.473 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:36.472+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:36.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:36.538+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:36.576 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:36.576 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:36.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:36.576 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:36.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.576 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124090 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2588672~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180667931999999, 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038606527000000002, 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124090 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.577 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393920+0000", 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3699999999999999e-07 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393921+0000", 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.083e-06 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393924+0000", 2024-09-11T06:19:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9809999999999999e-06 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393927+0000", 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.441e-06 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432404+0000", 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038477645999999997 2024-09-11T06:19:36.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432457+0000", 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2266999999999999e-05 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432526+0000", 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9871999999999998e-05 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.581 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124091 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180658465, 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038834586999999997, 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.582 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124091 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393930+0000", 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393931+0000", 2024-09-11T06:19:36.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393934+0000", 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.055e-06 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393936+0000", 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:19:36.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432564+0000", 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038628026000000003 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432650+0000", 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5545999999999997e-05 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432764+0000", 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011411199999999999 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124092 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:36.587 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180648984000001, 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039050738000000002, 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124092 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:36.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393940+0000", 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0699999999999999e-06 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393943+0000", 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393945+0000", 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.356e-06 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432796+0000", 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038850253000000001 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432883+0000", 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7287999999999995e-05 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432990+0000", 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106586 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.592 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124093 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180639409999998, 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039266809999999999, 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124093 2024-09-11T06:19:36.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393949+0000", 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4600000000000001e-07 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393950+0000", 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.105e-06 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393953+0000", 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.959e-06 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393955+0000", 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.605e-06 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433033+0000", 2024-09-11T06:19:36.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039077685000000001 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433095+0000", 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2451000000000002e-05 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433215+0000", 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119759 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.597 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124094 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2621440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180629719999999, 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039472198, 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.598 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124094 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5499999999999999e-07 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393964+0000", 2024-09-11T06:19:36.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3510000000000001e-06 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393969+0000", 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6080000000000003e-06 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393974+0000", 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5560000000000001e-06 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433238+0000", 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039264518999999998 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433322+0000", 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3805000000000001e-05 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433430+0000", 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010810399999999999 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124095 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2629632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:36.603 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180607760999997, 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039657393999999999, 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124095 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393981+0000", 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393983+0000", 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393988+0000", 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393992+0000", 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0679999999999998e-06 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433471+0000", 2024-09-11T06:19:36.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039478924999999998 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433531+0000", 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9883000000000002e-05 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433637+0000", 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106449 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.608 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124096 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2637824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180590498999997, 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039912982999999999, 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124096 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393998+0000", 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393999+0000", 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.764e-06 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394004+0000", 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394008+0000", 2024-09-11T06:19:36.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.092e-06 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433714+0000", 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039705419999999998 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433804+0000", 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0447999999999999e-05 2024-09-11T06:19:36.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433910+0000", 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010616999999999999 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124097 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2646016~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.614 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180572865000002, 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040088436999999998, 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124097 2024-09-11T06:19:36.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394017+0000", 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394023+0000", 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9449999999999998e-06 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394028+0000", 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433952+0000", 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039924460000000002 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434009+0000", 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6860000000000001e-05 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434103+0000", 2024-09-11T06:19:36.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4455000000000003e-05 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124098 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180554995000001, 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040258124999999999, 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.620 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124098 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394035+0000", 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6780000000000001e-06 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394040+0000", 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1540000000000001e-06 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394044+0000", 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2189999999999998e-06 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434130+0000", 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040085549999999998 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434208+0000", 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7865000000000001e-05 2024-09-11T06:19:36.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434291+0000", 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3347e-05 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124099 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:36.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180538626000001, 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040461951000000003, 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124099 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394050+0000", 2024-09-11T06:19:36.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.89e-07 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394052+0000", 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394057+0000", 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7529999999999998e-06 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394063+0000", 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434323+0000", 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040260038999999997 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434378+0000", 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5631999999999999e-05 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434511+0000", 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013283699999999999 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.630 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124100 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180505650999997, 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040582739999999999, 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124100 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.631 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394083+0000", 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394087+0000", 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000004e-06 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394093+0000", 2024-09-11T06:19:36.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394098+0000", 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9860000000000002e-06 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434548+0000", 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040450016999999998 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434595+0000", 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6255999999999999e-05 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434665+0000", 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0338000000000003e-05 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124101 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180482753, 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040783649999999998, 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124101 2024-09-11T06:19:36.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394107+0000", 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394113+0000", 2024-09-11T06:19:36.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8440000000000003e-06 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394117+0000", 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.335e-06 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434695+0000", 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040577692999999998 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434783+0000", 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7538000000000001e-05 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434889+0000", 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105989 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124102 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180464485000002, 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040992853000000003, 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124102 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394124+0000", 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394126+0000", 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394131+0000", 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6879999999999996e-06 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394136+0000", 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5430000000000004e-06 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434919+0000", 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040782773000000001 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435005+0000", 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6594000000000005e-05 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435116+0000", 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110776 2024-09-11T06:19:36.645 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124103 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180446087, 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041211651000000002, 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.646 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124103 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394144+0000", 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7689999999999999e-06 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394150+0000", 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6699999999999999e-06 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394154+0000", 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:19:36.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435146+0000", 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040991684 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435239+0000", 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3428000000000001e-05 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435353+0000", 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114219 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124104 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:36.651 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180427973999997, 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041465574999999998, 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124104 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:36.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394162+0000", 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.776e-06 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394168+0000", 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7080000000000002e-06 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394172+0000", 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5059999999999997e-06 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435385+0000", 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041212998000000001 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435477+0000", 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1528999999999997e-05 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435625+0000", 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148677 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124105 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.656 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180410096999999, 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041619452000000001, 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124105 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394180+0000", 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0930000000000001e-06 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394186+0000", 2024-09-11T06:19:36.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5389999999999998e-06 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394191+0000", 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7039999999999999e-06 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435663+0000", 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041471806 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435721+0000", 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7655999999999998e-05 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435797+0000", 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6247000000000004e-05 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124106 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180386306000003, 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041713447000000001, 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124106 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:36.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394204+0000", 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394210+0000", 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2269999999999998e-06 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394215+0000", 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435816+0000", 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041600683999999999 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435858+0000", 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2518999999999997e-05 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435915+0000", 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6514000000000001e-05 2024-09-11T06:19:36.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124107 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180366536999998, 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041835280000000002, 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124107 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394222+0000", 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394223+0000", 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.793e-06 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394229+0000", 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394233+0000", 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:36.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435931+0000", 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041697761 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435972+0000", 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0806000000000002e-05 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436057+0000", 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4602000000000001e-05 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124108 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180348815999999, 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042155791999999997, 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124108 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394241+0000", 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0109999999999999e-06 2024-09-11T06:19:36.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394247+0000", 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8810000000000001e-06 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394252+0000", 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436174+0000", 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041922012000000002 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436274+0000", 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100054 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436395+0000", 2024-09-11T06:19:36.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012093499999999999 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124109 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.180330325, 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042294403000000001, 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:36.677 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124109 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:36.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394258+0000", 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394269+0000", 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0974e-05 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394275+0000", 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3450000000000002e-06 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394280+0000", 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.826e-06 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436426+0000", 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042146175000000001 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:36.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436472+0000", 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436552+0000", 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0075999999999997e-05 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:36.682 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:36.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:36.684 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:36.683+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:36.784 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:36.784+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:36.826 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:36.826 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:36.826 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:36.826 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:36.834 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:36.885 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:36.884+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:36.937 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:36.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:36.938 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:36.938 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:36.938 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:36.947 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:36.990 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:36.990+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 77.728035757000001, 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:19:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:19:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:19:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.624111571, 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.080 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:19:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.084 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.624085221000001, 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.085 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:19:37.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.624064740999998, 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.090 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:19:37.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.094 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.624046026999999, 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:19:37.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:19:37.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.099 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615315193000001, 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:19:37.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:19:37.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615281609, 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.105 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:19:37.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.109 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615268780000001, 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.110 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:19:37.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615258642999997, 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:19:37.115 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:19:37.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615247824999997, 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.121 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:37.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615237944999997, 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:19:37.126 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:37.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:19:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:37.132 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615228213999998, 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:19:37.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:19:37.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.137 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615218595999998, 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:37.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:19:37.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615208782000003, 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:19:37.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:37.149 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615193415, 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.150 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:19:37.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:19:37.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.154 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.615183113000001, 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.155 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:37.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.613482830000002, 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:37.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:19:37.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:19:37.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:19:37.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.165 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.607337831000002, 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.166 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:37.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:37.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:19:37.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.171 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.607328334999998, 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:37.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:19:37.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 32.607318776, 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.177 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:37.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:37.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:19:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.182 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:37.184 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.184 INFO:teuthology.orchestra.run.smithi070.stdout:5300 writesame 0x2bbc8e thru 0x2cba23 data_size 0x7(0xfd96 bytes) 2024-09-11T06:19:37.184 INFO:teuthology.orchestra.run.smithi070.stdout:5301 trunc from 0x837a848 to 0x9be93c 2024-09-11T06:19:37.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:37.185 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:37.183+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:37.186 INFO:teuthology.orchestra.run.smithi070.stdout:5304 read 0x8cb751 thru 0x8ce827 (0x30d7 bytes) 2024-09-11T06:19:37.186 INFO:teuthology.orchestra.run.smithi070.stdout:5305 read 0x3ac681 thru 0x3bb98e (0xf30e bytes) 2024-09-11T06:19:37.195 INFO:teuthology.orchestra.run.smithi070.stdout:5307 write 0x300537a thru 0x300de35 (0x8abc bytes) 2024-09-11T06:19:37.197 INFO:teuthology.orchestra.run.smithi070.stdout:5308 read 0x27541a9 thru 0x2759618 (0x5470 bytes) 2024-09-11T06:19:37.208 INFO:teuthology.orchestra.run.smithi070.stdout:5309 write 0x7398be8 thru 0x73a5592 (0xc9ab bytes) 2024-09-11T06:19:37.212 INFO:teuthology.orchestra.run.smithi070.stdout:5311 punch from 0x3d30a75 to 0x3d3ef9f, (0xe52a bytes) 2024-09-11T06:19:37.212 INFO:teuthology.orchestra.run.smithi070.stdout:5312 read 0x1f79b41 thru 0x1f81aaa (0x7f6a bytes) 2024-09-11T06:19:37.212 INFO:teuthology.orchestra.run.smithi070.stdout:5313 punch from 0x2c36ffb to 0x2c40190, (0x9195 bytes) 2024-09-11T06:19:37.212 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.212 INFO:teuthology.orchestra.run.smithi070.stdout:5316 read 0x49b7d14 thru 0x49c24f6 (0xa7e3 bytes) 2024-09-11T06:19:37.220 INFO:teuthology.orchestra.run.smithi070.stdout:5317 trunc from 0x73a5593 to 0x9c5e8 2024-09-11T06:19:37.236 INFO:teuthology.orchestra.run.smithi070.stdout:5318 read 0x534c2 thru 0x5b893 (0x83d2 bytes) 2024-09-11T06:19:37.242 INFO:teuthology.orchestra.run.smithi070.stdout:5319 trunc from 0x9c5e8 to 0x52e51b7 2024-09-11T06:19:37.258 INFO:teuthology.orchestra.run.smithi070.stdout:5320 writesame 0x95cd4f3 thru 0x95cd5ed data_size 0x1(0xfb bytes) 2024-09-11T06:19:37.259 INFO:teuthology.orchestra.run.smithi070.stdout:5322 writesame 0x54e28c2 thru 0x54e386c data_size 0x7(0xfab bytes) 2024-09-11T06:19:37.261 INFO:teuthology.orchestra.run.smithi070.stdout:5323 write 0x949c3c2 thru 0x949e61c (0x225b bytes) 2024-09-11T06:19:37.265 INFO:teuthology.orchestra.run.smithi070.stdout:5324 read 0x7c8ff79 thru 0x7c9efa7 (0xf02f bytes) 2024-09-11T06:19:37.265 INFO:teuthology.orchestra.run.smithi070.stdout:5325 read 0x1426a3f thru 0x1429c1b (0x31dd bytes) 2024-09-11T06:19:37.270 INFO:teuthology.orchestra.run.smithi070.stdout:5329 write 0x9f5e182 thru 0x9f67bd4 (0x9a53 bytes) 2024-09-11T06:19:37.273 INFO:teuthology.orchestra.run.smithi070.stdout:5331 write 0x5b4376 thru 0x5bdf93 (0x9c1e bytes) 2024-09-11T06:19:37.276 INFO:teuthology.orchestra.run.smithi070.stdout:5332 writesame 0x8f76607 thru 0x8f7a61c data_size 0xd(0x4016 bytes) 2024-09-11T06:19:37.279 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.279 INFO:teuthology.orchestra.run.smithi070.stdout:5334 writesame 0x72e59c2 thru 0x72f44d3 data_size 0x1(0xeb12 bytes) 2024-09-11T06:19:37.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:37.284+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:37.305 INFO:teuthology.orchestra.run.smithi070.stdout:5336 trunc from 0x9f67bd5 to 0x92371e3 2024-09-11T06:19:37.312 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.312 INFO:teuthology.orchestra.run.smithi070.stdout:5338 writesame 0xa5a0d3 thru 0xa648b4 data_size 0x13(0xa7e2 bytes) 2024-09-11T06:19:37.315 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.315 INFO:teuthology.orchestra.run.smithi070.stdout:5342 read 0x472a917 thru 0x4730030 (0x571a bytes) 2024-09-11T06:19:37.315 INFO:teuthology.orchestra.run.smithi070.stdout:5343 writesame 0xea4170 thru 0xeb2698 data_size 0x5(0xe529 bytes) 2024-09-11T06:19:37.321 INFO:teuthology.orchestra.run.smithi070.stdout:5344 read 0x11652f2 thru 0x1174c98 (0xf9a7 bytes) 2024-09-11T06:19:37.321 INFO:teuthology.orchestra.run.smithi070.stdout:5347 writesame 0x5506a4d thru 0x550ecb8 data_size 0x22(0x826c bytes) 2024-09-11T06:19:37.323 INFO:teuthology.orchestra.run.smithi070.stdout:5349 read 0x2748f2b thru 0x274c97b (0x3a51 bytes) 2024-09-11T06:19:37.323 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.323 INFO:teuthology.orchestra.run.smithi070.stdout:5351 read 0x23d82ba thru 0x23dbb00 (0x3847 bytes) 2024-09-11T06:19:37.324 INFO:teuthology.orchestra.run.smithi070.stdout:5352 write 0x459adb9 thru 0x45a7ebe (0xd106 bytes) 2024-09-11T06:19:37.326 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.333 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:37.333 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:37.333 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:37.335 INFO:teuthology.orchestra.run.smithi070.stdout:5354 trunc from 0x92371e3 to 0x200e888 2024-09-11T06:19:37.343 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:37.364 INFO:teuthology.orchestra.run.smithi070.stdout:5358 write 0xcc685f2 thru 0xcc72024 (0x9a33 bytes) 2024-09-11T06:19:37.367 INFO:teuthology.orchestra.run.smithi070.stdout:5359 writesame 0x75a1175 thru 0x75aec5f data_size 0x27(0xdaeb bytes) 2024-09-11T06:19:37.370 INFO:teuthology.orchestra.run.smithi070.stdout:5360 writesame 0xbd58995 thru 0xbd5c3e5 data_size 0x1(0x3a51 bytes) 2024-09-11T06:19:37.380 INFO:teuthology.orchestra.run.smithi070.stdout:5361 read 0x8059a5d thru 0x805c6ec (0x2c90 bytes) 2024-09-11T06:19:37.380 INFO:teuthology.orchestra.run.smithi070.stdout:5362 writesame 0x944289f thru 0x9449bdc data_size 0x16(0x733e bytes) 2024-09-11T06:19:37.383 INFO:teuthology.orchestra.run.smithi070.stdout:5364 writesame 0x4a2efa5 thru 0x4a3c657 data_size 0x1f(0xd6b3 bytes) 2024-09-11T06:19:37.386 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:37.385+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:37.387 INFO:teuthology.orchestra.run.smithi070.stdout:5365 punch from 0x43a0577 to 0x43a7bab, (0x7634 bytes) 2024-09-11T06:19:37.387 INFO:teuthology.orchestra.run.smithi070.stdout:5367 read 0x7db88dd thru 0x7dba14c (0x1870 bytes) 2024-09-11T06:19:37.387 INFO:teuthology.orchestra.run.smithi070.stdout:5368 write 0x81f91e9 thru 0x81fc21e (0x3036 bytes) 2024-09-11T06:19:37.389 INFO:teuthology.orchestra.run.smithi070.stdout:5371 read 0x356c5c2 thru 0x357a62e (0xe06d bytes) 2024-09-11T06:19:37.389 INFO:teuthology.orchestra.run.smithi070.stdout:5373 write 0xbcdc4f1 thru 0xbceb379 (0xee89 bytes) 2024-09-11T06:19:37.398 INFO:teuthology.orchestra.run.smithi070.stdout:5374 writesame 0xe473bd8 thru 0xe4819cc data_size 0x1(0xddf5 bytes) 2024-09-11T06:19:37.398 INFO:teuthology.orchestra.run.smithi070.stdout:5375 write 0x6c55c81 thru 0x6c5b6b0 (0x5a30 bytes) 2024-09-11T06:19:37.401 INFO:teuthology.orchestra.run.smithi070.stdout:5376 writesame 0x9a4af43 thru 0x9a4d79f data_size 0x1(0x285d bytes) 2024-09-11T06:19:37.408 INFO:teuthology.orchestra.run.smithi070.stdout:5377 read 0xce94882 thru 0xce9bcbe (0x743d bytes) 2024-09-11T06:19:37.412 INFO:teuthology.orchestra.run.smithi070.stdout:5378 trunc from 0xe4819cd to 0xb45c40e 2024-09-11T06:19:37.421 INFO:teuthology.orchestra.run.smithi070.stdout:5379 trunc from 0xb45c40e to 0xb3287e2 2024-09-11T06:19:37.426 INFO:teuthology.orchestra.run.smithi070.stdout:5381 punch from 0xdd6cba to 0xddb023, (0x4369 bytes) 2024-09-11T06:19:37.427 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.439 INFO:teuthology.orchestra.run.smithi070.stdout:5383 trunc from 0xb3287e2 to 0xc04f0c 2024-09-11T06:19:37.453 INFO:teuthology.orchestra.run.smithi070.stdout:5384 punch from 0x8b7107 to 0x8c0db3, (0x9cac bytes) 2024-09-11T06:19:37.472 INFO:teuthology.orchestra.run.smithi070.stdout:5385 write 0xbd40443 thru 0xbd43330 (0x2eee bytes) 2024-09-11T06:19:37.475 INFO:teuthology.orchestra.run.smithi070.stdout:5386 read 0x4799f7c thru 0x47a7a14 (0xda99 bytes) 2024-09-11T06:19:37.476 INFO:teuthology.orchestra.run.smithi070.stdout:5388 write 0xbbbac32 thru 0xbbbbc29 (0xff8 bytes) 2024-09-11T06:19:37.478 INFO:teuthology.orchestra.run.smithi070.stdout:5389 read 0x370b0f thru 0x373aa4 (0x2f96 bytes) 2024-09-11T06:19:37.478 INFO:teuthology.orchestra.run.smithi070.stdout:5391 punch from 0x525e3a6 to 0x5260254, (0x1eae bytes) 2024-09-11T06:19:37.479 INFO:teuthology.orchestra.run.smithi070.stdout:5393 write 0xb6a26ae thru 0xb6a58d5 (0x3228 bytes) 2024-09-11T06:19:37.482 INFO:teuthology.orchestra.run.smithi070.stdout:5395 punch from 0x78652fc to 0x787245b, (0xd15f bytes) 2024-09-11T06:19:37.482 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:37.482 INFO:teuthology.orchestra.run.smithi070.stdout:5397 writesame 0xb2945a1 thru 0xb294f1c data_size 0x2(0x97c bytes) 2024-09-11T06:19:37.484 INFO:teuthology.orchestra.run.smithi070.stdout:5398 punch from 0xc63c20 to 0xc6cef9, (0x92d9 bytes) 2024-09-11T06:19:37.485 INFO:teuthology.orchestra.run.smithi070.stdout:5400 writesame 0xa3810af thru 0xa38a4dc data_size 0xd(0x942e bytes) 2024-09-11T06:19:37.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:37.486+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:37.490 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:37.490 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:37.490 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:37.490 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:37.490 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:37.499 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:37.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:37.587+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:37.644 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.644 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.523827072000003, 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:19:37.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:19:37.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.523769526000002, 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.650 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:37.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.655 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.523744016999999, 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:19:37.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:19:37.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:19:37.660 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.523520849000001, 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.661 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:19:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.523486183000003, 2024-09-11T06:19:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.523462021, 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:19:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.52321147, 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.523184088999997, 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:19:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.523160949999998, 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:19:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522932365999999, 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:19:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522895232000003, 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:19:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:19:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522868043000003, 2024-09-11T06:19:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:19:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:19:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522599438, 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:19:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:19:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522558136999997, 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:19:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522533029999998, 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:19:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522292266000001, 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:19:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:19:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522257959999997, 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522237193000002, 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:19:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.522006670000003, 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:19:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118795 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.521965502, 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99200256799999997, 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118795 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120454+0000", 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.06e-07 2024-09-11T06:19:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120457+0000", 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459999999999998e-06 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120464+0000", 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1350000000000003e-06 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120470+0000", 2024-09-11T06:19:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120511+0000", 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1316000000000002e-05 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120517+0000", 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6790000000000002e-06 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112451+0000", 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.991934078 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112456+0000", 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:37.745 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:37.747 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:37.747 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:37.746+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:37.847 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:37.847+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:37.893 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:37.893 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:37.893 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:37.893 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:37.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:37.948 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:37.948+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:38.044 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:38.044 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:38.044 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:38.044 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:38.044 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:38.049 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:38.049+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:38.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:38.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:19:38.165 INFO:teuthology.orchestra.run.smithi070.stdout:5401 write 0xe003000 thru 0xe00fbe2 (0xcbe3 bytes) 2024-09-11T06:19:38.165 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:38.164+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:38.169 INFO:teuthology.orchestra.run.smithi070.stdout:5402 writesame 0xc2485e8 thru 0xc255b97 data_size 0x10(0xd5b0 bytes) 2024-09-11T06:19:38.173 INFO:teuthology.orchestra.run.smithi070.stdout:5403 read 0x5efdd46 thru 0x5f01b51 (0x3e0c bytes) 2024-09-11T06:19:38.173 INFO:teuthology.orchestra.run.smithi070.stdout:5404 writesame 0x57d4667 thru 0x57df4b9 data_size 0x1(0xae53 bytes) 2024-09-11T06:19:38.196 INFO:teuthology.orchestra.run.smithi070.stdout:5405 punch from 0x980356c to 0x9803e48, (0x8dc bytes) 2024-09-11T06:19:38.196 INFO:teuthology.orchestra.run.smithi070.stdout:5408 read 0xdab8c49 thru 0xdabcf9c (0x4354 bytes) 2024-09-11T06:19:38.196 INFO:teuthology.orchestra.run.smithi070.stdout:5409 read 0xb6d3f5f thru 0xb6d59a4 (0x1a46 bytes) 2024-09-11T06:19:38.197 INFO:teuthology.orchestra.run.smithi070.stdout:5410 punch from 0xc1b31f to 0xc200d7, (0x4db8 bytes) 2024-09-11T06:19:38.197 INFO:teuthology.orchestra.run.smithi070.stdout:5411 write 0x747ca53 thru 0x74898b5 (0xce63 bytes) 2024-09-11T06:19:38.200 INFO:teuthology.orchestra.run.smithi070.stdout:truncating to largest ever: 0xed6c63b 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.960123209, 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.202 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:38.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:19:38.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.96011047099999, 2024-09-11T06:19:38.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:19:38.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.96009933800001, 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:19:38.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:19:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:19:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.96008875, 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:19:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.960078255, 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:19:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:19:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.96006794199999, 2024-09-11T06:19:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.9600574, 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:19:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.960047094, 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:19:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.960031516, 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:19:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.960012511, 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:19:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:19:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:19:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.900483138, 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.90046466699999, 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.90044617700001, 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:19:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:19:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.900429109, 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:19:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:19:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.900411078, 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:19:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:19:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.900388894, 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:19:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.90037090200001, 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.900353248, 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:19:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:19:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:19:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.900330332, 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:19:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 109.90031194399999, 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:38.297 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:38.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:5412 trunc from 0xe00fbe3 to 0xed6c63b 2024-09-11T06:19:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:5413 read 0xd65e0d5 thru 0xd66113d (0x3069 bytes) 2024-09-11T06:19:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:5414 read 0x5eef2e1 thru 0x5ef729b (0x7fbb bytes) 2024-09-11T06:19:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:5416 read 0x2ed9f78 thru 0x2edad95 (0xe1e bytes) 2024-09-11T06:19:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:5417 read 0xafae021 thru 0xafb704a (0x902a bytes) 2024-09-11T06:19:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:5418 trunc from 0xed6c63b to 0x1d62162 2024-09-11T06:19:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:5419 write 0x1e3a55f thru 0x1e3e9b9 (0x445b bytes) 2024-09-11T06:19:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:5420 write 0x84ec470 thru 0x84ede13 (0x19a4 bytes) 2024-09-11T06:19:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:5421 read 0x2210a50 thru 0x22117ef (0xda0 bytes) 2024-09-11T06:19:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:5422 trunc from 0x84ede14 to 0x9066282 2024-09-11T06:19:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:5423 punch from 0x77e1e75 to 0x77e2263, (0x3ee bytes) 2024-09-11T06:19:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:5424 read 0x181829b thru 0x181fdb4 (0x7b1a bytes) 2024-09-11T06:19:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:5426 write 0xcbd2ea6 thru 0xcbd5a02 (0x2b5d bytes) 2024-09-11T06:19:38.301 INFO:teuthology.orchestra.run.smithi070.stdout:5427 trunc from 0xcbd5a03 to 0xa5226d 2024-09-11T06:19:38.301 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:38.297+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:38.311 INFO:teuthology.orchestra.run.smithi070.stdout:5432 read 0x31a786 thru 0x3210b0 (0x692b bytes) 2024-09-11T06:19:38.311 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:38.311 INFO:teuthology.orchestra.run.smithi070.stdout:5434 read 0x66386e thru 0x672aed (0xf280 bytes) 2024-09-11T06:19:38.322 INFO:teuthology.orchestra.run.smithi070.stdout:5435 write 0x438bea3 thru 0x4395cef (0x9e4d bytes) 2024-09-11T06:19:38.333 INFO:teuthology.orchestra.run.smithi070.stdout:5436 trunc from 0x4395cf0 to 0xa90ada5 2024-09-11T06:19:38.340 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:38.340 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:38.340 INFO:teuthology.orchestra.run.smithi070.stdout:5439 punch from 0x468ccb1 to 0x469b77c, (0xeacb bytes) 2024-09-11T06:19:38.340 INFO:teuthology.orchestra.run.smithi070.stdout:5440 writesame 0x9e7d09 thru 0x9eb858 data_size 0x49(0x3b50 bytes) 2024-09-11T06:19:38.342 INFO:teuthology.orchestra.run.smithi070.stdout:5441 punch from 0x7e12812 to 0x7e1ac83, (0x8471 bytes) 2024-09-11T06:19:38.342 INFO:teuthology.orchestra.run.smithi070.stdout:5442 read 0x106563f thru 0x106992e (0x42f0 bytes) 2024-09-11T06:19:38.345 INFO:teuthology.orchestra.run.smithi070.stdout:5443 trunc from 0xa90ada5 to 0x7a46207 2024-09-11T06:19:38.363 INFO:teuthology.orchestra.run.smithi070.stdout:5444 write 0xb423bfb thru 0xb42e18f (0xa595 bytes) 2024-09-11T06:19:38.371 INFO:teuthology.orchestra.run.smithi070.stdout:5445 trunc from 0xb42e190 to 0x6e74123 2024-09-11T06:19:38.382 INFO:teuthology.orchestra.run.smithi070.stdout:5446 write 0x32ea081 thru 0x32f0c52 (0x6bd2 bytes) 2024-09-11T06:19:38.386 INFO:teuthology.orchestra.run.smithi070.stdout:5448 punch from 0x40b072c to 0x40b70b4, (0x6988 bytes) 2024-09-11T06:19:38.386 INFO:teuthology.orchestra.run.smithi070.stdout:5449 read 0x3c33ea thru 0x3ca2b0 (0x6ec7 bytes) 2024-09-11T06:19:38.386 INFO:teuthology.orchestra.run.smithi070.stdout:5450 write 0x18cc1bf thru 0x18cdd68 (0x1baa bytes) 2024-09-11T06:19:38.389 INFO:teuthology.orchestra.run.smithi070.stdout:5453 read 0x5991919 thru 0x59a040c (0xeaf4 bytes) 2024-09-11T06:19:38.389 INFO:teuthology.orchestra.run.smithi070.stdout:5454 read 0x7e465 thru 0x8cc40 (0xe7dc bytes) 2024-09-11T06:19:38.390 INFO:teuthology.orchestra.run.smithi070.stdout:5456 write 0x3f65a46 thru 0x3f71f0a (0xc4c5 bytes) 2024-09-11T06:19:38.393 INFO:teuthology.orchestra.run.smithi070.stdout:5457 read 0x6026d86 thru 0x6026e1e (0x99 bytes) 2024-09-11T06:19:38.398 INFO:teuthology.orchestra.run.smithi070.stdout:5458 trunc from 0x6e74123 to 0x298428a 2024-09-11T06:19:38.399 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:38.398+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:38.415 INFO:teuthology.orchestra.run.smithi070.stdout:5459 write 0x2e5eda9 thru 0x2e65e4b (0x70a3 bytes) 2024-09-11T06:19:38.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:38.424 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:38.424 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:38.429 INFO:teuthology.orchestra.run.smithi070.stdout:5463 write 0x6973b32 thru 0x69807e0 (0xccaf bytes) 2024-09-11T06:19:38.435 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:38.445 INFO:teuthology.orchestra.run.smithi070.stdout:5464 write 0xb5a43d3 thru 0xb5ab521 (0x714f bytes) 2024-09-11T06:19:38.448 INFO:teuthology.orchestra.run.smithi070.stdout:5465 write 0x8fd57ee thru 0x8fd5e83 (0x696 bytes) 2024-09-11T06:19:38.451 INFO:teuthology.orchestra.run.smithi070.stdout:5466 read 0x1f521d1 thru 0x1f595de (0x740e bytes) 2024-09-11T06:19:38.452 INFO:teuthology.orchestra.run.smithi070.stdout:5467 read 0x67e0670 thru 0x67e53a7 (0x4d38 bytes) 2024-09-11T06:19:38.452 INFO:teuthology.orchestra.run.smithi070.stdout:5468 read 0x6366363 thru 0x636c46b (0x6109 bytes) 2024-09-11T06:19:38.452 INFO:teuthology.orchestra.run.smithi070.stdout:5469 punch from 0x6aeb308 to 0x6af3808, (0x8500 bytes) 2024-09-11T06:19:38.453 INFO:teuthology.orchestra.run.smithi070.stdout:5471 read 0x9a1096b thru 0x9a10f1c (0x5b2 bytes) 2024-09-11T06:19:38.453 INFO:teuthology.orchestra.run.smithi070.stdout:5472 write 0x1ded4a7 thru 0x1df4b68 (0x76c2 bytes) 2024-09-11T06:19:38.463 INFO:teuthology.orchestra.run.smithi070.stdout:5473 writesame 0xd0ab8d8 thru 0xd0b5bfd data_size 0x3(0xa326 bytes) 2024-09-11T06:19:38.465 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:38.465 INFO:teuthology.orchestra.run.smithi070.stdout:5476 read 0x5c61189 thru 0x5c67e05 (0x6c7d bytes) 2024-09-11T06:19:38.465 INFO:teuthology.orchestra.run.smithi070.stdout:5477 write 0x7351ee4 thru 0x7357794 (0x58b1 bytes) 2024-09-11T06:19:38.466 INFO:teuthology.orchestra.run.smithi070.stdout:5478 punch from 0x57fcb0b to 0x5808ed1, (0xc3c6 bytes) 2024-09-11T06:19:38.466 INFO:teuthology.orchestra.run.smithi070.stdout:5479 write 0xed645c thru 0xee3cea (0xd88f bytes) 2024-09-11T06:19:38.470 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:38.478 INFO:teuthology.orchestra.run.smithi070.stdout:5481 write 0xe8aabd5 thru 0xe8af19a (0x45c6 bytes) 2024-09-11T06:19:38.482 INFO:teuthology.orchestra.run.smithi070.stdout:5482 read 0xe4e4473 thru 0xe4eac24 (0x67b2 bytes) 2024-09-11T06:19:38.490 INFO:teuthology.orchestra.run.smithi070.stdout:5483 trunc from 0xe8af19b to 0x730fef3 2024-09-11T06:19:38.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:38.499+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:38.502 INFO:teuthology.orchestra.run.smithi070.stdout:5484 write 0x2d8b985 thru 0x2d8d705 (0x1d81 bytes) 2024-09-11T06:19:38.511 INFO:teuthology.orchestra.run.smithi070.stdout:5485 write 0x8059781 thru 0x8066579 (0xcdf9 bytes) 2024-09-11T06:19:38.515 INFO:teuthology.orchestra.run.smithi070.stdout:5486 read 0x760049c thru 0x760424c (0x3db1 bytes) 2024-09-11T06:19:38.515 INFO:teuthology.orchestra.run.smithi070.stdout:5487 read 0x4ffb877 thru 0x500a786 (0xef10 bytes) 2024-09-11T06:19:38.515 INFO:teuthology.orchestra.run.smithi070.stdout:5488 read 0x140e04e thru 0x1412d75 (0x4d28 bytes) 2024-09-11T06:19:38.516 INFO:teuthology.orchestra.run.smithi070.stdout:5490 write 0x10dd5af thru 0x10e31b8 (0x5c0a bytes) 2024-09-11T06:19:38.531 INFO:teuthology.orchestra.run.smithi070.stdout:5491 write 0xed2b012 thru 0xed385ac (0xd59b bytes) 2024-09-11T06:19:38.534 INFO:teuthology.orchestra.run.smithi070.stdout:5492 write 0xe96a038 thru 0xe96a7b4 (0x77d bytes) 2024-09-11T06:19:38.537 INFO:teuthology.orchestra.run.smithi070.stdout:5493 writesame 0x4724c41 thru 0x472776f data_size 0x37(0x2b2f bytes) 2024-09-11T06:19:38.541 INFO:teuthology.orchestra.run.smithi070.stdout:5494 write 0x772b0cf thru 0x7735097 (0x9fc9 bytes) 2024-09-11T06:19:38.545 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:38.545 INFO:teuthology.orchestra.run.smithi070.stdout:5496 punch from 0x643e085 to 0x643e842, (0x7bd bytes) 2024-09-11T06:19:38.545 INFO:teuthology.orchestra.run.smithi070.stdout:5497 writesame 0x7a3667d thru 0x7a41edb data_size 0x1(0xb85f bytes) 2024-09-11T06:19:38.561 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:38.561 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:38.566 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:38.567 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:38.567 INFO:teuthology.orchestra.run.smithi070.stdout:5498 writesame 0x4174b5f thru 0x4178c19 data_size 0x1(0x40bb bytes) 2024-09-11T06:19:38.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:38.577 INFO:teuthology.orchestra.run.smithi070.stdout:5499 punch from 0x9a7cd65 to 0x9a83935, (0x6bd0 bytes) 2024-09-11T06:19:38.577 INFO:teuthology.orchestra.run.smithi070.stdout:5500 clone 37 order 23 su 65536 sc 9 2024-09-11T06:19:38.579 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:38.580 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:38.596 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:38.596 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:38.600 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:38.599+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:38.613 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:38.630 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:38.630 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:38.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:38.664 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:38.664 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:38.681 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:38.682 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:38.682 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:38.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:38.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:38.700+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:38.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:38.801+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:38.835 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:38.836 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:38.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:38.903 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:38.902+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:38.948 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:38.948 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:38.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:39.005 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:39.004+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:39.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:39.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:39.105+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:19:39.148 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:19:39.149 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:19:39.149 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T06:19:39.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:19:39.210 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:39.209+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:39.224 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:39.224 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:39.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:39.307 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:39.306+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:39.379 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:39.379 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:39.387 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:39.432 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:39.431+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:39.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:39.444 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:39.444 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 171, 2024-09-11T06:19:39.444 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:19:39.444 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:19:39.444 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:19:39.144921+0000", 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:18:57.153745+0000", 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:16:42.356322+0000", 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 7, 2024-09-11T06:19:39.445 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:19:39.446 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:39.447 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:39.448 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:39.449 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:39.450 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:39.451 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:19:39.452 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:19:39.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:19:39.454 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:19:39.455 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:39.456 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.457 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:39.458 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:19:39.460 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:19:39.461 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "171", 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 75, 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 171, 2024-09-11T06:19:39.462 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:19:39.463 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:19:39.464 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:19:39.465 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.83906745910644531, 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.8399999737739563, 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.8399999737739563 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:39.466 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0.630950927734375, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 155, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:19:39.467 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.468 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.6932525634765625, 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 54, 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 92, 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 161, 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 56, 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:19:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/747530186", 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/747530186", 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/747530186", 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/747530186", 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 109, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 130, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 162, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 110, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/4176263936", 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/4176263936", 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/4176263936", 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/4176263936", 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 133, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:19:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:19:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:19:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:19:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 169, 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 130, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:19:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 0.7060699462890625, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 168, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:19:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.019287109375, 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 110, 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:19:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 56 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 110 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:19:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.3", 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: 6, 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: 3 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.f", 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: 7, 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: 2 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.b", 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 7, 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 4 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 6, 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-11T06:19:39.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.12", 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 3, 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 4 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.521 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.19", 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 4, 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 1, 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 3 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:39.522 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 72, 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 74, 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:19:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:19:39.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:39.526 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:39.528 INFO:tasks.thrashosds.thrasher:j is {'epoch': 171, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:19:39.144921+0000', 'last_up_change': '2024-09-11T06:18:57.153745+0000', 'last_in_change': '2024-09-11T06:16:42.356322+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 75, 'snap_epoch': 171, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8390674591064453, 'average_primary_affinity': 0.8399999737739563, 'average_primary_affinity_weighted': 0.8399999737739563}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 0.630950927734375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 155, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6932525634765625, 'last_clean_begin': 15, 'last_clean_end': 54, 'up_from': 92, 'up_thru': 161, 'down_at': 56, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 747530186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 747530186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 747530186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 747530186}]}, 'public_addr': '172.21.15.70:6817/747530186', 'cluster_addr': '172.21.15.70:6819/747530186', 'heartbeat_back_addr': '172.21.15.70:6823/747530186', 'heartbeat_front_addr': '172.21.15.70:6821/747530186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 109, 'up_from': 130, 'up_thru': 162, 'down_at': 110, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 4176263936}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4176263936}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4176263936}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4176263936}]}, 'public_addr': '172.21.15.70:6809/4176263936', 'cluster_addr': '172.21.15.70:6811/4176263936', 'heartbeat_back_addr': '172.21.15.70:6815/4176263936', 'heartbeat_front_addr': '172.21.15.70:6813/4176263936', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 169, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 0.7060699462890625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 168, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.019287109375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 110, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 56}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 110}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.3', 'osds': [6, 3]}, {'pgid': '3.f', 'osds': [7, 2]}], 'pg_upmap_items': [{'pgid': '3.b', 'mappings': [{'from': 7, 'to': 4}, {'from': 6, 'to': 2}]}, {'pgid': '3.12', 'mappings': [{'from': 3, 'to': 4}]}, {'pgid': '3.19', 'mappings': [{'from': 4, 'to': 2}, {'from': 1, 'to': 3}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 72, 'length': 1}, {'begin': 74, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:19:39.528 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.f 2024-09-11T06:19:39.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.f 2024-09-11T06:19:39.529 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:39.529 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:39.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:39.530 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:39.526+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:39.629 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:39.627+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:39.674 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:39.674 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:39.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:39.728 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:39.728+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:39.788 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:39.789 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:39.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:39.829 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:39.828+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:39.930 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:39.929+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:39.941 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:39.942 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:39.950 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:40.031 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:40.030+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:40.066 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:40.066 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:40.077 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:40.113 INFO:teuthology.orchestra.run.smithi070.stderr:clear 3.f pg_upmap mapping 2024-09-11T06:19:40.131 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:40.130+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:40.224 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:40.224 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:40.233 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:40.231+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:40.234 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:40.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:40.332+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:40.378 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:40.378 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:40.387 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:40.471 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:40.470+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:40.530 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:40.530 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:40.534 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:40.534+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:40.539 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:40.636 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:40.635+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:40.682 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:40.682 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:40.692 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:40.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:40.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:40.736+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:40.794 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:40.794 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:40.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:40.820 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:40.821 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:40.838 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:40.838 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:40.838 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:40.837+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:40.853 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:40.853 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:40.869 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:40.869 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:40.887 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:40.887 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:40.903 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:40.903 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:40.919 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:40.936 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:40.937 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:40.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:40.938+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:40.959 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:41.039 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:41.039+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:41.101 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:41.101 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:41.101 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:41.110 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:41.141 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:41.140+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:41.169 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:19:41.215 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.095418363999997, 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.216 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:19:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:19:41.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.095360818000003, 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:41.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:19:41.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.095335308999999, 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.227 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:19:41.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.095112141000001, 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.095077474999997, 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.238 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:41.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:41.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:19:41.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.095053313000001, 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.243 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:19:41.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:19:41.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.248 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094802762, 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:41.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094775380999998, 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.253 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:19:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:19:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:19:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:19:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:19:41.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:19:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:19:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:19:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:19:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:19:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:41.260 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094752241999998, 2024-09-11T06:19:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:19:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:19:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:41.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:19:41.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094523658, 2024-09-11T06:19:41.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:19:41.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:41.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.272 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094486523999997, 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.273 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:41.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:19:41.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:19:41.277 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094459335000003, 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:19:41.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094190730000001, 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:19:41.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:19:41.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:19:41.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094149428999998, 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.289 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:19:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:19:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:19:41.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:19:41.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.094124321999999, 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:19:41.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:19:41.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:19:41.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.093883558000002, 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.300 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:19:41.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.304 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.093849251999998, 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.305 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.307 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:19:41.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:19:41.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.093828485000003, 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.310 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:19:41.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.093597961999997, 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:19:41.315 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.317 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:41.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.320 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118795 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.093556794000001, 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99200256799999997, 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.321 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118795 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120454+0000", 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.06e-07 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120457+0000", 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459999999999998e-06 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120464+0000", 2024-09-11T06:19:41.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1350000000000003e-06 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120470+0000", 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120511+0000", 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1316000000000002e-05 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120517+0000", 2024-09-11T06:19:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6790000000000002e-06 2024-09-11T06:19:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112451+0000", 2024-09-11T06:19:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.991934078 2024-09-11T06:19:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112456+0000", 2024-09-11T06:19:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:19:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.327 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.327 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:41.329 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:41.330 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:41.328+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:41.430 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:41.429+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:41.433 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:41.433 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:41.433 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:41.442 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:41.530 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:41.530+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:41.543 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:41.543 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:41.543 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:41.552 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:41.631 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:41.631+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.416355229, 2024-09-11T06:19:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.41634249099999, 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.41633135799999, 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:19:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.41632077, 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.416310275, 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:19:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.416299962, 2024-09-11T06:19:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:19:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:19:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.41628942, 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:19:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:19:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.41627911400001, 2024-09-11T06:19:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:19:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.416263536, 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:19:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.416244531, 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:19:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.356715158, 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:19:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:19:41.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:19:41.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.356696687, 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:19:41.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:41.717 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.35667819699999, 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:41.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:19:41.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:19:41.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.356661129, 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.726 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.35664309800001, 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:41.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:19:41.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.356620914, 2024-09-11T06:19:41.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:41.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:19:41.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.35660292199999, 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:41.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:19:41.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.356585268, 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.741 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:19:41.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.356562352, 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.745 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:19:41.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 113.356543964, 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:19:41.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:19:41.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:41.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:41.754 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:41.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:41.756 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:41.755+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:41.856 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:41.855+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:41.859 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:41.859 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:41.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:41.957 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:41.956+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:42.011 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:42.011 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:42.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:42.058 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:42.056+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:19:42.133 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130410 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10993664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984649001999998, 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043187259999999998, 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130410 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146584+0000", 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146592+0000", 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5619999999999998e-06 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146598+0000", 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189643+0000", 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043045091000000001 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189704+0000", 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0911e-05 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189769+0000", 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5745000000000002e-05 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130411 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 11001856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984626861000002, 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043307804999999998, 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130411 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146605+0000", 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146613+0000", 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6729999999999998e-06 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146621+0000", 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8849999999999999e-06 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146626+0000", 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9520000000000002e-06 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189802+0000", 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043175603 2024-09-11T06:19:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189848+0000", 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6465999999999999e-05 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189912+0000", 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3835000000000001e-05 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130444 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10752000~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984598061, 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043428937000000001, 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130444 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146635+0000", 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146642+0000", 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8680000000000001e-06 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146649+0000", 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2319999999999998e-06 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189933+0000", 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043284979000000001 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189982+0000", 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8513000000000001e-05 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190062+0000", 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9929e-05 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130445 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10760192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984570537000003, 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043549156999999998, 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130445 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146663+0000", 2024-09-11T06:19:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146678+0000", 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5201000000000001e-05 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146684+0000", 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190086+0000", 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043401281 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190147+0000", 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1246000000000003e-05 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190210+0000", 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2720999999999998e-05 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130446 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10768384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984533454999998, 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043660235999999998, 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130446 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146700+0000", 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-06 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146709+0000", 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3520000000000007e-06 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146718+0000", 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6830000000000003e-06 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190233+0000", 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043514440000000001 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190283+0000", 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0178e-05 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190358+0000", 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4796999999999996e-05 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130447 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10776576~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984469533999999, 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043732383999999999, 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130447 2024-09-11T06:19:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146765+0000", 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146782+0000", 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7282000000000002e-05 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146789+0000", 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7279999999999998e-06 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190386+0000", 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043596843000000003 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190431+0000", 2024-09-11T06:19:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5751999999999998e-05 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190494+0000", 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2614999999999996e-05 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130448 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10784768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984427799000002, 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043831475000000002, 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130448 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146811+0000", 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146814+0000", 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.543e-06 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146823+0000", 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8699999999999998e-06 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146828+0000", 2024-09-11T06:19:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190522+0000", 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043694033 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190572+0000", 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0269999999999998e-05 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190635+0000", 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2719999999999996e-05 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130449 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10792960~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984391143000003, 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043926146999999999, 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130449 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8200000000000001e-07 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146842+0000", 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5910000000000001e-06 2024-09-11T06:19:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146852+0000", 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0341e-05 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146855+0000", 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190655+0000", 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043800258000000002 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190706+0000", 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0226999999999999e-05 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190766+0000", 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0517999999999999e-05 2024-09-11T06:19:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130450 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10801152~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984371936999999, 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044072734000000002, 2024-09-11T06:19:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130450 2024-09-11T06:19:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146861+0000", 2024-09-11T06:19:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3379999999999999e-06 2024-09-11T06:19:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146865+0000", 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3220000000000003e-06 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146868+0000", 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190792+0000", 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043923845000000003 2024-09-11T06:19:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190853+0000", 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1008999999999998e-05 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190932+0000", 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9326000000000006e-05 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130451 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10809344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984359902999998, 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044195328999999998, 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130451 2024-09-11T06:19:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147086+0000", 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021491899999999999 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147096+0000", 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0217999999999999e-05 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147105+0000", 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147112+0000", 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190954+0000", 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043842032000000003 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191004+0000", 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0482999999999998e-05 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191066+0000", 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2420000000000002e-05 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130452 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10817536~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.984110845000004, 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044100716999999998, 2024-09-11T06:19:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130452 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147905+0000", 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078465999999999996 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147909+0000", 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2549999999999999e-06 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147919+0000", 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0236e-05 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147927+0000", 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8679999999999999e-06 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191092+0000", 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043164431000000003 2024-09-11T06:19:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191142+0000", 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9923000000000003e-05 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191221+0000", 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9344000000000005e-05 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130453 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10825728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.983270287000003, 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392063000000002, 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130453 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147963+0000", 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.795e-06 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147967+0000", 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9979999999999997e-06 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147970+0000", 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191246+0000", 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043275980999999998 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191291+0000", 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5498999999999999e-05 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191353+0000", 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999994e-05 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.189 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130454 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10833920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.983257096999999, 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043530384999999998, 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130454 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5199999999999998e-07 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147975+0000", 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.195e-06 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147979+0000", 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.196e-06 2024-09-11T06:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147981+0000", 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191374+0000", 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392673 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191441+0000", 2024-09-11T06:19:42.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191504+0000", 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3602999999999994e-05 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130455 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10842112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.983246450999999, 2024-09-11T06:19:42.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043653780000000003, 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130455 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147986+0000", 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.35e-06 2024-09-11T06:19:42.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147989+0000", 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147992+0000", 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191525+0000", 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043533080000000002 2024-09-11T06:19:42.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191577+0000", 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2506999999999997e-05 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191638+0000", 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0903999999999998e-05 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130456 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10850304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.983236011000002, 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.04379475, 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130456 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149579+0000", 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001583877 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149584+0000", 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9359999999999998e-06 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149593+0000", 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2429999999999994e-06 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149598+0000", 2024-09-11T06:19:42.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0919999999999997e-06 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191663+0000", 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042064987999999998 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191714+0000", 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0506000000000001e-05 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191790+0000", 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130463 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10907648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.981557025000001, 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043098538999999998, 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130463 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:42.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.28e-07 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149679+0000", 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5449999999999997e-06 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149682+0000", 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.455e-06 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149685+0000", 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.526e-06 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192662+0000", 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042976939999999998 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192712+0000", 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0682e-05 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192773+0000", 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0163e-05 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130464 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10915840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.981542900999997, 2024-09-11T06:19:42.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043257601999999999, 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130464 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149920+0000", 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023134100000000001 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149923+0000", 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000001e-06 2024-09-11T06:19:42.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149932+0000", 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7080000000000003e-06 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149939+0000", 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6510000000000001e-06 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192802+0000", 2024-09-11T06:19:42.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042862572000000002 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192861+0000", 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9077999999999999e-05 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192946+0000", 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4901999999999995e-05 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130465 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10924032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.981283904000001, 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043129278, 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130465 2024-09-11T06:19:42.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149949+0000", 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.886e-06 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149953+0000", 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149956+0000", 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192970+0000", 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043013844000000002 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193017+0000", 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6530999999999999e-05 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193076+0000", 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9824999999999997e-05 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130466 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10932224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.981271333000002, 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043272974999999998, 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130466 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151901+0000", 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001941356 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151905+0000", 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000003e-06 2024-09-11T06:19:42.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151912+0000", 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0679999999999999e-06 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151916+0000", 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9829999999999998e-06 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193097+0000", 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041180814000000003 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193161+0000", 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3584000000000007e-05 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193233+0000", 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2074000000000001e-05 2024-09-11T06:19:42.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130516 3.1c 3:3f6bd6e9:::rbd_object_map.116df114867d.000000000000003e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.97806885, 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043688850000000001, 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:42.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130516 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:42.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153163+0000", 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8299999999999996e-07 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153168+0000", 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153176+0000", 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153181+0000", 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3539999999999999e-06 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194609+0000", 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041427972 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194661+0000", 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2308999999999997e-05 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194883+0000", 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221466 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196734+0000", 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018515039999999999 2024-09-11T06:19:42.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196752+0000", 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7558e-05 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196812+0000", 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9639000000000003e-05 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196851+0000", 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9536999999999998e-05 2024-09-11T06:19:42.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.227 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:42.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:42.230 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:42.229+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:42.331 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:42.330+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:42.333 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2152866229999999, 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2153071019999999, 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:19:42.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.215266446, 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.21533417, 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:19:42.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.215255081, 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2153642279999999, 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:19:42.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:19:42.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.349 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2152276440000001, 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2153766079999999, 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:19:42.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:19:42.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:19:42.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2151933880000001, 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2153964930000001, 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.355 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:42.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:19:42.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2151799249999999, 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.215419257, 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.360 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:42.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2151481959999999, 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.215424974, 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:19:42.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:19:42.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.215136038, 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2154486929999999, 2024-09-11T06:19:42.370 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2151111889999999, 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.215454936, 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:19:42.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.21509796, 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2154722920000001, 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:42.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2157304899999999, 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2161363670000001, 2024-09-11T06:19:42.383 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:19:42.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2156795790000001, 2024-09-11T06:19:42.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.216121325, 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:19:42.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2154922749999999, 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.215970086, 2024-09-11T06:19:42.393 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:19:42.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:19:42.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.215455315, 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2159723309999999, 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:42.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2154304579999999, 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160096220000001, 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:19:42.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.408 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.215390494, 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.216007735, 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.215360118, 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.216015716, 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:19:42.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:19:42.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.215339352, 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.216033227, 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:19:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:19:42.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.215306481, 2024-09-11T06:19:42.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160380479999999, 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:42.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:42.429 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 19 2024-09-11T06:19:42.430 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:42.431 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:42.472 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:42.471+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:42.532 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:42.532+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:42.587 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:42.588 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:42.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:42.633 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:42.633+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.577571708000001, 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5813268460000001, 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:19:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:19:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:19:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5812759349999999, 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:19:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:19:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5810886310000001, 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:19:42.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.581051671, 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:19:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5810268139999999, 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:19:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5809868499999999, 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:19:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5809564739999999, 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:19:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:19:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:19:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5809357080000002, 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:19:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.580902837, 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:19:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:19:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5808829790000001, 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:19:42.761 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:19:42.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.580862802, 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:19:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:19:42.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:42.772 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.580851437, 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:19:42.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.580824, 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:19:42.778 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:19:42.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5807897440000001, 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:42.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5807762809999999, 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:42.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:19:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5807445520000001, 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:19:42.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:19:42.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.580732394, 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:19:42.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.5807075450000001, 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.806 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.810 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.580694316, 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:42.811 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:42.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:19:42.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.815 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:42.816 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:42.816 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:42.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:42.818 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:42.816+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:42.918 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:42.917+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:42.921 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:42.921 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:42.922 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:42.922 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:42.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:42.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:43.019 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:43.018+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:43.035 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:43.035 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:43.035 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:43.035 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:43.035 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:43.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:43.110 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:43.111 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:43.119 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:43.119+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:43.142 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:43.142 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:43.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:43.176 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:43.176 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:43.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:43.195 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:43.213 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:43.213 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:43.220 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:43.219+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:43.247 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:43.247 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:43.264 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:43.264 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:43.281 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:43.281 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:43.296 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:43.297 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:43.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:43.321 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:43.320+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:43.337 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-11T06:19:43.423 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:43.422+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:43.449 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:43.449 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:43.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:43.486 INFO:teuthology.orchestra.run.smithi070.stdout:5501 read 0x92146f2 thru 0x9223791 (0xf0a0 bytes) 2024-09-11T06:19:43.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:43.523+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:43.562 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:43.562 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:43.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:43.625 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:43.624+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:43.680 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:43.681 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:43.689 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:43.726 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:43.726+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:43.826 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:43.826+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:43.833 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:43.833 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:43.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:43.927 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:43.926+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:43.945 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:43.946 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:43.954 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:44.038 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:44.038+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:44.099 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:44.099 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:44.108 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:44.129 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:44.129+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:44.165 INFO:teuthology.orchestra.run.smithi070.stdout:5502 read 0xca14288 thru 0xca14e63 (0xbdc bytes) 2024-09-11T06:19:44.174 INFO:teuthology.orchestra.run.smithi070.stdout:5503 trunc from 0xed385ad to 0xa2d1614 2024-09-11T06:19:44.192 INFO:teuthology.orchestra.run.smithi070.stdout:5504 punch from 0x2bdb4c4 to 0x2beb41a, (0xff56 bytes) 2024-09-11T06:19:44.192 INFO:teuthology.orchestra.run.smithi070.stdout:5505 write 0x870fbb9 thru 0x8717bd4 (0x801c bytes) 2024-09-11T06:19:44.201 INFO:teuthology.orchestra.run.smithi070.stdout:5506 trunc from 0xa2d1614 to 0xe2ad24a 2024-09-11T06:19:44.207 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.225 INFO:teuthology.orchestra.run.smithi070.stdout:5508 trunc from 0xe2ad24a to 0xa6ee58 2024-09-11T06:19:44.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:19:44.230 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:44.229+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:44.259 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:44.259 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:44.265 INFO:teuthology.orchestra.run.smithi070.stdout:5509 write 0xdfd475a thru 0xdfdfd4e (0xb5f5 bytes) 2024-09-11T06:19:44.269 INFO:teuthology.orchestra.run.smithi070.stdout:5511 punch from 0xc693cd7 to 0xc6a2c19, (0xef42 bytes) 2024-09-11T06:19:44.269 INFO:teuthology.orchestra.run.smithi070.stdout:5512 read 0x4d288a7 thru 0x4d28fbd (0x717 bytes) 2024-09-11T06:19:44.269 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.270 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:44.283 INFO:teuthology.orchestra.run.smithi070.stdout:5514 trunc from 0xdfdfd4f to 0x22598ec 2024-09-11T06:19:44.297 INFO:teuthology.orchestra.run.smithi070.stdout:5515 read 0x22a85f thru 0x239fb6 (0xf758 bytes) 2024-09-11T06:19:44.318 INFO:teuthology.orchestra.run.smithi070.stdout:5516 write 0xed644d9 thru 0xed7001c (0xbb44 bytes) 2024-09-11T06:19:44.321 INFO:teuthology.orchestra.run.smithi070.stdout:5517 read 0xaf1038c thru 0xaf12303 (0x1f78 bytes) 2024-09-11T06:19:44.330 INFO:teuthology.orchestra.run.smithi070.stdout:5518 trunc from 0xed7001d to 0x79c0570 2024-09-11T06:19:44.330 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:44.329+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:44.340 INFO:teuthology.orchestra.run.smithi070.stdout:5519 read 0x1a50e4a thru 0x1a52040 (0x11f7 bytes) 2024-09-11T06:19:44.347 INFO:teuthology.orchestra.run.smithi070.stdout:5522 trunc from 0x79c0570 to 0xd47f3ab 2024-09-11T06:19:44.353 INFO:teuthology.orchestra.run.smithi070.stdout:5523 write 0x73b77b6 thru 0x73b8b62 (0x13ad bytes) 2024-09-11T06:19:44.358 INFO:teuthology.orchestra.run.smithi070.stdout:5525 punch from 0xd22e6e7 to 0xd233b6d, (0x5486 bytes) 2024-09-11T06:19:44.358 INFO:teuthology.orchestra.run.smithi070.stdout:5526 read 0xd0d7ff1 thru 0xd0e30e1 (0xb0f1 bytes) 2024-09-11T06:19:44.358 INFO:teuthology.orchestra.run.smithi070.stdout:5527 read 0x7a0c486 thru 0x7a146b7 (0x8232 bytes) 2024-09-11T06:19:44.358 INFO:teuthology.orchestra.run.smithi070.stdout:5528 read 0xa44a6e4 thru 0xa44f792 (0x50af bytes) 2024-09-11T06:19:44.358 INFO:teuthology.orchestra.run.smithi070.stdout:5529 read 0x2dd87a9 thru 0x2dddda0 (0x55f8 bytes) 2024-09-11T06:19:44.358 INFO:teuthology.orchestra.run.smithi070.stdout:5530 write 0x5005046 thru 0x5007487 (0x2442 bytes) 2024-09-11T06:19:44.361 INFO:teuthology.orchestra.run.smithi070.stdout:5531 read 0x7e68fb3 thru 0x7e6d867 (0x48b5 bytes) 2024-09-11T06:19:44.362 INFO:teuthology.orchestra.run.smithi070.stdout:5532 trunc from 0xd47f3ab to 0xe01cfb6 2024-09-11T06:19:44.367 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.378 INFO:teuthology.orchestra.run.smithi070.stdout:5534 trunc from 0xe01cfb6 to 0x4c7307b 2024-09-11T06:19:44.385 INFO:teuthology.orchestra.run.smithi070.stdout:5536 read 0x1004010 thru 0x100926e (0x525f bytes) 2024-09-11T06:19:44.400 INFO:teuthology.orchestra.run.smithi070.stdout:5537 write 0xbf28b0c thru 0xbf329e1 (0x9ed6 bytes) 2024-09-11T06:19:44.403 INFO:teuthology.orchestra.run.smithi070.stdout:5538 write 0x2cb2373 thru 0x2cb4a53 (0x26e1 bytes) 2024-09-11T06:19:44.405 INFO:teuthology.orchestra.run.smithi070.stdout:5539 write 0x6f9270b thru 0x6f955d8 (0x2ece bytes) 2024-09-11T06:19:44.417 INFO:teuthology.orchestra.run.smithi070.stdout:5541 writesame 0xe81a03b thru 0xe8278db data_size 0x1(0xd8a1 bytes) 2024-09-11T06:19:44.417 INFO:teuthology.orchestra.run.smithi070.stdout:5543 punch from 0x199aaa3 to 0x19a29a4, (0x7f01 bytes) 2024-09-11T06:19:44.417 INFO:teuthology.orchestra.run.smithi070.stdout:5544 write 0x4e35500 thru 0x4e355b7 (0xb8 bytes) 2024-09-11T06:19:44.417 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:44.417 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:44.419 INFO:teuthology.orchestra.run.smithi070.stdout:5545 writesame 0x649e8d3 thru 0x64a2a98 data_size 0x1(0x41c6 bytes) 2024-09-11T06:19:44.426 INFO:teuthology.orchestra.run.smithi070.stdout:5548 punch from 0xa1eaeab to 0xa1f8341, (0xd496 bytes) 2024-09-11T06:19:44.426 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.426 INFO:teuthology.orchestra.run.smithi070.stdout:5551 writesame 0x737d0f0 thru 0x738aec6 data_size 0x3d(0xddd7 bytes) 2024-09-11T06:19:44.427 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:44.428 INFO:teuthology.orchestra.run.smithi070.stdout:5552 write 0xc1ec546 thru 0xc1ef7b0 (0x326b bytes) 2024-09-11T06:19:44.431 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:44.430+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:44.431 INFO:teuthology.orchestra.run.smithi070.stdout:5553 writesame 0xdca83ba thru 0xdca9680 data_size 0x1(0x12c7 bytes) 2024-09-11T06:19:44.436 INFO:teuthology.orchestra.run.smithi070.stdout:5554 trunc from 0xe8278dc to 0xdb3113e 2024-09-11T06:19:44.443 INFO:teuthology.orchestra.run.smithi070.stdout:5555 read 0xc8e533d thru 0xc8ef234 (0x9ef8 bytes) 2024-09-11T06:19:44.443 INFO:teuthology.orchestra.run.smithi070.stdout:5559 read 0x4d75cc2 thru 0x4d7b6f1 (0x5a30 bytes) 2024-09-11T06:19:44.444 INFO:teuthology.orchestra.run.smithi070.stdout:5560 punch from 0xa486b0a to 0xa4893bd, (0x28b3 bytes) 2024-09-11T06:19:44.444 INFO:teuthology.orchestra.run.smithi070.stdout:5562 read 0x52c809a thru 0x52ca09b (0x2002 bytes) 2024-09-11T06:19:44.444 INFO:teuthology.orchestra.run.smithi070.stdout:5564 write 0xc8ac58b thru 0xc8b716a (0xabe0 bytes) 2024-09-11T06:19:44.445 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.451 INFO:teuthology.orchestra.run.smithi070.stdout:5566 write 0xe159302 thru 0xe15ee83 (0x5b82 bytes) 2024-09-11T06:19:44.453 INFO:teuthology.orchestra.run.smithi070.stdout:5567 write 0x5abb8ff thru 0x5ac12fc (0x59fe bytes) 2024-09-11T06:19:44.456 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.456 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.456 INFO:teuthology.orchestra.run.smithi070.stdout:5572 writesame 0x4468c05 thru 0x447449e data_size 0x1(0xb89a bytes) 2024-09-11T06:19:44.474 INFO:teuthology.orchestra.run.smithi070.stdout:5573 punch from 0x7dee345 to 0x7df520e, (0x6ec9 bytes) 2024-09-11T06:19:44.474 INFO:teuthology.orchestra.run.smithi070.stdout:5575 punch from 0x1422055 to 0x1428619, (0x65c4 bytes) 2024-09-11T06:19:44.474 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.474 INFO:teuthology.orchestra.run.smithi070.stdout:5581 writesame 0xdf4306c thru 0xdf51eca data_size 0x1(0xee5f bytes) 2024-09-11T06:19:44.509 INFO:teuthology.orchestra.run.smithi070.stdout:5582 trunc from 0xe15ee84 to 0x95cf0ae 2024-09-11T06:19:44.521 INFO:teuthology.orchestra.run.smithi070.stdout:5583 read 0x7004446 thru 0x700f16f (0xad2a bytes) 2024-09-11T06:19:44.528 INFO:teuthology.orchestra.run.smithi070.stdout:5584 trunc from 0x95cf0ae to 0x3847a15 2024-09-11T06:19:44.532 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:44.531+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:44.541 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:44.541 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:44.542 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.550 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:44.555 INFO:teuthology.orchestra.run.smithi070.stdout:5586 write 0x9b009a0 thru 0x9b02e0c (0x246d bytes) 2024-09-11T06:19:44.559 INFO:teuthology.orchestra.run.smithi070.stdout:5588 punch from 0x7d187b to 0x7d4fbc, (0x3741 bytes) 2024-09-11T06:19:44.559 INFO:teuthology.orchestra.run.smithi070.stdout:5589 read 0x2227bd5 thru 0x2231eff (0xa32b bytes) 2024-09-11T06:19:44.559 INFO:teuthology.orchestra.run.smithi070.stdout:5590 writesame 0x9cca2f thru 0x9d92f8 data_size 0x1a(0xc8ca bytes) 2024-09-11T06:19:44.561 INFO:teuthology.orchestra.run.smithi070.stdout:5591 write 0x791a656 thru 0x791d8ce (0x3279 bytes) 2024-09-11T06:19:44.568 INFO:teuthology.orchestra.run.smithi070.stdout:5592 trunc from 0x9b02e0d to 0x6158726 2024-09-11T06:19:44.580 INFO:teuthology.orchestra.run.smithi070.stdout:5593 punch from 0x2801be9 to 0x2806901, (0x4d18 bytes) 2024-09-11T06:19:44.580 INFO:teuthology.orchestra.run.smithi070.stdout:5594 writesame 0x12f27a7 thru 0x12f6791 data_size 0x1(0x3feb bytes) 2024-09-11T06:19:44.587 INFO:teuthology.orchestra.run.smithi070.stdout:5595 read 0x1a5e0dc thru 0x1a69181 (0xb0a6 bytes) 2024-09-11T06:19:44.588 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.588 INFO:teuthology.orchestra.run.smithi070.stdout:5597 write 0x58e93f thru 0x58fa36 (0x10f8 bytes) 2024-09-11T06:19:44.591 INFO:teuthology.orchestra.run.smithi070.stdout:5599 read 0x2af3954 thru 0x2aff537 (0xbbe4 bytes) 2024-09-11T06:19:44.592 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.594 INFO:teuthology.orchestra.run.smithi070.stdout:5602 trunc from 0x6158726 to 0x44c3509 2024-09-11T06:19:44.606 INFO:teuthology.orchestra.run.smithi070.stdout:5603 write 0x171a360 thru 0x171a56b (0x20c bytes) 2024-09-11T06:19:44.608 INFO:teuthology.orchestra.run.smithi070.stdout:5606 punch from 0x3ea8cd8 to 0x3eb6b27, (0xde4f bytes) 2024-09-11T06:19:44.608 INFO:teuthology.orchestra.run.smithi070.stdout:5607 read 0x1e0eccf thru 0x1e1e212 (0xf544 bytes) 2024-09-11T06:19:44.623 INFO:teuthology.orchestra.run.smithi070.stdout:5608 write 0xbfa9211 thru 0xbfb8935 (0xf725 bytes) 2024-09-11T06:19:44.627 INFO:teuthology.orchestra.run.smithi070.stdout:5610 write 0x941d47d thru 0x942c9eb (0xf56f bytes) 2024-09-11T06:19:44.631 INFO:teuthology.orchestra.run.smithi070.stdout:5611 punch from 0x99036fc to 0x99074e0, (0x3de4 bytes) 2024-09-11T06:19:44.633 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:44.632+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:44.636 INFO:teuthology.orchestra.run.smithi070.stdout:5612 trunc from 0xbfb8936 to 0x778a478 2024-09-11T06:19:44.646 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.646 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.646 INFO:teuthology.orchestra.run.smithi070.stdout:5615 write 0x5910774 thru 0x591219d (0x1a2a bytes) 2024-09-11T06:19:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:5616 write 0x756a1c0 thru 0x7579ae2 (0xf923 bytes) 2024-09-11T06:19:44.653 INFO:teuthology.orchestra.run.smithi070.stdout:5620 punch from 0x3e0f23a to 0x3e1e7b9, (0xf57f bytes) 2024-09-11T06:19:44.653 INFO:teuthology.orchestra.run.smithi070.stdout:5621 punch from 0x6aa9208 to 0x6ab435f, (0xb157 bytes) 2024-09-11T06:19:44.653 INFO:teuthology.orchestra.run.smithi070.stdout:5622 read 0x133a73b thru 0x133fba5 (0x546b bytes) 2024-09-11T06:19:44.653 INFO:teuthology.orchestra.run.smithi070.stdout:5623 writesame 0x5e7fc5c thru 0x5e8c4fe data_size 0x27(0xc8a3 bytes) 2024-09-11T06:19:44.657 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.657 INFO:teuthology.orchestra.run.smithi070.stdout:5625 punch from 0x4b054c8 to 0x4b0db82, (0x86ba bytes) 2024-09-11T06:19:44.660 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:44.660 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:44.669 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:44.670 INFO:teuthology.orchestra.run.smithi070.stdout:5626 write 0xd34aa06 thru 0xd350edf (0x64da bytes) 2024-09-11T06:19:44.672 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.673 INFO:teuthology.orchestra.run.smithi070.stdout:5628 write 0x3f088e7 thru 0x3f17ea5 (0xf5bf bytes) 2024-09-11T06:19:44.674 INFO:teuthology.orchestra.run.smithi070.stdout:5630 punch from 0x5aea993 to 0x5af2c66, (0x82d3 bytes) 2024-09-11T06:19:44.674 INFO:teuthology.orchestra.run.smithi070.stdout:5631 writesame 0x6c48017 thru 0x6c4d851 data_size 0x1(0x583b bytes) 2024-09-11T06:19:44.697 INFO:teuthology.orchestra.run.smithi070.stdout:5632 trunc from 0xd350ee0 to 0x50f75f8 2024-09-11T06:19:44.725 INFO:teuthology.orchestra.run.smithi070.stdout:5633 write 0xe2b8171 thru 0xe2bcf37 (0x4dc7 bytes) 2024-09-11T06:19:44.728 INFO:teuthology.orchestra.run.smithi070.stdout:5634 write 0xc0153ac thru 0xc01d4d6 (0x812b bytes) 2024-09-11T06:19:44.731 INFO:teuthology.orchestra.run.smithi070.stdout:5635 read 0xaa22e43 thru 0xaa258ca (0x2a88 bytes) 2024-09-11T06:19:44.731 INFO:teuthology.orchestra.run.smithi070.stdout:5636 writesame 0x84af865 thru 0x84b9c50 data_size 0xd(0xa3ec bytes) 2024-09-11T06:19:44.734 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:44.733+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:44.734 INFO:teuthology.orchestra.run.smithi070.stdout:5637 write 0x6dfbe49 thru 0x6e09ba3 (0xdd5b bytes) 2024-09-11T06:19:44.738 INFO:teuthology.orchestra.run.smithi070.stdout:5638 read 0x378a8f4 thru 0x37961f5 (0xb902 bytes) 2024-09-11T06:19:44.739 INFO:teuthology.orchestra.run.smithi070.stdout:5639 read 0x427ac28 thru 0x427e0bc (0x3495 bytes) 2024-09-11T06:19:44.744 INFO:teuthology.orchestra.run.smithi070.stdout:5640 trunc from 0xe2bcf38 to 0x9e71fd6 2024-09-11T06:19:44.756 INFO:teuthology.orchestra.run.smithi070.stdout:5641 punch from 0x8cb6d99 to 0x8cbc240, (0x54a7 bytes) 2024-09-11T06:19:44.756 INFO:teuthology.orchestra.run.smithi070.stdout:5642 write 0x81dd821 thru 0x81ea858 (0xd038 bytes) 2024-09-11T06:19:44.757 INFO:teuthology.orchestra.run.smithi070.stdout:5643 writesame 0x354c7df thru 0x355628c data_size 0xd(0x9aae bytes) 2024-09-11T06:19:44.767 INFO:teuthology.orchestra.run.smithi070.stdout:5644 write 0xb58ede9 thru 0xb5968c7 (0x7adf bytes) 2024-09-11T06:19:44.772 INFO:teuthology.orchestra.run.smithi070.stdout:5645 punch from 0x892d7f3 to 0x893d337, (0xfb44 bytes) 2024-09-11T06:19:44.778 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:44.778 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:44.781 INFO:teuthology.orchestra.run.smithi070.stdout:5646 write 0xdd00c67 thru 0xdd0c02f (0xb3c9 bytes) 2024-09-11T06:19:44.785 INFO:teuthology.orchestra.run.smithi070.stdout:5648 writesame 0x241468f thru 0x241901e data_size 0x10(0x4990 bytes) 2024-09-11T06:19:44.788 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:44.797 INFO:teuthology.orchestra.run.smithi070.stdout:5651 trunc from 0xdd0c030 to 0x4be1b48 2024-09-11T06:19:44.813 INFO:teuthology.orchestra.run.smithi070.stdout:5652 read 0x2cc9b62 thru 0x2cd0d3a (0x71d9 bytes) 2024-09-11T06:19:44.814 INFO:teuthology.orchestra.run.smithi070.stdout:5653 writesame 0x40d3d6f thru 0x40d4f00 data_size 0x2(0x1192 bytes) 2024-09-11T06:19:44.816 INFO:teuthology.orchestra.run.smithi070.stdout:5655 writesame 0x277f471 thru 0x278835b data_size 0x1(0x8eeb bytes) 2024-09-11T06:19:44.834 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:44.833+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:44.846 INFO:teuthology.orchestra.run.smithi070.stdout:5657 trunc from 0x4be1b48 to 0xecea6f3 2024-09-11T06:19:44.851 INFO:teuthology.orchestra.run.smithi070.stdout:5658 writesame 0xa3cf340 thru 0xa3dc394 data_size 0x1(0xd055 bytes) 2024-09-11T06:19:44.879 INFO:teuthology.orchestra.run.smithi070.stdout:5659 read 0x3ee9221 thru 0x3eeb5ab (0x238b bytes) 2024-09-11T06:19:44.880 INFO:teuthology.orchestra.run.smithi070.stdout:5660 writesame 0x7ec63e thru 0x7fc5dd data_size 0x28(0xffa0 bytes) 2024-09-11T06:19:44.882 INFO:teuthology.orchestra.run.smithi070.stdout:5661 write 0x232c1bd thru 0x233aad4 (0xe918 bytes) 2024-09-11T06:19:44.884 INFO:teuthology.orchestra.run.smithi070.stdout:5663 writesame 0xe887510 thru 0xe891471 data_size 0x2(0x9f62 bytes) 2024-09-11T06:19:44.894 INFO:teuthology.orchestra.run.smithi070.stdout:5664 write 0x25015a7 thru 0x2508d3a (0x7794 bytes) 2024-09-11T06:19:44.896 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:44.896 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:44.897 INFO:teuthology.orchestra.run.smithi070.stdout:5665 read 0x2ae9ee4 thru 0x2af287d (0x899a bytes) 2024-09-11T06:19:44.902 INFO:teuthology.orchestra.run.smithi070.stdout:5666 trunc from 0xecea6f3 to 0xaa93329 2024-09-11T06:19:44.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:44.914 INFO:teuthology.orchestra.run.smithi070.stdout:5667 punch from 0x45376dd to 0x4544c6a, (0xd58d bytes) 2024-09-11T06:19:44.914 INFO:teuthology.orchestra.run.smithi070.stdout:5668 write 0x21b5028 thru 0x21bf61f (0xa5f8 bytes) 2024-09-11T06:19:44.922 INFO:teuthology.orchestra.run.smithi070.stdout:5669 trunc from 0xaa93329 to 0x501f732 2024-09-11T06:19:44.935 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:44.934+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:44.936 INFO:teuthology.orchestra.run.smithi070.stdout:5670 writesame 0x36c4737 thru 0x36cfdb5 data_size 0x57(0xb67f bytes) 2024-09-11T06:19:44.938 INFO:teuthology.orchestra.run.smithi070.stdout:5672 write 0xce24bd thru 0xce3f4d (0x1a91 bytes) 2024-09-11T06:19:44.939 INFO:teuthology.orchestra.run.smithi070.stdout:5673 read 0x35b6f47 thru 0x35c249a (0xb554 bytes) 2024-09-11T06:19:44.940 INFO:teuthology.orchestra.run.smithi070.stdout:5675 write 0x1ea0813 thru 0x1eacc86 (0xc474 bytes) 2024-09-11T06:19:44.941 INFO:teuthology.orchestra.run.smithi070.stdout:5676 read 0x32e8e80 thru 0x32f08f5 (0x7a76 bytes) 2024-09-11T06:19:44.942 INFO:teuthology.orchestra.run.smithi070.stdout:5677 writesame 0xb129ba thru 0xb20631 data_size 0xa6(0xdc78 bytes) 2024-09-11T06:19:44.944 INFO:teuthology.orchestra.run.smithi070.stdout:5678 read 0x39fa329 thru 0x3a024c9 (0x81a1 bytes) 2024-09-11T06:19:44.945 INFO:teuthology.orchestra.run.smithi070.stdout:5680 read 0x3cba6c2 thru 0x3cbea8b (0x43ca bytes) 2024-09-11T06:19:44.945 INFO:teuthology.orchestra.run.smithi070.stdout:5681 read 0x248804 thru 0x24f11e (0x691b bytes) 2024-09-11T06:19:44.945 INFO:teuthology.orchestra.run.smithi070.stdout:5682 read 0x1de1d9d thru 0x1de9d5d (0x7fc1 bytes) 2024-09-11T06:19:44.945 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.945 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.945 INFO:teuthology.orchestra.run.smithi070.stdout:5686 read 0x3280c45 thru 0x32896be (0x8a7a bytes) 2024-09-11T06:19:44.946 INFO:teuthology.orchestra.run.smithi070.stdout:5687 read 0x5eb0d0 thru 0x5fa112 (0xf043 bytes) 2024-09-11T06:19:44.952 INFO:teuthology.orchestra.run.smithi070.stdout:5688 write 0x5870e1a thru 0x58789de (0x7bc5 bytes) 2024-09-11T06:19:44.956 INFO:teuthology.orchestra.run.smithi070.stdout:5690 read 0x28abfd9 thru 0x28af82a (0x3852 bytes) 2024-09-11T06:19:44.969 INFO:teuthology.orchestra.run.smithi070.stdout:5691 write 0xb464e10 thru 0xb471fae (0xd19f bytes) 2024-09-11T06:19:44.973 INFO:teuthology.orchestra.run.smithi070.stdout:5692 read 0x9e38872 thru 0x9e3be9a (0x3629 bytes) 2024-09-11T06:19:44.973 INFO:teuthology.orchestra.run.smithi070.stdout:5695 writesame 0x3f39257 thru 0x3f3f3f7 data_size 0x3(0x61a1 bytes) 2024-09-11T06:19:44.977 INFO:teuthology.orchestra.run.smithi070.stdout:5697 read 0x2e28ffe thru 0x2e2cea9 (0x3eac bytes) 2024-09-11T06:19:44.977 INFO:teuthology.orchestra.run.smithi070.stdout:5700 read 0x5fc88c4 thru 0x5fce9da (0x6117 bytes) 2024-09-11T06:19:44.978 INFO:teuthology.orchestra.run.smithi070.stdout:5701 read 0x9bb0a74 thru 0x9bb84f4 (0x7a81 bytes) 2024-09-11T06:19:44.978 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:44.978 INFO:teuthology.orchestra.run.smithi070.stdout:5703 write 0x3256cc0 thru 0x326488e (0xdbcf bytes) 2024-09-11T06:19:44.980 INFO:teuthology.orchestra.run.smithi070.stdout:5704 read 0x2f06fde thru 0x2f0d6f3 (0x6716 bytes) 2024-09-11T06:19:44.981 INFO:teuthology.orchestra.run.smithi070.stdout:5705 write 0x7269e3 thru 0x734cf2 (0xe310 bytes) 2024-09-11T06:19:44.982 INFO:teuthology.orchestra.run.smithi070.stdout:5707 clone 38 order 25 su 4194304 sc 8 2024-09-11T06:19:45.036 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:45.036+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:45.049 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:45.049 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:45.058 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:45.132 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:19:45.132 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:19:45.132 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T06:19:45.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-11T06:19:45.137 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:45.136+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:45.161 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:45.162 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:45.166 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:19:45.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:45.237 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:45.237+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:45.283 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:45.284 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:45.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:45.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:45.338 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:45.338+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:45.399 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:45.399 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:45.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:45.421 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:45.440 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:45.440 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:45.440 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:45.439+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:45.442 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T06:19:45.441+0000 7fea5acac640 -1 mon.a@0(leader).osd e177 definitely_dead 0 2024-09-11T06:19:45.458 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:45.475 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:45.475 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:45.492 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:45.510 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:45.510 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130410 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10993664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372979178000001, 2024-09-11T06:19:45.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043187259999999998, 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130410 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146584+0000", 2024-09-11T06:19:45.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146592+0000", 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5619999999999998e-06 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146598+0000", 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189643+0000", 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043045091000000001 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189704+0000", 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0911e-05 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189769+0000", 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5745000000000002e-05 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130411 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 11001856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372957036999999, 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043307804999999998, 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130411 2024-09-11T06:19:45.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146605+0000", 2024-09-11T06:19:45.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146613+0000", 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6729999999999998e-06 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146621+0000", 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8849999999999999e-06 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146626+0000", 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9520000000000002e-06 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189802+0000", 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043175603 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189848+0000", 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6465999999999999e-05 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189912+0000", 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3835000000000001e-05 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130444 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10752000~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372928236999996, 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043428937000000001, 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130444 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146635+0000", 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146642+0000", 2024-09-11T06:19:45.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8680000000000001e-06 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146649+0000", 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2319999999999998e-06 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189933+0000", 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043284979000000001 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189982+0000", 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8513000000000001e-05 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190062+0000", 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9929e-05 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130445 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10760192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372900713, 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043549156999999998, 2024-09-11T06:19:45.534 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130445 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146663+0000", 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146678+0000", 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5201000000000001e-05 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146684+0000", 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190086+0000", 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043401281 2024-09-11T06:19:45.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190147+0000", 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1246000000000003e-05 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190210+0000", 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2720999999999998e-05 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130446 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10768384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.538 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372863631000001, 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043660235999999998, 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130446 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146700+0000", 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-06 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146709+0000", 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3520000000000007e-06 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146718+0000", 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6830000000000003e-06 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190233+0000", 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043514440000000001 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190283+0000", 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0178e-05 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190358+0000", 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4796999999999996e-05 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130447 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10776576~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372799710000002, 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043732383999999999, 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130447 2024-09-11T06:19:45.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:45.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146765+0000", 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146782+0000", 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7282000000000002e-05 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146789+0000", 2024-09-11T06:19:45.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7279999999999998e-06 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190386+0000", 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043596843000000003 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190431+0000", 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5751999999999998e-05 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190494+0000", 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2614999999999996e-05 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130448 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10784768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372757974999999, 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043831475000000002, 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130448 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146811+0000", 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146814+0000", 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.543e-06 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146823+0000", 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8699999999999998e-06 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146828+0000", 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190522+0000", 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043694033 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190572+0000", 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0269999999999998e-05 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190635+0000", 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2719999999999996e-05 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130449 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10792960~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372721319, 2024-09-11T06:19:45.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043926146999999999, 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130449 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:45.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8200000000000001e-07 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146842+0000", 2024-09-11T06:19:45.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5910000000000001e-06 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146852+0000", 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0341e-05 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146855+0000", 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190655+0000", 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043800258000000002 2024-09-11T06:19:45.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190706+0000", 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0226999999999999e-05 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190766+0000", 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0517999999999999e-05 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130450 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10801152~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372702113000003, 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044072734000000002, 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130450 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146861+0000", 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3379999999999999e-06 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146865+0000", 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3220000000000003e-06 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146868+0000", 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190792+0000", 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043923845000000003 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190853+0000", 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1008999999999998e-05 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190932+0000", 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9326000000000006e-05 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130451 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10809344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372690079000002, 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044195328999999998, 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130451 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.560 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147086+0000", 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021491899999999999 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147096+0000", 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0217999999999999e-05 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147105+0000", 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147112+0000", 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190954+0000", 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043842032000000003 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191004+0000", 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0482999999999998e-05 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191066+0000", 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2420000000000002e-05 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130452 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10817536~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.372441021, 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044100716999999998, 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130452 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:45.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147905+0000", 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078465999999999996 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147909+0000", 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2549999999999999e-06 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147919+0000", 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0236e-05 2024-09-11T06:19:45.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147927+0000", 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8679999999999999e-06 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191092+0000", 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043164431000000003 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191142+0000", 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9923000000000003e-05 2024-09-11T06:19:45.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191221+0000", 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9344000000000005e-05 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130453 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10825728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.371600463, 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392063000000002, 2024-09-11T06:19:45.568 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130453 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147963+0000", 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.795e-06 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147967+0000", 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9979999999999997e-06 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147970+0000", 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191246+0000", 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043275980999999998 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191291+0000", 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5498999999999999e-05 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191353+0000", 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999994e-05 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130454 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10833920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.572 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.371587273000003, 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043530384999999998, 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130454 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5199999999999998e-07 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147975+0000", 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.195e-06 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147979+0000", 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.196e-06 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147981+0000", 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191374+0000", 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392673 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191441+0000", 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191504+0000", 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3602999999999994e-05 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130455 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10842112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.371576627000003, 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043653780000000003, 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130455 2024-09-11T06:19:45.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147986+0000", 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.35e-06 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147989+0000", 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147992+0000", 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191525+0000", 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043533080000000002 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191577+0000", 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2506999999999997e-05 2024-09-11T06:19:45.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191638+0000", 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0903999999999998e-05 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130456 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10850304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.371566186999999, 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.04379475, 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130456 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149579+0000", 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001583877 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149584+0000", 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9359999999999998e-06 2024-09-11T06:19:45.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149593+0000", 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2429999999999994e-06 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149598+0000", 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0919999999999997e-06 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191663+0000", 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042064987999999998 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191714+0000", 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0506000000000001e-05 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191790+0000", 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130463 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10907648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.369887200999997, 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043098538999999998, 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130463 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149674+0000", 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.28e-07 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149679+0000", 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5449999999999997e-06 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149682+0000", 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.455e-06 2024-09-11T06:19:45.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149685+0000", 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.526e-06 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192662+0000", 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042976939999999998 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192712+0000", 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0682e-05 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192773+0000", 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0163e-05 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130464 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10915840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.369873077000001, 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043257601999999999, 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130464 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149920+0000", 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023134100000000001 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149923+0000", 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000001e-06 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149932+0000", 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7080000000000003e-06 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149939+0000", 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6510000000000001e-06 2024-09-11T06:19:45.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192802+0000", 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042862572000000002 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192861+0000", 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9077999999999999e-05 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192946+0000", 2024-09-11T06:19:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4901999999999995e-05 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130465 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10924032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.369614079999998, 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043129278, 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130465 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:45.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149947+0000", 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.39e-07 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149949+0000", 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.886e-06 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149953+0000", 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8160000000000004e-06 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149956+0000", 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0369999999999999e-06 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192970+0000", 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043013844000000002 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193017+0000", 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6530999999999999e-05 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193076+0000", 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9824999999999997e-05 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130466 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10932224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.369601508999999, 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043272974999999998, 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130466 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151901+0000", 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001941356 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151905+0000", 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000003e-06 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151912+0000", 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0679999999999999e-06 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151916+0000", 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9829999999999998e-06 2024-09-11T06:19:45.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193097+0000", 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041180814000000003 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193161+0000", 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3584000000000007e-05 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193233+0000", 2024-09-11T06:19:45.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2074000000000001e-05 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130516 3.1c 3:3f6bd6e9:::rbd_object_map.116df114867d.000000000000003e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.366399026000003, 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043688850000000001, 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:45.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130516 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:45.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153163+0000", 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8299999999999996e-07 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153168+0000", 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153176+0000", 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:45.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153181+0000", 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3539999999999999e-06 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194609+0000", 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041427972 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194661+0000", 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2308999999999997e-05 2024-09-11T06:19:45.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194883+0000", 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221466 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196734+0000", 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018515039999999999 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196752+0000", 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7558e-05 2024-09-11T06:19:45.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196812+0000", 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9639000000000003e-05 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196851+0000", 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9536999999999998e-05 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:45.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:45.610 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:45.610 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:45.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:45.612 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:45.612 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:45.613 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:45.610+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:45.712 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:45.711+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:45.756 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:45.756 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:45.756 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:45.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:45.849 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:45.848+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:45.908 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:45.908 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:45.908 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:45.908 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:45.908 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:45.914 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:45.913+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:45.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:46.015 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:46.014+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:46.063 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:46.063 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:46.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:46.063 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:46.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.940725702000002, 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.064 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:19:46.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9444808399999998, 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:19:46.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:19:46.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.944429929, 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:19:46.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9442426250000002, 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:19:46.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:19:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9442056650000001, 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.088 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:46.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:19:46.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9441808080000005, 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:19:46.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:19:46.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:19:46.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9441408439999996, 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:19:46.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:19:46.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9441104679999999, 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:19:46.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:19:46.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:46.111 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9440897020000003, 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:19:46.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9440568310000002, 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:19:46.117 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:19:46.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:19:46.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9440369730000002, 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:19:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:19:46.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9440167959999997, 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:46.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:19:46.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:19:46.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:19:46.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9440054309999999, 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:19:46.134 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:19:46.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:19:46.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:19:46.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9439779939999999, 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:19:46.140 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:46.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:19:46.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:19:46.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:19:46.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:46.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9439437379999998, 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:19:46.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9439302749999996, 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:19:46.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:19:46.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9438985459999998, 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:19:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.163 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9438863880000001, 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9438615390000002, 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9438483099999999, 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.178 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:46.179 INFO:teuthology.orchestra.run.smithi070.stderr:marked out osd.3. 2024-09-11T06:19:46.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:46.180 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:46.178+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:46.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:46.280+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:46.285 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:19:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:19:46.285 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.111159707, 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.111181744, 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:19:46.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:19:46.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.108756326, 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.108819292, 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:19:46.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:46.294 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 2 2024-09-11T06:19:46.294 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:46.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:46.381 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:46.379+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:46.397 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:46.398 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:46.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:46.482 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:46.482+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:46.551 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 146.74668047700001, 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:19:46.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:19:46.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90442 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 192512~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.558 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.41032654, 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951583000000001, 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90442 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139768+0000", 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0600000000000001e-07 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139771+0000", 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2369999999999999e-06 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139777+0000", 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9780000000000002e-06 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139781+0000", 2024-09-11T06:19:46.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162432+0000", 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022650323999999999 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162504+0000", 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2476000000000002e-05 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162719+0000", 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215322 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.410307200000005, 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:19:46.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.567 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.410288851000004, 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:19:46.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.410270667000006, 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:19:46.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:19:46.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.410251880999994, 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.410232882000003, 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.410204293000007, 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:19:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.409991167000001, 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:19:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:19:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90567 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 157696~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407436279999999, 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023047874999999999, 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90567 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142658+0000", 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142659+0000", 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5000000000000003e-07 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142661+0000", 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5780000000000001e-06 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142669+0000", 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142675+0000", 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2920000000000003e-06 2024-09-11T06:19:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165437+0000", 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022762661999999999 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165521+0000", 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3578999999999994e-05 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165706+0000", 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018512300000000001 2024-09-11T06:19:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407412589000003, 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407392563000002, 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:19:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407351008000006, 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407327065000004, 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:19:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:19:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407305656999995, 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:19:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407284868999994, 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:19:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407264834000003, 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:19:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407244696999996, 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:19:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:19:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:19:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:19:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:19:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407222700000005, 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:19:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:19:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.407202635000004, 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:19:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:46.650 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:46.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:46.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:46.651+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:46.752 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:46.750+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:46.755 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:46.755 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:46.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:46.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:46.852+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:46.905 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:46.906 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:46.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:46.958 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:46.956+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:47.017 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 167.39632546999999, 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:19:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:19:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:19:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 167.101889892, 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:19:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.835326698000003, 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:19:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.871644106999995, 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:19:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:19:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.871626680999995, 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:19:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:19:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.871609425000003, 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.897399227999998, 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:19:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.897306526000001, 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.897100715999997, 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:19:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:19:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.897015148999998, 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.896801891000003, 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:19:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:19:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.896718571999997, 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:19:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.896461688999999, 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.896400249999999, 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.896154424999999, 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:19:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.896086298, 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:19:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:19:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:19:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.895818636000001, 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:19:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:19:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.895746596000002, 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:19:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.895575837000003, 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:19:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:19:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:19:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.895470615999997, 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:19:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:19:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:47.121 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:47.122 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:47.123 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:47.121+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:47.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:19:47.229 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:47.227+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:47.245 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:47.245 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:47.245 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:47.254 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:47.324 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:47.322+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:47.357 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:47.357 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:47.357 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:47.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:47.425 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:47.423+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:47.470 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124091 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074962475, 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038834586999999997, 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124091 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393930+0000", 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393931+0000", 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393934+0000", 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.055e-06 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393936+0000", 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432564+0000", 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038628026000000003 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432650+0000", 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5545999999999997e-05 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432764+0000", 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011411199999999999 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124092 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:47.475 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074952994, 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039050738000000002, 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124092 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:47.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393940+0000", 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0699999999999999e-06 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393943+0000", 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393945+0000", 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.356e-06 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432796+0000", 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038850253000000001 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432883+0000", 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7287999999999995e-05 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432990+0000", 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106586 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124093 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074943419999997, 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039266809999999999, 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124093 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393949+0000", 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4600000000000001e-07 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393950+0000", 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.105e-06 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393953+0000", 2024-09-11T06:19:47.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.959e-06 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393955+0000", 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.605e-06 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433033+0000", 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039077685000000001 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433095+0000", 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2451000000000002e-05 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433215+0000", 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119759 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124094 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2621440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074933729999998, 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039472198, 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124094 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.485 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5499999999999999e-07 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393964+0000", 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3510000000000001e-06 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393969+0000", 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6080000000000003e-06 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393974+0000", 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5560000000000001e-06 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433238+0000", 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039264518999999998 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433322+0000", 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3805000000000001e-05 2024-09-11T06:19:47.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433430+0000", 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010810399999999999 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124095 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2629632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074911770999996, 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039657393999999999, 2024-09-11T06:19:47.489 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124095 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393981+0000", 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393983+0000", 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393988+0000", 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393992+0000", 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0679999999999998e-06 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433471+0000", 2024-09-11T06:19:47.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039478924999999998 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433531+0000", 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9883000000000002e-05 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433637+0000", 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106449 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124096 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2637824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074894509000003, 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039912982999999999, 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124096 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393998+0000", 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:47.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393999+0000", 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.764e-06 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394004+0000", 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394008+0000", 2024-09-11T06:19:47.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.092e-06 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433714+0000", 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039705419999999998 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433804+0000", 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0447999999999999e-05 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433910+0000", 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010616999999999999 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124097 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2646016~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074876875000001, 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040088436999999998, 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.498 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124097 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:47.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394017+0000", 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394023+0000", 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9449999999999998e-06 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394028+0000", 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433952+0000", 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039924460000000002 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434009+0000", 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6860000000000001e-05 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434103+0000", 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4455000000000003e-05 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124098 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:47.502 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074859005, 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040258124999999999, 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124098 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:47.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394035+0000", 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6780000000000001e-06 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394040+0000", 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1540000000000001e-06 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394044+0000", 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2189999999999998e-06 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434130+0000", 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040085549999999998 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434208+0000", 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7865000000000001e-05 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434291+0000", 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3347e-05 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124099 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074842636, 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040461951000000003, 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124099 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394050+0000", 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.89e-07 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394052+0000", 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394057+0000", 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7529999999999998e-06 2024-09-11T06:19:47.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394063+0000", 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434323+0000", 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040260038999999997 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434378+0000", 2024-09-11T06:19:47.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5631999999999999e-05 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434511+0000", 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013283699999999999 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124100 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074809661000003, 2024-09-11T06:19:47.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040582739999999999, 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124100 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:47.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394083+0000", 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394087+0000", 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000004e-06 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394093+0000", 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394098+0000", 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9860000000000002e-06 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434548+0000", 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040450016999999998 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434595+0000", 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6255999999999999e-05 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434665+0000", 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0338000000000003e-05 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.515 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124101 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074786762999999, 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040783649999999998, 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124101 2024-09-11T06:19:47.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394107+0000", 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394113+0000", 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8440000000000003e-06 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394117+0000", 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.335e-06 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434695+0000", 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040577692999999998 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434783+0000", 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7538000000000001e-05 2024-09-11T06:19:47.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434889+0000", 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105989 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124102 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074768495000001, 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040992853000000003, 2024-09-11T06:19:47.520 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124102 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394124+0000", 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394126+0000", 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394131+0000", 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6879999999999996e-06 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394136+0000", 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5430000000000004e-06 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434919+0000", 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040782773000000001 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435005+0000", 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6594000000000005e-05 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435116+0000", 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110776 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124103 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074750096999999, 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041211651000000002, 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124103 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394144+0000", 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7689999999999999e-06 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394150+0000", 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6699999999999999e-06 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394154+0000", 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:19:47.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435146+0000", 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040991684 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435239+0000", 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3428000000000001e-05 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435353+0000", 2024-09-11T06:19:47.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114219 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124104 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074731984000003, 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041465574999999998, 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.529 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124104 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394162+0000", 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.776e-06 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394168+0000", 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7080000000000002e-06 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394172+0000", 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5059999999999997e-06 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435385+0000", 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041212998000000001 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435477+0000", 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1528999999999997e-05 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435625+0000", 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148677 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124105 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.533 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074714106999998, 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041619452000000001, 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124105 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394180+0000", 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0930000000000001e-06 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394186+0000", 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5389999999999998e-06 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394191+0000", 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7039999999999999e-06 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435663+0000", 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041471806 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435721+0000", 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7655999999999998e-05 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435797+0000", 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6247000000000004e-05 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.537 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124106 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074690316000002, 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041713447000000001, 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124106 2024-09-11T06:19:47.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394204+0000", 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394210+0000", 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2269999999999998e-06 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394215+0000", 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435816+0000", 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041600683999999999 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435858+0000", 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2518999999999997e-05 2024-09-11T06:19:47.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435915+0000", 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6514000000000001e-05 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124107 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074670546999997, 2024-09-11T06:19:47.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041835280000000002, 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124107 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:47.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394222+0000", 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394223+0000", 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.793e-06 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394229+0000", 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394233+0000", 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:47.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435931+0000", 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041697761 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435972+0000", 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0806000000000002e-05 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436057+0000", 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4602000000000001e-05 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124108 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074652825999998, 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042155791999999997, 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.547 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.548 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124108 2024-09-11T06:19:47.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.548 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:47.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394241+0000", 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0109999999999999e-06 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394247+0000", 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8810000000000001e-06 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394252+0000", 2024-09-11T06:19:47.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436174+0000", 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041922012000000002 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436274+0000", 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100054 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436395+0000", 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012093499999999999 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124109 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 43.074634334999999, 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042294403000000001, 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.552 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124109 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394258+0000", 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394269+0000", 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0974e-05 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394275+0000", 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3450000000000002e-06 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394280+0000", 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.826e-06 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436426+0000", 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042146175000000001 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436472+0000", 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436552+0000", 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0075999999999997e-05 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.9826363550000003, 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:47.557 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:19:47.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:19:47.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:47.563 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:47.564 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:47.565 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:47.565 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:47.564+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:47.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:47.666 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:47.665+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:47.708 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:47.708 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:47.708 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:47.708 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:47.717 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:47.733 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:47.733 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:47.749 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:47.765 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:47.765 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:47.767 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:47.765+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:47.781 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:47.797 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:47.817 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:47.817 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:47.834 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:47.834 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:47.850 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:47.851 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:47.861 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:47.861 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:47.870 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:47.903 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:47.901+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:47.969 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:47.968+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:47.972 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:47.972 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:47.981 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:48.070 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:48.069+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:48.084 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:48.085 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:48.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:48.171 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:48.170+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:19:48.254 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:48.254 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:48.265 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:48.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:48.309+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:48.373 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:48.373+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:48.384 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:48.384 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:48.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:48.475 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:48.473+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:48.557 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:48.558 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:48.568 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:48.612 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:48.611+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:48.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:48.676+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:48.693 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:48.693 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:48.703 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:48.778 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:48.776+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:48.855 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:48.855 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:48.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:48.910 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:48.908+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:48.971 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:48.971 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:48.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:48.981 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:48.979+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:49.081 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:49.080+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:49.123 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:49.123 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:49.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:49.181 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:49.179+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:49.243 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:49.243 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:49.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:49.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:49.282+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:49.384 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:49.382+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:49.395 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:49.395 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:49.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:49.488 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:49.487+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:49.547 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:49.547 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:49.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:49.596 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:49.595+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:49.685 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:49.684+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:49.698 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:49.698 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:49.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:49.791 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:49.790+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:49.850 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:49.850 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:49.859 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:49.862 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:49.900 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:49.899+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:49.988 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:49.987+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:50.005 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:50.005 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:50.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:50.022 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:50.022 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:50.039 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:50.039 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:50.056 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:50.056 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:50.072 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:50.072 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:50.088 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:50.087+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:50.094 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:50.094 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:50.111 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:50.112 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:50.129 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:50.129 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:50.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:50.129 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:50.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 150.323127016, 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:19:50.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:19:50.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90443 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 204800~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.986753738999994, 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023322104999999999, 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90443 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.136 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139787+0000", 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139788+0000", 2024-09-11T06:19:50.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139790+0000", 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9549999999999999e-06 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139795+0000", 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8560000000000003e-06 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139800+0000", 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162751+0000", 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022951247000000001 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.162821+0000", 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0127000000000001e-05 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163109+0000", 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028801100000000002 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90444 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 217088~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.986735390000007, 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023717611, 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90444 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139806+0000", 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9200000000000002e-07 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139808+0000", 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139814+0000", 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139818+0000", 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4850000000000003e-06 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163141+0000", 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023323030000000002 2024-09-11T06:19:50.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163213+0000", 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2265e-05 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163523+0000", 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030970900000000003 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90445 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 229376~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.986717205999994, 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025211786999999999, 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90445 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139824+0000", 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139826+0000", 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1019999999999999e-06 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139832+0000", 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7490000000000004e-06 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139837+0000", 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163557+0000", 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023720358 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163629+0000", 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2000000000000002e-05 2024-09-11T06:19:50.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165036+0000", 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001406568 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90446 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 241664~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.986698419999996, 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024414159000000001, 2024-09-11T06:19:50.149 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90446 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139843+0000", 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139845+0000", 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:50.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139851+0000", 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8900000000000004e-06 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139855+0000", 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.163994+0000", 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024138407000000001 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164064+0000", 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0531999999999995e-05 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164257+0000", 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019244600000000001 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90447 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 253952~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:50.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.986679421000005, 2024-09-11T06:19:50.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024677754999999999, 2024-09-11T06:19:50.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90447 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139862+0000", 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139864+0000", 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:19:50.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139870+0000", 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7950000000000004e-06 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139874+0000", 2024-09-11T06:19:50.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164284+0000", 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024409587999999999 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164355+0000", 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1254000000000006e-05 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164539+0000", 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018397199999999999 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90448 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 266240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.986650831999995, 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024931548000000001, 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90448 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139890+0000", 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.139891+0000", 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140072+0000", 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018136699999999999 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140083+0000", 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1129e-05 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140090+0000", 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3189999999999997e-06 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164567+0000", 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024476947999999998 2024-09-11T06:19:50.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164638+0000", 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1008999999999997e-05 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164822+0000", 2024-09-11T06:19:50.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183296 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90449 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 278528~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.986437706000004, 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025003480000000002, 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90449 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140103+0000", 2024-09-11T06:19:50.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140104+0000", 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140111+0000", 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1189999999999999e-06 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140119+0000", 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0609999999999996e-06 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.140125+0000", 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9000000000000003e-06 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164847+0000", 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024721842000000001 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.164922+0000", 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5403999999999998e-05 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165107+0000", 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000184413 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90568 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 169984~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983859128000006, 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023336114000000002, 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90568 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142682+0000", 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142685+0000", 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5040000000000001e-06 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142690+0000", 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7629999999999997e-06 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142695+0000", 2024-09-11T06:19:50.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8919999999999999e-06 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165736+0000", 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023040903000000001 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.165814+0000", 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8039000000000003e-05 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166018+0000", 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020365300000000001 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90569 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 182272~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983839102000005, 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023660569999999999, 2024-09-11T06:19:50.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90569 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142702+0000", 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142705+0000", 2024-09-11T06:19:50.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4559999999999999e-06 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142711+0000", 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7000000000000002e-06 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142717+0000", 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.113e-06 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166047+0000", 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023330898999999999 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166133+0000", 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5847000000000007e-05 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166362+0000", 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022915500000000001 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90570 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 194560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983797546999995, 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023959286999999999, 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90570 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142743+0000", 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142744+0000", 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0200000000000002e-07 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142747+0000", 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142754+0000", 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4019999999999996e-06 2024-09-11T06:19:50.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142760+0000", 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9179999999999999e-06 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166393+0000", 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023633271000000001 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166487+0000", 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3879e-05 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166703+0000", 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021568600000000001 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90571 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 206848~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983773604000007, 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024286143999999999, 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90571 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142767+0000", 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142768+0000", 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142770+0000", 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.193e-06 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142777+0000", 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5400000000000001e-06 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142782+0000", 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5990000000000001e-06 2024-09-11T06:19:50.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166743+0000", 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023961028999999998 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.166828+0000", 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5140000000000001e-05 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167054+0000", 2024-09-11T06:19:50.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000225205 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90572 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 219136~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983752195999998, 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024575443999999998, 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90572 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:50.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142789+0000", 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1e-07 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142791+0000", 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.08e-06 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142798+0000", 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.511e-06 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142803+0000", 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8910000000000003e-06 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167086+0000", 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024283549000000001 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167165+0000", 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8541999999999994e-05 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167364+0000", 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019956100000000001 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90573 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 231424~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983731407999997, 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024856601999999998, 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90573 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142810+0000", 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7399999999999998e-07 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142812+0000", 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2500000000000001e-06 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142819+0000", 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142824+0000", 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167397+0000", 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024573397 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167475+0000", 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8207000000000005e-05 2024-09-11T06:19:50.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167666+0000", 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000190755 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90574 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 243712~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:50.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983711373000006, 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025145218, 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90574 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142830+0000", 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142832+0000", 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.103e-06 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142838+0000", 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3459999999999999e-06 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142843+0000", 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9640000000000002e-06 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167696+0000", 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024852664999999999 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167777+0000", 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0687999999999997e-05 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.167975+0000", 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019809100000000001 2024-09-11T06:19:50.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90575 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983691235999999, 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025422450999999999, 2024-09-11T06:19:50.201 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90575 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142850+0000", 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142852+0000", 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.204e-06 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142860+0000", 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142865+0000", 2024-09-11T06:19:50.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168007+0000", 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025142258000000001 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168075+0000", 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8269000000000007e-05 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168272+0000", 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019684699999999999 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90576 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983669238999994, 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025707979999999998, 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90576 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142872+0000", 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142874+0000", 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.289e-06 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142881+0000", 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3180000000000003e-06 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142886+0000", 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168302+0000", 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025415905999999999 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168378+0000", 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5896000000000007e-05 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168580+0000", 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201953 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90577 3.15 3:aae8301f:::rbd_data.116d94c57ffc.0000000000000000:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.983649173999993, 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025986708000000001, 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90577 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142892+0000", 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142908+0000", 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5985e-05 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142916+0000", 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3390000000000004e-06 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.142921+0000", 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168607+0000", 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025685824999999999 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168689+0000", 2024-09-11T06:19:50.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1859000000000003e-05 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.168878+0000", 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018980200000000001 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:19:50.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.952693719, 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:19:50.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:19:50.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.221 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9502903379999998, 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:19:50.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:19:50.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.227 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:50.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:19:50.228 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:50.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:50.229 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:50.230 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:50.231 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:50.227+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:50.249 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-11T06:19:50.328 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:50.327+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:50.376 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:50.376 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:50.376 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:50.376 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:50.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:50.429 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:50.428+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:50.520 INFO:teuthology.orchestra.run.smithi070.stdout:5708 read 0x685d973 thru 0x685f9bb (0x2049 bytes) 2024-09-11T06:19:50.520 INFO:teuthology.orchestra.run.smithi070.stdout:5709 punch from 0x8e99b51 to 0x8e9b00e, (0x14bd bytes) 2024-09-11T06:19:50.524 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:19:50.524 INFO:teuthology.orchestra.run.smithi070.stdout:5712 clone 39 order 19 su 2048 sc 8 2024-09-11T06:19:50.530 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:50.529+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:50.534 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:50.534 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:50.534 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:50.534 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:50.534 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:50.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:50.631 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:50.630+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 171.06851262699999, 2024-09-11T06:19:50.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:19:50.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 170.774077049, 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:19:50.697 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:19:50.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:19:50.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:19:50.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 85.507513854999999, 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:19:50.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:19:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 80.543831264000005, 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:19:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 80.543813838000005, 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:19:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:19:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 80.543796581999999, 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.569586385000001, 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:19:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.569493682999997, 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:19:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.569287873, 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.569202306000001, 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.568989047999999, 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:19:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:19:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:19:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:19:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.568905729000001, 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:19:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:19:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:19:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.568648846000002, 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:19:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.568587407000003, 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:19:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.568341582000002, 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.568273455000003, 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:19:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:19:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.568005792999998, 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:19:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.567933752999998, 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:19:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.567762993999999, 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:19:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.567657773000001, 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:19:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:19:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:19:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:50.789 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:50.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:50.791 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:50.790+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:50.891 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:50.890+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:50.905 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:50.905 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:50.905 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:50.905 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:50.914 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:50.992 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:50.991+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:51.017 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:51.017 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:51.017 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:51.026 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:51.092 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:51.092+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124091 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736422771000001, 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038834586999999997, 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.132 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124091 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393929+0000", 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393930+0000", 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4299999999999999e-07 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393931+0000", 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393934+0000", 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.055e-06 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393936+0000", 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4660000000000002e-06 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432564+0000", 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038628026000000003 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432650+0000", 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5545999999999997e-05 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432764+0000", 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011411199999999999 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.137 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124092 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.137 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:51.137 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736413290000002, 2024-09-11T06:19:51.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039050738000000002, 2024-09-11T06:19:51.139 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124092 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:51.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393939+0000", 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3999999999999998e-07 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393940+0000", 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0699999999999999e-06 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393943+0000", 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9450000000000002e-06 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393945+0000", 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.356e-06 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432796+0000", 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038850253000000001 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432883+0000", 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7287999999999995e-05 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.432990+0000", 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106586 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.143 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124093 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736403715999998, 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039266809999999999, 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.144 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124093 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393948+0000", 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393949+0000", 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4600000000000001e-07 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393950+0000", 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.105e-06 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393953+0000", 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.959e-06 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393955+0000", 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.605e-06 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433033+0000", 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039077685000000001 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433095+0000", 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2451000000000002e-05 2024-09-11T06:19:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433215+0000", 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000119759 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124094 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2621440~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736394025999999, 2024-09-11T06:19:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039472198, 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124094 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393958+0000", 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5499999999999999e-07 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393964+0000", 2024-09-11T06:19:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3510000000000001e-06 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393969+0000", 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6080000000000003e-06 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393974+0000", 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5560000000000001e-06 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433238+0000", 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039264518999999998 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433322+0000", 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3805000000000001e-05 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433430+0000", 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010810399999999999 2024-09-11T06:19:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124095 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2629632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736372066999998, 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039657393999999999, 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124095 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393980+0000", 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393981+0000", 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5900000000000002e-07 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393983+0000", 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0030000000000001e-06 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393988+0000", 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6069999999999998e-06 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393992+0000", 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0679999999999998e-06 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433471+0000", 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039478924999999998 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433531+0000", 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9883000000000002e-05 2024-09-11T06:19:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433637+0000", 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106449 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124096 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2637824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736354804999998, 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039912982999999999, 2024-09-11T06:19:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124096 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:19:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393998+0000", 2024-09-11T06:19:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393999+0000", 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.764e-06 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394004+0000", 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394008+0000", 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.092e-06 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433714+0000", 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039705419999999998 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433804+0000", 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0447999999999999e-05 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433910+0000", 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010616999999999999 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124097 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2646016~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736337171000002, 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040088436999999998, 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124097 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:19:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:19:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394017+0000", 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394023+0000", 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9449999999999998e-06 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394028+0000", 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433952+0000", 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039924460000000002 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434009+0000", 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6860000000000001e-05 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434103+0000", 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4455000000000003e-05 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124098 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736319301000002, 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040258124999999999, 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124098 2024-09-11T06:19:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394035+0000", 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6780000000000001e-06 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394040+0000", 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1540000000000001e-06 2024-09-11T06:19:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394044+0000", 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2189999999999998e-06 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434130+0000", 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040085549999999998 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434208+0000", 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7865000000000001e-05 2024-09-11T06:19:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434291+0000", 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3347e-05 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124099 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736302932000001, 2024-09-11T06:19:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040461951000000003, 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124099 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394050+0000", 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.89e-07 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394052+0000", 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:19:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394057+0000", 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7529999999999998e-06 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394063+0000", 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434323+0000", 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040260038999999997 2024-09-11T06:19:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434378+0000", 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5631999999999999e-05 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434511+0000", 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013283699999999999 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124100 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736269956999998, 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040582739999999999, 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124100 2024-09-11T06:19:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394083+0000", 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394087+0000", 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000004e-06 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394093+0000", 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394098+0000", 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9860000000000002e-06 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434548+0000", 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040450016999999998 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434595+0000", 2024-09-11T06:19:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6255999999999999e-05 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434665+0000", 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0338000000000003e-05 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124101 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736247059, 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040783649999999998, 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124101 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394107+0000", 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394113+0000", 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8440000000000003e-06 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394117+0000", 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.335e-06 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434695+0000", 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040577692999999998 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434783+0000", 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7538000000000001e-05 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434889+0000", 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105989 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124102 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736228791000002, 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040992853000000003, 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124102 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394124+0000", 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394126+0000", 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394131+0000", 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6879999999999996e-06 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394136+0000", 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5430000000000004e-06 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434919+0000", 2024-09-11T06:19:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040782773000000001 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435005+0000", 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6594000000000005e-05 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435116+0000", 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110776 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124103 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736210393, 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041211651000000002, 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124103 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394144+0000", 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7689999999999999e-06 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394150+0000", 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6699999999999999e-06 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394154+0000", 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435146+0000", 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040991684 2024-09-11T06:19:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435239+0000", 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3428000000000001e-05 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435353+0000", 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114219 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124104 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736192279999997, 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041465574999999998, 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124104 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394162+0000", 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.776e-06 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394168+0000", 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7080000000000002e-06 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394172+0000", 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5059999999999997e-06 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435385+0000", 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041212998000000001 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435477+0000", 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1528999999999997e-05 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435625+0000", 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148677 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124105 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736174403, 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041619452000000001, 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124105 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394180+0000", 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0930000000000001e-06 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394186+0000", 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5389999999999998e-06 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394191+0000", 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7039999999999999e-06 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435663+0000", 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041471806 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435721+0000", 2024-09-11T06:19:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7655999999999998e-05 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435797+0000", 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6247000000000004e-05 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124106 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736150612000003, 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041713447000000001, 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124106 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394204+0000", 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394210+0000", 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2269999999999998e-06 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394215+0000", 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435816+0000", 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041600683999999999 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435858+0000", 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2518999999999997e-05 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435915+0000", 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6514000000000001e-05 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124107 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736130842999998, 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041835280000000002, 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124107 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394222+0000", 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394223+0000", 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.793e-06 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394229+0000", 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:19:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394233+0000", 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435931+0000", 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041697761 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435972+0000", 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0806000000000002e-05 2024-09-11T06:19:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436057+0000", 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4602000000000001e-05 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124108 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736113121999999, 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042155791999999997, 2024-09-11T06:19:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124108 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394241+0000", 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0109999999999999e-06 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394247+0000", 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8810000000000001e-06 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394252+0000", 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436174+0000", 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041922012000000002 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436274+0000", 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100054 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436395+0000", 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012093499999999999 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124109 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 46.736094631, 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042294403000000001, 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124109 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394258+0000", 2024-09-11T06:19:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394269+0000", 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0974e-05 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394275+0000", 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3450000000000002e-06 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394280+0000", 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.826e-06 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436426+0000", 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042146175000000001 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436472+0000", 2024-09-11T06:19:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436552+0000", 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0075999999999997e-05 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:19:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 13.644096651, 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:19:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.229 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:51.230 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7] out_osds: [3] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:19:51.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T06:19:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:19:51.232 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:51.232 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:51.229+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:51.332 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:51.331+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:51.375 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:51.376 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:51.376 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:51.376 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:51.384 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:51.432 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:51.432+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:51.487 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:51.487 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:51.488 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:51.488 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:51.497 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:51.538 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:51.537+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:51.634 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:51.634+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:51.641 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:51.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.296026631000004, 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.192102445000003, 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:19:51.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:19:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.192076094999997, 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:19:51.654 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:19:51.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.192055615000001, 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:19:51.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:19:51.663 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.192036901000002, 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.664 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:19:51.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:19:51.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183306066999997, 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.669 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:51.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183272483000003, 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:19:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:19:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183259653999997, 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:19:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:19:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183249517, 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:19:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183238699, 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:19:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183228819, 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:19:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183219088000001, 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:19:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:19:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183209470000001, 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:19:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183199655999999, 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:19:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:19:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:19:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183184289000003, 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:19:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:19:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.183173987000004, 2024-09-11T06:19:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:19:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.181473703999998, 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:19:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.175328704999998, 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:19:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.175319209000001, 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 47.175309650000003, 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:19:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:51.750 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:51.751 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:51.752 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:51.750+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:51.852 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:51.851+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:51.895 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:51.895 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:51.896 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:51.896 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:51.904 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:51.953 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:51.952+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:52.007 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:52.007 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:52.007 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:52.008 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:52.008 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:52.016 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:52.053 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:52.052+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:52.120 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:52.120 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.000373432000004, 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:52.121 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:19:52.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.127 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.000315886000003, 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.128 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:19:52.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:19:52.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.133 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.000290376999999, 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.134 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:52.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:19:52.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.000067209000001, 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.140 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:19:52.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:52.146 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.000032543000003, 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:52.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:19:52.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:19:52.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.152 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.000008381000001, 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:19:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:19:52.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:19:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:19:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:19:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:19:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.99975783, 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:19:52.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.166 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.999730448999998, 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.167 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:52.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:19:52.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.172 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.999707309999998, 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:19:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:19:52.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.999478726, 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.178 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:19:52.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.999441591999997, 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:19:52.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.999414403000003, 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:19:52.189 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:52.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:52.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:19:52.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.999145798000001, 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.195 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:52.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.999104496999998, 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:19:52.200 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:19:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:19:52.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.999079389999999, 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:52.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:19:52.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.998838626000001, 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.212 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.998804319999998, 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:19:52.217 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:52.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:19:52.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:19:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.998783553000003, 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:19:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:19:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.998553029999997, 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:19:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:19:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118795 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 51.998511862000001, 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99200256799999997, 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118795 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120454+0000", 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.06e-07 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120457+0000", 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459999999999998e-06 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120464+0000", 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1350000000000003e-06 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120470+0000", 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:19:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120511+0000", 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1316000000000002e-05 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120517+0000", 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6790000000000002e-06 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112451+0000", 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.991934078 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112456+0000", 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:52.240 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:52.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:52.242 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T06:19:52.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:52.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T06:19:52.244 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:52.240+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:52.341 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:52.341+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:52.347 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:52.347 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:52.347 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:52.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:52.405 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:52.405 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:52.423 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:52.423 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:52.440 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:52.441 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:52.443 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:52.442+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:52.457 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:52.457 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:52.457 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:52.458 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:52.458 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:52.458 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:52.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:52.473 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:52.474 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:52.490 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:52.490 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:52.506 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:52.506 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:52.522 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:52.523 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:52.575 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:52.574+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:52.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:52.645 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:52.644+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:52.683 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:52.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:52.746 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:52.745+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:52.835 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:52.835 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:52.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:52.846 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:52.846+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:52.948 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:52.947+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:52.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:53.049 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:53.048+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:53.098 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:53.098 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:53.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:53.152 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:53.151+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T06:19:53.215 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:53.215 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:53.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:53.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T06:19:53.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:19:53.270 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:53.269+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:53.351 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:53.351+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:53.376 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:53.376 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:53.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:53.452 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:53.451+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:53.492 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:53.492 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:53.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:53.553 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:53.553+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:53.645 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:53.645 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:53.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:53.654 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:53.653+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:53.755 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:53.754+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:53.799 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:53.799 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:53.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:53.855 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:53.855+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:53.911 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:53.911 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:53.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:53.962 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:53.961+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:54.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:54.056+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:54.063 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:54.063 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:54.072 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:54.158 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:54.156+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:54.176 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:54.176 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:54.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:54.210 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:19:54.214 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T06:19:54.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T06:19:54.258 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:54.258+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:54.304 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:54.305 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:54.313 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:54.398 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:54.397+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:54.460 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:54.460 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:54.460 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:54.459+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:54.469 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:54.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:54.579 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:54.578+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:54.621 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:54.621 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:54.630 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:54.662 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:54.661+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:54.716 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:54.737 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:54.737 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:54.745 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:54.746 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:54.747 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:54.763 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:19:54.762+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:19:54.797 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:54.820 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:54.843 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:54.843 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:54.851 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:54.851 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:54.860 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:54.870 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:54.871 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:54.894 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:54.895 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:54.904 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:54.903+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:54.919 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:54.919 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:54.964 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:54.963+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 95.622183264, 2024-09-11T06:19:54.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:54.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:19:54.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:54.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:19:54.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:19:54.973 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.973 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:54.973 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.973 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:54.973 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:54.974 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.518259078, 2024-09-11T06:19:54.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:19:54.974 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:54.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:19:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:54.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.518232728000001, 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:54.979 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:54.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:19:54.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:54.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:19:54.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.518212247999998, 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:19:54.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:54.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:19:54.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:54.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:19:54.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:19:54.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:54.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:19:54.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:19:54.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.990 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:54.991 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.991 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:54.991 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:54.991 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.518193533999998, 2024-09-11T06:19:54.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:19:54.992 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:54.992 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:54.992 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:54.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:54.992 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:19:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:54.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:19:54.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:54.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:54.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:19:54.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:54.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:54.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:19:54.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:19:54.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:54.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:19:54.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:19:54.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:54.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:19:54.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:19:54.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.5094627, 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:54.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:55.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:19:55.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509429116, 2024-09-11T06:19:55.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:19:55.005 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.005 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.005 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.005 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:19:55.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509416287000001, 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.010 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:19:55.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.014 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509406149999997, 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.015 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.019 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509395331999997, 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:55.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:55.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:19:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:19:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:19:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:19:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:19:55.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:19:55.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.029 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.029 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.029 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.029 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:55.030 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509385451999997, 2024-09-11T06:19:55.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:19:55.030 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.030 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.030 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.030 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.031 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.031 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:19:55.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.031 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:55.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:55.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:19:55.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:55.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:19:55.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:19:55.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:19:55.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:19:55.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:19:55.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:19:55.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:19:55.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:19:55.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:19:55.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:19:55.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:19:55.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509375720999998, 2024-09-11T06:19:55.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:19:55.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509366102999998, 2024-09-11T06:19:55.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:55.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509356289000003, 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.048 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:19:55.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:19:55.052 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.509340922, 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:19:55.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.50933062, 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.058 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:19:55.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.507630337000002, 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:19:55.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.501485338000002, 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.067 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:19:55.071 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.501475841999998, 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.072 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:19:55.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 50.501466282999999, 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:19:55.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.081 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.082 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:55.083 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:55.084 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:55.082+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T06:19:55.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T06:19:55.224 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:55.223+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:55.232 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:55.232 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:55.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.232 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:152248 3.12 3:4e3807e2:::rbd_object_map.116ddf3f5156.0000000000000050:head [call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:19:55.232 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.228390+0000", 2024-09-11T06:19:55.232 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.00089263700000000005, 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00092350799999999997, 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for sub ops", 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 152248 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228390+0000", 2024-09-11T06:19:55.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228390+0000", 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228392+0000", 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.666e-06 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228401+0000", 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228419+0000", 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7526000000000001e-05 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228444+0000", 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4892000000000002e-05 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228505+0000", 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1033999999999999e-05 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228578+0000", 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2865000000000001e-05 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 7", 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.228818+0000", 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00024009500000000001 2024-09-11T06:19:55.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.237 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.237 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.237 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.237 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-11T06:19:55.237 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 1 2024-09-11T06:19:55.237 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:55.240 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:19:55.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:55.284+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:55.353 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:55.354 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:55.354 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:55.354 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:55.354 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:55.364 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:19:55.406 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:55.405+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:55.487 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:55.486+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:55.536 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:55.536 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:55.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:55.536 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.415285605999998, 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:19:55.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:19:55.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.415228059999997, 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.542 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:19:55.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:19:55.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.415202551, 2024-09-11T06:19:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:19:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.552 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414979383000002, 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:55.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:19:55.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:19:55.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:19:55.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:19:55.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:19:55.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:19:55.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:19:55.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:19:55.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:19:55.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:19:55.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:19:55.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:19:55.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:19:55.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:19:55.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:19:55.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.561 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.561 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:19:55.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:19:55.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.562 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414944716999997, 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:19:55.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:19:55.567 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414920555000002, 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.568 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:55.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.570 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.573 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414670004000001, 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:19:55.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:55.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414642622999999, 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:19:55.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.583 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414619483999999, 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:19:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:19:55.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:19:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:19:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:19:55.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:19:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:19:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414390900000001, 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:19:55.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.595 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414353765999998, 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:19:55.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:19:55.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:19:55.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:19:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:19:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:19:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:19:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.601 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414326576999997, 2024-09-11T06:19:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:19:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.602 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:19:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:55.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:19:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:19:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:19:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:19:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:19:55.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:19:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:19:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:19:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:19:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:19:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414057972000002, 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.610 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:19:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.414016670999999, 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.615 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:19:55.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.413991564, 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.620 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:19:55.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.413750800000003, 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:19:55.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:19:55.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:19:55.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.630 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.413716493999999, 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:19:55.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:19:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:19:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:19:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.413695726999997, 2024-09-11T06:19:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:55.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:19:55.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:55.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.413465203999998, 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:19:55.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:19:55.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118795 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.413424036000002, 2024-09-11T06:19:55.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99200256799999997, 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118795 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120454+0000", 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.06e-07 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:55.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120457+0000", 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459999999999998e-06 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120464+0000", 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1350000000000003e-06 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120470+0000", 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120511+0000", 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1316000000000002e-05 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120517+0000", 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6790000000000002e-06 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112451+0000", 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.991934078 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:55.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112456+0000", 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:55.652 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:55.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:19:55.654 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:55.653+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:55.754 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:55.753+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:55.797 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:55.797 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:55.797 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:19:55.797 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:55.806 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:19:55.855 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:55.854+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:55.909 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:19:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:19:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:19:55.909 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:55.918 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:19:55.956 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:55.955+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:56.022 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:19:56.022 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:19:56.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:19:56.023 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:19:56.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.023 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.023 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:56.023 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.781079913, 2024-09-11T06:19:56.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:19:56.024 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.024 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.024 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.025 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:19:56.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.025 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:56.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:19:56.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:19:56.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:19:56.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:19:56.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:19:56.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:19:56.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:19:56.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:19:56.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:19:56.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:19:56.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:19:56.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:19:56.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:19:56.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:19:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:19:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.781067175, 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.033 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:19:56.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.781056042, 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:19:56.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:19:56.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.044 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.78104545399999, 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.046 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:19:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.781034959, 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.049 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.051 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:19:56.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.053 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.78102464600001, 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.054 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.055 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.055 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:19:56.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.055 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:56.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:19:56.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.059 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.78101410399999, 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:56.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:19:56.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:19:56.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:19:56.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:19:56.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.064 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:19:56.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:19:56.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:19:56.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:19:56.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:19:56.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:19:56.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:19:56.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:19:56.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:19:56.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:19:56.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.068 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.069 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.069 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:56.069 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.781003798, 2024-09-11T06:19:56.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:19:56.069 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.070 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.071 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.071 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:19:56.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.071 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:56.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:19:56.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:19:56.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:19:56.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:19:56.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:19:56.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:19:56.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:19:56.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:19:56.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:19:56.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:19:56.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:19:56.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:19:56.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:19:56.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:19:56.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:19:56.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.080 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.080 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.081 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.081 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:56.081 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.78098822, 2024-09-11T06:19:56.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:19:56.081 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.082 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.082 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.082 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.082 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.082 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.082 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:19:56.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.083 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:56.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:56.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:19:56.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:19:56.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:19:56.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:19:56.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:19:56.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:19:56.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:19:56.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:19:56.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:19:56.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:19:56.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:19:56.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:19:56.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:19:56.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:19:56.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.090 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.090 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.091 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.091 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:56.091 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.780969215, 2024-09-11T06:19:56.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:19:56.091 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.091 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.092 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.092 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:19:56.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.092 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:19:56.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.096 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.721439842, 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.097 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:19:56.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:19:56.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:19:56.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:19:56.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:19:56.101 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.72142137100001, 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.102 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.721402881, 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.721385813, 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:19:56.111 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:19:56.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:19:56.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.721367782, 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:56.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.721345598, 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:19:56.121 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.124 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:19:56.125 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.721327606, 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.126 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:56.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.130 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.721309952, 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.131 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:19:56.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:19:56.135 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.72128703600001, 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.136 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:19:56.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.140 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.141 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.141 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:19:56.141 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:56.141 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 127.72126864800001, 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:19:56.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:19:56.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:19:56.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:19:56.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:19:56.146 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:19:56.148 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T06:19:56.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:19:56.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:56.147+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:56.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T06:19:56.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:19:56.248 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:56.248+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:56.336 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:56.337 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:56.337 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:19:56.337 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:56.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:19:56.350 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:56.348+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:56.450 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:56.449+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:56.500 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:19:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:19:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:19:56.500 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:56.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:19:56.551 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:56.550+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:56.652 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:56.651+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:56.727 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:56.727 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130410 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10993664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.578023350000002, 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043187259999999998, 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130410 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146582+0000", 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1300000000000001e-07 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146584+0000", 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146592+0000", 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5619999999999998e-06 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146598+0000", 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7420000000000003e-06 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189643+0000", 2024-09-11T06:19:56.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043045091000000001 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189704+0000", 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0911e-05 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189769+0000", 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5745000000000002e-05 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130411 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 11001856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.578001209, 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043307804999999998, 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130411 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146604+0000", 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146605+0000", 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146613+0000", 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6729999999999998e-06 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146621+0000", 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8849999999999999e-06 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146626+0000", 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9520000000000002e-06 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189802+0000", 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043175603 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189848+0000", 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6465999999999999e-05 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189912+0000", 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3835000000000001e-05 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130444 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10752000~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577972408999997, 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043428937000000001, 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130444 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:56.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146633+0000", 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146635+0000", 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.041e-06 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146642+0000", 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8680000000000001e-06 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146649+0000", 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2319999999999998e-06 2024-09-11T06:19:56.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189933+0000", 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043284979000000001 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.189982+0000", 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8513000000000001e-05 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190062+0000", 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9929e-05 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130445 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10760192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577944885000001, 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043549156999999998, 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130445 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146661+0000", 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146663+0000", 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0430000000000002e-06 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146678+0000", 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5201000000000001e-05 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146684+0000", 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3040000000000001e-06 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190086+0000", 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043401281 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190147+0000", 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1246000000000003e-05 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190210+0000", 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2720999999999998e-05 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130446 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10768384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577907803000002, 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043660235999999998, 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130446 2024-09-11T06:19:56.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146698+0000", 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146700+0000", 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.34e-06 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146709+0000", 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3520000000000007e-06 2024-09-11T06:19:56.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146718+0000", 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6830000000000003e-06 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190233+0000", 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043514440000000001 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190283+0000", 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0178e-05 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190358+0000", 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4796999999999996e-05 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130447 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10776576~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577843882000003, 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043732383999999999, 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130447 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146762+0000", 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146765+0000", 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146782+0000", 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7282000000000002e-05 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146789+0000", 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7279999999999998e-06 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190386+0000", 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043596843000000003 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190431+0000", 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5751999999999998e-05 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190494+0000", 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2614999999999996e-05 2024-09-11T06:19:56.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130448 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10784768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577802147, 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043831475000000002, 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130448 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146803+0000", 2024-09-11T06:19:56.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146811+0000", 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.028e-06 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146814+0000", 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.543e-06 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146823+0000", 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8699999999999998e-06 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146828+0000", 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.011e-06 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190522+0000", 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043694033 2024-09-11T06:19:56.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190572+0000", 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0269999999999998e-05 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190635+0000", 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2719999999999996e-05 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.760 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130449 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10792960~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577765491000001, 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043926146999999999, 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130449 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146840+0000", 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8200000000000001e-07 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146842+0000", 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5910000000000001e-06 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146852+0000", 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0341e-05 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146855+0000", 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190655+0000", 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043800258000000002 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190706+0000", 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0226999999999999e-05 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190766+0000", 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0517999999999999e-05 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130450 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10801152~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577746285000003, 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044072734000000002, 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130450 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146859+0000", 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5699999999999999e-07 2024-09-11T06:19:56.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146861+0000", 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3379999999999999e-06 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146865+0000", 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3220000000000003e-06 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146868+0000", 2024-09-11T06:19:56.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6369999999999999e-06 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190792+0000", 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043923845000000003 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190853+0000", 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1008999999999998e-05 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190932+0000", 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9326000000000006e-05 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130451 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10809344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577734251000003, 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044195328999999998, 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130451 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.146871+0000", 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147086+0000", 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021491899999999999 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147096+0000", 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0217999999999999e-05 2024-09-11T06:19:56.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147105+0000", 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4379999999999995e-06 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147112+0000", 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.190954+0000", 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043842032000000003 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191004+0000", 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0482999999999998e-05 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191066+0000", 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2420000000000002e-05 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130452 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10817536~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.577485193000001, 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.044100716999999998, 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130452 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147120+0000", 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147905+0000", 2024-09-11T06:19:56.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078465999999999996 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147909+0000", 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2549999999999999e-06 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147919+0000", 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0236e-05 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147927+0000", 2024-09-11T06:19:56.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8679999999999999e-06 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191092+0000", 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043164431000000003 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191142+0000", 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9923000000000003e-05 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191221+0000", 2024-09-11T06:19:56.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9344000000000005e-05 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130453 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10825728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.576644635000001, 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392063000000002, 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130453 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147961+0000", 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147963+0000", 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.795e-06 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147967+0000", 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9979999999999997e-06 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147970+0000", 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8399999999999999e-06 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191246+0000", 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043275980999999998 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191291+0000", 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5498999999999999e-05 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191353+0000", 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999994e-05 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130454 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10833920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.576631444999997, 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043530384999999998, 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130454 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147974+0000", 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5199999999999998e-07 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147975+0000", 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.195e-06 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147979+0000", 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.196e-06 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147981+0000", 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.582e-06 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191374+0000", 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043392673 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191441+0000", 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-11T06:19:56.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191504+0000", 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3602999999999994e-05 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130455 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10842112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.576620798999997, 2024-09-11T06:19:56.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043653780000000003, 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130455 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147985+0000", 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147986+0000", 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.35e-06 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147989+0000", 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0900000000000001e-06 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147992+0000", 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191525+0000", 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043533080000000002 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191577+0000", 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2506999999999997e-05 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191638+0000", 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0903999999999998e-05 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130456 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10850304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:56.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.576610359, 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.04379475, 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130456 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.147995+0000", 2024-09-11T06:19:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149579+0000", 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001583877 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149584+0000", 2024-09-11T06:19:56.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9359999999999998e-06 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149593+0000", 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2429999999999994e-06 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149598+0000", 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0919999999999997e-06 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191663+0000", 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042064987999999998 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191714+0000", 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0506000000000001e-05 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.191790+0000", 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6107999999999997e-05 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130464 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10915840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.574917249000002, 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043257601999999999, 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130464 2024-09-11T06:19:56.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149688+0000", 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149920+0000", 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023134100000000001 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149923+0000", 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000001e-06 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149932+0000", 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7080000000000003e-06 2024-09-11T06:19:56.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149939+0000", 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6510000000000001e-06 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192802+0000", 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.042862572000000002 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192861+0000", 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9077999999999999e-05 2024-09-11T06:19:56.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.192946+0000", 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4901999999999995e-05 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130466 3.1c 3:3f7fa4c9:::rbd_data.116da7b621ae.0000000000000005:3d [read 10932224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.574645681, 2024-09-11T06:19:56.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043272974999999998, 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130466 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:56.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.149960+0000", 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151901+0000", 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001941356 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151905+0000", 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0960000000000003e-06 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151912+0000", 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0679999999999999e-06 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.151916+0000", 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9829999999999998e-06 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193097+0000", 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041180814000000003 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193161+0000", 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3584000000000007e-05 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.193233+0000", 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2074000000000001e-05 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.807 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:130516 3.1c 3:3f6bd6e9:::rbd_object_map.116df114867d.000000000000003e:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.571443197999997, 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.043688850000000001, 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 130516 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153162+0000", 2024-09-11T06:19:56.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153163+0000", 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8299999999999996e-07 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153168+0000", 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153176+0000", 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0909999999999993e-06 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.153181+0000", 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3539999999999999e-06 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194609+0000", 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.041427972 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194661+0000", 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2308999999999997e-05 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.194883+0000", 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000221466 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196734+0000", 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018515039999999999 2024-09-11T06:19:56.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196752+0000", 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7558e-05 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196812+0000", 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9639000000000003e-05 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:05.196851+0000", 2024-09-11T06:19:56.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9536999999999998e-05 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.392045161, 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:19:56.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:19:56.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:19:56.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:56.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.346173302, 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:19:56.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:19:56.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:19:56.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:19:56.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:19:56.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:19:56.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:19:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:56.827 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:56.827 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:56.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:19:56.829 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:56.827+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:56.929 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:56.928+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:56.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:19:57.030 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:57.029+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:57.049 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:19:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:19:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164063 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025059+0000", 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011418101, 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011442404, 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164063 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025059+0000", 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025059+0000", 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025060+0000", 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025062+0000", 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0250000000000001e-06 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025068+0000", 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2339999999999999e-06 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025072+0000", 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5249999999999999e-06 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164095 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026812+0000", 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0096659309999999991, 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097554519999999995, 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164095 2024-09-11T06:19:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026812+0000", 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026812+0000", 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026812+0000", 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8799999999999998e-07 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026814+0000", 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1770000000000001e-06 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026820+0000", 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1120000000000001e-06 2024-09-11T06:19:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026825+0000", 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0440000000000003e-06 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164126 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028139+0000", 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0083385950000000007, 2024-09-11T06:19:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084845749999999994, 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164126 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028139+0000", 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028139+0000", 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028140+0000", 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1299999999999999e-07 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028144+0000", 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.143e-06 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028152+0000", 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6230000000000003e-06 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028159+0000", 2024-09-11T06:19:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7739999999999999e-06 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164158 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030367+0000", 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0061100850000000003, 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063109029999999997, 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164158 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030367+0000", 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030367+0000", 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030368+0000", 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030372+0000", 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030380+0000", 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2150000000000001e-06 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030386+0000", 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0329999999999997e-06 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164190 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.033800+0000", 2024-09-11T06:19:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0026775599999999998, 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002932703, 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164190 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033800+0000", 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033800+0000", 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033801+0000", 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0400000000000005e-07 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033805+0000", 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0280000000000002e-06 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033813+0000", 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7870000000000002e-06 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033819+0000", 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1249999999999998e-06 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164064 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025079+0000", 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011398419999999999, 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011709397, 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164064 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025079+0000", 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025079+0000", 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025079+0000", 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-07 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025081+0000", 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0219999999999999e-06 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025093+0000", 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1905e-05 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025097+0000", 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9500000000000003e-06 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164096 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026832+0000", 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0096454999999999996, 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010011824000000001, 2024-09-11T06:19:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164096 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026832+0000", 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026832+0000", 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026832+0000", 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026835+0000", 2024-09-11T06:19:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2910000000000002e-06 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026842+0000", 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4170000000000003e-06 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026847+0000", 2024-09-11T06:19:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164127 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028172+0000", 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0083058950000000006, 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087330029999999996, 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164127 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028172+0000", 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028172+0000", 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028172+0000", 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7400000000000003e-07 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028175+0000", 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.954e-06 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028182+0000", 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5270000000000004e-06 2024-09-11T06:19:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028187+0000", 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2000000000000002e-06 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164159 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030396+0000", 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0060811190000000003, 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065618489999999998, 2024-09-11T06:19:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164159 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030396+0000", 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030396+0000", 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030397+0000", 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000002e-07 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030399+0000", 2024-09-11T06:19:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1509999999999998e-06 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030407+0000", 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6159999999999996e-06 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030412+0000", 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-06 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164191 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.033829+0000", 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0026481199999999999, 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003183595, 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164191 2024-09-11T06:19:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033829+0000", 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033829+0000", 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033830+0000", 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-07 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033832+0000", 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3640000000000002e-06 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033839+0000", 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5169999999999996e-06 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033844+0000", 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2830000000000001e-06 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164065 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025106+0000", 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011371905, 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011963219000000001, 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164065 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025106+0000", 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025106+0000", 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025106+0000", 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9099999999999999e-07 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025108+0000", 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:19:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025115+0000", 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1779999999999997e-06 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025120+0000", 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8720000000000001e-06 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164097 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026854+0000", 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0096239150000000002, 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010267388000000001, 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164097 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026854+0000", 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026854+0000", 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026854+0000", 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4000000000000002e-07 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026856+0000", 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2970000000000002e-06 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026862+0000", 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1510000000000001e-06 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026867+0000", 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8420000000000004e-06 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164128 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028194+0000", 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0082833019999999993, 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089538039999999992, 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164128 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028194+0000", 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028194+0000", 2024-09-11T06:19:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028195+0000", 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028210+0000", 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5537e-05 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028217+0000", 2024-09-11T06:19:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6159999999999998e-06 2024-09-11T06:19:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028222+0000", 2024-09-11T06:19:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:19:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164160 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030488+0000", 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0059899109999999997, 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066877250000000003, 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164160 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030488+0000", 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030488+0000", 2024-09-11T06:19:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030488+0000", 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1699999999999998e-07 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030492+0000", 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9659999999999998e-06 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030499+0000", 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1729999999999998e-06 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030507+0000", 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7810000000000005e-06 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164192 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.033946+0000", 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0025316900000000001, 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032560229999999998, 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164192 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033946+0000", 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033946+0000", 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033947+0000", 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7899999999999997e-07 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033951+0000", 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5959999999999997e-06 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033961+0000", 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000002e-06 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033968+0000", 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7479999999999996e-06 2024-09-11T06:19:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164066 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025127+0000", 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011350654, 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012103193999999999, 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164066 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025127+0000", 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025127+0000", 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025127+0000", 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025129+0000", 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2359999999999999e-06 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025136+0000", 2024-09-11T06:19:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.054e-06 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025140+0000", 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6609999999999999e-06 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164098 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026874+0000", 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0096039019999999992, 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010383579, 2024-09-11T06:19:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164098 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026874+0000", 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026874+0000", 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026874+0000", 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026876+0000", 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0980000000000001e-06 2024-09-11T06:19:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026882+0000", 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0220000000000001e-06 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026887+0000", 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7520000000000004e-06 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164129 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028230+0000", 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0082469870000000008, 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090567919999999993, 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164129 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028230+0000", 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028230+0000", 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028231+0000", 2024-09-11T06:19:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2099999999999996e-07 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028233+0000", 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2139999999999999e-06 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028239+0000", 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0340000000000002e-06 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028244+0000", 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9710000000000003e-06 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164161 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030648+0000", 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.005829735, 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066662140000000002, 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164161 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030648+0000", 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030648+0000", 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030649+0000", 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7599999999999996e-07 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030653+0000", 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4259999999999996e-06 2024-09-11T06:19:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030665+0000", 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1613e-05 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030672+0000", 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4109999999999999e-06 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164193 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034061+0000", 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0024169059999999999, 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032795739999999999, 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164193 2024-09-11T06:19:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034061+0000", 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034061+0000", 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034061+0000", 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.68e-07 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034065+0000", 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6780000000000002e-06 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034073+0000", 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6399999999999997e-06 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034079+0000", 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1850000000000001e-06 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164067 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025146+0000", 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011331285999999999, 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012220959999999999, 2024-09-11T06:19:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164067 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025146+0000", 2024-09-11T06:19:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025146+0000", 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025147+0000", 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025149+0000", 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1330000000000002e-06 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025155+0000", 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.879e-06 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025160+0000", 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3600000000000004e-06 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164099 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026894+0000", 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.009583912, 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010500456, 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164099 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026894+0000", 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026894+0000", 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026894+0000", 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.46e-07 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026902+0000", 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000005e-06 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026908+0000", 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5989999999999998e-06 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026913+0000", 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9320000000000004e-06 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164130 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028563+0000", 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0079145269999999993, 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088585350000000007, 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164130 2024-09-11T06:19:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028563+0000", 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028563+0000", 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028564+0000", 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8999999999999996e-07 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028568+0000", 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1649999999999999e-06 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028576+0000", 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3990000000000004e-06 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028582+0000", 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9900000000000002e-06 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164162 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030775+0000", 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0057028110000000003, 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066746059999999996, 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164162 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030775+0000", 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030775+0000", 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030776+0000", 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3099999999999996e-07 2024-09-11T06:19:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030781+0000", 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999996e-06 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030796+0000", 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5228000000000001e-05 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030806+0000", 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5899999999999997e-06 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164194 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034099+0000", 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0023785070000000002, 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033773789999999998, 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164194 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034099+0000", 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034099+0000", 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034100+0000", 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034102+0000", 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6520000000000002e-06 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034110+0000", 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9650000000000008e-06 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034115+0000", 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2429999999999996e-06 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164068 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025166+0000", 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011310980999999999, 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012353075999999999, 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164068 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025166+0000", 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025166+0000", 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025167+0000", 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7500000000000001e-07 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025169+0000", 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0540000000000002e-06 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025175+0000", 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7409999999999998e-06 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025179+0000", 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5929999999999999e-06 2024-09-11T06:19:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164100 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026920+0000", 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0095570069999999993, 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010652785999999999, 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164100 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026920+0000", 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026920+0000", 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026921+0000", 2024-09-11T06:19:57.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.08e-07 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026939+0000", 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8201000000000001e-05 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026946+0000", 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.092e-06 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026970+0000", 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4167000000000001e-05 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164131 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028593+0000", 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0078839960000000008, 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090338359999999999, 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164131 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028593+0000", 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028593+0000", 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028594+0000", 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5699999999999998e-07 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028596+0000", 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1229999999999998e-06 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028602+0000", 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028607+0000", 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9930000000000003e-06 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164163 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.148 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030821+0000", 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0056567800000000001, 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068584989999999997, 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164163 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030821+0000", 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030821+0000", 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030821+0000", 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6899999999999997e-07 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030824+0000", 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.96e-06 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030831+0000", 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.878e-06 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030837+0000", 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7509999999999997e-06 2024-09-11T06:19:57.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164195 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034228+0000", 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0022498879999999998, 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003504882, 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164195 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034228+0000", 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034228+0000", 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034228+0000", 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9800000000000003e-07 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034233+0000", 2024-09-11T06:19:57.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034242+0000", 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8480000000000007e-06 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034248+0000", 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3940000000000001e-06 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164069 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025205+0000", 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011272927, 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012572972999999999, 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164069 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025205+0000", 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025205+0000", 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025205+0000", 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6199999999999998e-07 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025208+0000", 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4830000000000002e-06 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025215+0000", 2024-09-11T06:19:57.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3880000000000002e-06 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025221+0000", 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6200000000000004e-06 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164101 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026979+0000", 2024-09-11T06:19:57.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0094982499999999997, 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010831406, 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164101 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026979+0000", 2024-09-11T06:19:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026979+0000", 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026980+0000", 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1600000000000001e-07 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026982+0000", 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.565e-06 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026990+0000", 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4340000000000003e-06 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026996+0000", 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6969999999999998e-06 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164132 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028614+0000", 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0078632589999999992, 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092316840000000004, 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164132 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028614+0000", 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028614+0000", 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028615+0000", 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7099999999999997e-07 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028616+0000", 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9139999999999998e-06 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028622+0000", 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9209999999999997e-06 2024-09-11T06:19:57.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028627+0000", 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.634e-06 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164164 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030940+0000", 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0055375870000000001, 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069488739999999998, 2024-09-11T06:19:57.166 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164164 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030940+0000", 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030940+0000", 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030941+0000", 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030945+0000", 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8920000000000002e-06 2024-09-11T06:19:57.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030954+0000", 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1079999999999999e-06 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030960+0000", 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4860000000000002e-06 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164196 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034330+0000", 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0021474020000000001, 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036423430000000001, 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164196 2024-09-11T06:19:57.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034330+0000", 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034330+0000", 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034331+0000", 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5600000000000005e-07 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034335+0000", 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2379999999999999e-06 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034343+0000", 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4030000000000007e-06 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034350+0000", 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1330000000000004e-06 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164070 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025227+0000", 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011250456000000001, 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012800119, 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164070 2024-09-11T06:19:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025227+0000", 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025227+0000", 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025227+0000", 2024-09-11T06:19:57.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4699999999999998e-07 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025229+0000", 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.841e-06 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025236+0000", 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8399999999999997e-06 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025241+0000", 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6820000000000002e-06 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164102 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027004+0000", 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0094735719999999995, 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011079047, 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164102 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027004+0000", 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027004+0000", 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027004+0000", 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027007+0000", 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.357e-06 2024-09-11T06:19:57.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027013+0000", 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1489999999999999e-06 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027018+0000", 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1139999999999997e-06 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164133 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028633+0000", 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0078444159999999999, 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095030270000000007, 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164133 2024-09-11T06:19:57.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028633+0000", 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028633+0000", 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028633+0000", 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.72e-07 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028636+0000", 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.114e-06 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028642+0000", 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0220000000000001e-06 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028647+0000", 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.254e-06 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164165 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.031024+0000", 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0054530250000000002, 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071608549999999998, 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164165 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031024+0000", 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031024+0000", 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031025+0000", 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1999999999999999e-07 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031029+0000", 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2289999999999997e-06 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031042+0000", 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3028e-05 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031049+0000", 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8510000000000001e-06 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164197 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034371+0000", 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.002106756, 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038441489999999998, 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164197 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.188 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034371+0000", 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034371+0000", 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034371+0000", 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034374+0000", 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034390+0000", 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5807999999999998e-05 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034396+0000", 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2040000000000002e-06 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164071 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025247+0000", 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011230474000000001, 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012994614, 2024-09-11T06:19:57.191 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164071 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025247+0000", 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025247+0000", 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025247+0000", 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025257+0000", 2024-09-11T06:19:57.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1989999999999995e-06 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025264+0000", 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4630000000000004e-06 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025269+0000", 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0050000000000004e-06 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164103 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027025+0000", 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0094529369999999998, 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011245658, 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164103 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027025+0000", 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027025+0000", 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027025+0000", 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027027+0000", 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0949999999999998e-06 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027033+0000", 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1029999999999998e-06 2024-09-11T06:19:57.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027038+0000", 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164134 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028653+0000", 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0078244000000000005, 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096490719999999999, 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164134 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028653+0000", 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028653+0000", 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028653+0000", 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2399999999999999e-07 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028655+0000", 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.058e-06 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028661+0000", 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.879e-06 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028666+0000", 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8600000000000001e-06 2024-09-11T06:19:57.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164166 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.031153+0000", 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0053239730000000001, 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072047129999999997, 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164166 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031153+0000", 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031153+0000", 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031154+0000", 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031158+0000", 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.138e-06 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031169+0000", 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0879999999999999e-05 2024-09-11T06:19:57.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031176+0000", 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2320000000000004e-06 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164198 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034529+0000", 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0019487, 2024-09-11T06:19:57.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038818680000000001, 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164198 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034529+0000", 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034529+0000", 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034530+0000", 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3099999999999996e-07 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034534+0000", 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2989999999999998e-06 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034550+0000", 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.579e-05 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034555+0000", 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5260000000000001e-06 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164072 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025276+0000", 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011201531000000001, 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013170883, 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164072 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025276+0000", 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025276+0000", 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025276+0000", 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025279+0000", 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3599999999999999e-06 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025286+0000", 2024-09-11T06:19:57.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6529999999999994e-06 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025291+0000", 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9320000000000004e-06 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164104 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.212 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027044+0000", 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0094332019999999999, 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011429626, 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164104 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027044+0000", 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027044+0000", 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027045+0000", 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1100000000000001e-07 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027047+0000", 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0779999999999998e-06 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027053+0000", 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8930000000000002e-06 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027057+0000", 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2119999999999997e-06 2024-09-11T06:19:57.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164135 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028673+0000", 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0078045709999999997, 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098523269999999993, 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164135 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028673+0000", 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028673+0000", 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028673+0000", 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9999999999999999e-07 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028675+0000", 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.841e-06 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028681+0000", 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3790000000000003e-06 2024-09-11T06:19:57.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028686+0000", 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164167 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.031286+0000", 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0051910109999999997, 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072943790000000001, 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164167 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031286+0000", 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031286+0000", 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031287+0000", 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3300000000000001e-07 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031292+0000", 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-11T06:19:57.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031302+0000", 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0139999999999999e-05 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031309+0000", 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.657e-06 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.222 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164199 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034571+0000", 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0019060310000000001, 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040666189999999996, 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164199 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034571+0000", 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034571+0000", 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034572+0000", 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2599999999999998e-07 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034574+0000", 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9259999999999999e-06 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034578+0000", 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.544e-06 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034582+0000", 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3400000000000002e-06 2024-09-11T06:19:57.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164073 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025299+0000", 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011178950999999999, 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013392988999999999, 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164073 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025299+0000", 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025299+0000", 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025299+0000", 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025301+0000", 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1629999999999999e-06 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025308+0000", 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0559999999999999e-06 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025313+0000", 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9989999999999999e-06 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164105 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027624+0000", 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0088533729999999995, 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011123925999999999, 2024-09-11T06:19:57.229 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164105 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027624+0000", 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027624+0000", 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027625+0000", 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8400000000000003e-07 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027629+0000", 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4340000000000002e-06 2024-09-11T06:19:57.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027640+0000", 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0229e-05 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027647+0000", 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-06 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164136 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028693+0000", 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0077847919999999996, 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010108756, 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164136 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028693+0000", 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028693+0000", 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028693+0000", 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:57.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028695+0000", 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9439999999999999e-06 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028701+0000", 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7699999999999998e-06 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028706+0000", 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164168 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.031418+0000", 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0050591949999999998, 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074386269999999997, 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164168 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031418+0000", 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031418+0000", 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031419+0000", 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5300000000000003e-07 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031423+0000", 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8639999999999998e-06 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031433+0000", 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0079e-05 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031440+0000", 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1300000000000003e-06 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164200 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034742+0000", 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001735068, 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041721559999999998, 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164200 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034742+0000", 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034742+0000", 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034743+0000", 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2099999999999995e-07 2024-09-11T06:19:57.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034748+0000", 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2869999999999998e-06 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034757+0000", 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7759999999999992e-06 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034764+0000", 2024-09-11T06:19:57.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4080000000000003e-06 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164074 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025320+0000", 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.01115787, 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013647806, 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164074 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025320+0000", 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025320+0000", 2024-09-11T06:19:57.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025320+0000", 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025322+0000", 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2170000000000001e-06 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025330+0000", 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025334+0000", 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9370000000000003e-06 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164106 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027666+0000", 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0088118160000000001, 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011358744, 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164106 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027666+0000", 2024-09-11T06:19:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027666+0000", 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027666+0000", 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2399999999999998e-07 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027669+0000", 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7219999999999999e-06 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027676+0000", 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9210000000000003e-06 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027681+0000", 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.249 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164137 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028712+0000", 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0077658099999999997, 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010365944, 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164137 2024-09-11T06:19:57.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028712+0000", 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028712+0000", 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028712+0000", 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028714+0000", 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0949999999999998e-06 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028720+0000", 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.519e-06 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028724+0000", 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6369999999999998e-06 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164169 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.031752+0000", 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.004725127, 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073843149999999998, 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164169 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031752+0000", 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031752+0000", 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031753+0000", 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9599999999999999e-07 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031758+0000", 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6439999999999999e-06 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031766+0000", 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8350000000000004e-06 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031772+0000", 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1750000000000002e-06 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164201 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.034786+0000", 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001691695, 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004404486, 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164201 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034786+0000", 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034786+0000", 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034786+0000", 2024-09-11T06:19:57.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6700000000000003e-07 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034790+0000", 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.19e-06 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034798+0000", 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0879999999999995e-06 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.034805+0000", 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9940000000000003e-06 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164075 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025341+0000", 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011136297, 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013905374999999999, 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164075 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025341+0000", 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025341+0000", 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025342+0000", 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025344+0000", 2024-09-11T06:19:57.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.114e-06 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025351+0000", 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1280000000000002e-06 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025356+0000", 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8160000000000001e-06 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164107 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027689+0000", 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0087884020000000007, 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011611119, 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164107 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.264 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027689+0000", 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027689+0000", 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027690+0000", 2024-09-11T06:19:57.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0299999999999999e-07 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027692+0000", 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5739999999999998e-06 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027698+0000", 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0140000000000004e-06 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027703+0000", 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3229999999999997e-06 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164138 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028759+0000", 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0077184840000000003, 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010597069000000001, 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164138 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028759+0000", 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028759+0000", 2024-09-11T06:19:57.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028760+0000", 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4300000000000003e-07 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028762+0000", 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028769+0000", 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7220000000000002e-06 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028774+0000", 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2870000000000004e-06 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164170 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.031792+0000", 2024-09-11T06:19:57.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0046853509999999999, 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076180639999999999, 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164170 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031792+0000", 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031792+0000", 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031793+0000", 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4000000000000002e-07 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031795+0000", 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5519999999999999e-06 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031813+0000", 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7345000000000001e-05 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.031819+0000", 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7320000000000001e-06 2024-09-11T06:19:57.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164202 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.035150+0000", 2024-09-11T06:19:57.276 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0013275120000000001, 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043164759999999996, 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164202 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035150+0000", 2024-09-11T06:19:57.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035150+0000", 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035151+0000", 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2399999999999997e-07 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035155+0000", 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1409999999999998e-06 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035165+0000", 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0175e-05 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035172+0000", 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0849999999999999e-06 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164076 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025361+0000", 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011116068999999999, 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014157833999999999, 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164076 2024-09-11T06:19:57.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025361+0000", 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025361+0000", 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025362+0000", 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3700000000000001e-07 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025364+0000", 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.889e-06 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025371+0000", 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0430000000000002e-06 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025376+0000", 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2270000000000001e-06 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164108 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027710+0000", 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0087669960000000009, 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011845354000000001, 2024-09-11T06:19:57.283 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164108 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027710+0000", 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027710+0000", 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027711+0000", 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027713+0000", 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.142e-06 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027720+0000", 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0870000000000001e-06 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027725+0000", 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164139 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028786+0000", 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0076914289999999996, 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010797367, 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164139 2024-09-11T06:19:57.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028786+0000", 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028786+0000", 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028786+0000", 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028789+0000", 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3590000000000002e-06 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028795+0000", 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2639999999999997e-06 2024-09-11T06:19:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028800+0000", 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8119999999999998e-06 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164171 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032124+0000", 2024-09-11T06:19:57.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0043536, 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075476780000000004, 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164171 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032124+0000", 2024-09-11T06:19:57.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032124+0000", 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032125+0000", 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-07 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032129+0000", 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2320000000000003e-06 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032137+0000", 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1270000000000003e-06 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032143+0000", 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9030000000000001e-06 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164203 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.035185+0000", 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012929370000000001, 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004516763, 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164203 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035185+0000", 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035185+0000", 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035185+0000", 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3499999999999996e-07 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035188+0000", 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8459999999999999e-06 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035199+0000", 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0679000000000001e-05 2024-09-11T06:19:57.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035204+0000", 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3380000000000004e-06 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164077 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025383+0000", 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011094194, 2024-09-11T06:19:57.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014356689000000001, 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164077 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025383+0000", 2024-09-11T06:19:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025383+0000", 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025384+0000", 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8299999999999998e-07 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025386+0000", 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.548e-06 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025393+0000", 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8430000000000004e-06 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025398+0000", 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5709999999999999e-06 2024-09-11T06:19:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164109 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027732+0000", 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0087451130000000005, 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012061974, 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164109 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027732+0000", 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027732+0000", 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027733+0000", 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027735+0000", 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6400000000000001e-06 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027755+0000", 2024-09-11T06:19:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9284999999999999e-05 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027760+0000", 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7169999999999996e-06 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164140 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028807+0000", 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0076708230000000002, 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011040945999999999, 2024-09-11T06:19:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164140 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028807+0000", 2024-09-11T06:19:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028807+0000", 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028807+0000", 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3000000000000001e-07 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028809+0000", 2024-09-11T06:19:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8819999999999999e-06 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028815+0000", 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9499999999999998e-06 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028820+0000", 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8049999999999997e-06 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164172 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032154+0000", 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0043236639999999996, 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077538549999999996, 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164172 2024-09-11T06:19:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032154+0000", 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032154+0000", 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032154+0000", 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032157+0000", 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2649999999999999e-06 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032162+0000", 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8930000000000002e-06 2024-09-11T06:19:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032167+0000", 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164204 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.035213+0000", 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0012641429999999999, 2024-09-11T06:19:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047474839999999997, 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164204 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035213+0000", 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035213+0000", 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035214+0000", 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1500000000000005e-07 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035216+0000", 2024-09-11T06:19:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3489999999999999e-06 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035223+0000", 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4370000000000004e-06 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035227+0000", 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164078 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025404+0000", 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011073543, 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014614365000000001, 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164078 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025404+0000", 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025404+0000", 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025404+0000", 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0200000000000003e-07 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025406+0000", 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1380000000000001e-06 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025413+0000", 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.703e-06 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025418+0000", 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6110000000000004e-06 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164110 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027767+0000", 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0087100909999999997, 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012304677999999999, 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164110 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027767+0000", 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027767+0000", 2024-09-11T06:19:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027768+0000", 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027770+0000", 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1880000000000001e-06 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027776+0000", 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0730000000000001e-06 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027781+0000", 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0359999999999997e-06 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164141 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029132+0000", 2024-09-11T06:19:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0073458100000000004, 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010996422, 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164141 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029132+0000", 2024-09-11T06:19:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029132+0000", 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029132+0000", 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2500000000000005e-07 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029137+0000", 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7820000000000001e-06 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029146+0000", 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5480000000000002e-06 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029152+0000", 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7129999999999999e-06 2024-09-11T06:19:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164173 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032174+0000", 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0043034309999999999, 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079856379999999998, 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164173 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032174+0000", 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032174+0000", 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032174+0000", 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5999999999999999e-07 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032177+0000", 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.317e-06 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032190+0000", 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.323e-05 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032195+0000", 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1610000000000002e-06 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164205 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.035319+0000", 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001158837, 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048703080000000003, 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164205 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035319+0000", 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035319+0000", 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035319+0000", 2024-09-11T06:19:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8299999999999996e-07 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035323+0000", 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1339999999999997e-06 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035332+0000", 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0770000000000008e-06 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035338+0000", 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2580000000000001e-06 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164079 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025425+0000", 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011052753, 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014794734, 2024-09-11T06:19:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164079 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025425+0000", 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025425+0000", 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025425+0000", 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7199999999999999e-07 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025427+0000", 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2689999999999998e-06 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025434+0000", 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0230000000000004e-06 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025439+0000", 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7859999999999996e-06 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164111 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027788+0000", 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0086894520000000003, 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012460106, 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164111 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027788+0000", 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027788+0000", 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027788+0000", 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5900000000000003e-07 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027790+0000", 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027796+0000", 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9839999999999998e-06 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027801+0000", 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8640000000000004e-06 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164142 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029163+0000", 2024-09-11T06:19:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0073140310000000004, 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011112428000000001, 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164142 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029163+0000", 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029163+0000", 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029164+0000", 2024-09-11T06:19:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.89e-07 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029166+0000", 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.306e-06 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029172+0000", 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.161e-06 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029178+0000", 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1909999999999999e-06 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164174 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032203+0000", 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.004274913, 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081017550000000004, 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164174 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032203+0000", 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032203+0000", 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032203+0000", 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.39e-07 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032205+0000", 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2730000000000001e-06 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032212+0000", 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2809999999999997e-06 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032216+0000", 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8670000000000002e-06 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164206 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.035440+0000", 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.001037844, 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048914459999999998, 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164206 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035440+0000", 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035440+0000", 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035441+0000", 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035445+0000", 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.792e-06 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035457+0000", 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1453e-05 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035464+0000", 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4420000000000001e-06 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.349 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164080 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025445+0000", 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011032452, 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014915930000000001, 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164080 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025445+0000", 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025445+0000", 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025445+0000", 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6100000000000002e-07 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025447+0000", 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9850000000000001e-06 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025453+0000", 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6409999999999999e-06 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025458+0000", 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.814e-06 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164112 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027808+0000", 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0086695709999999992, 2024-09-11T06:19:57.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012580167, 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164112 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027808+0000", 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027808+0000", 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027808+0000", 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7e-07 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027810+0000", 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1789999999999998e-06 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027816+0000", 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0430000000000004e-06 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027821+0000", 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3039999999999998e-06 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.356 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164143 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029238+0000", 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0072399509999999997, 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011177428, 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164143 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029238+0000", 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029238+0000", 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029238+0000", 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3399999999999999e-07 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029242+0000", 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4809999999999998e-06 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029249+0000", 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.99e-06 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029255+0000", 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1319999999999999e-06 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164175 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032222+0000", 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00425502, 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082209569999999992, 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164175 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032222+0000", 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032222+0000", 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032223+0000", 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5900000000000003e-07 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032225+0000", 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9099999999999999e-06 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032235+0000", 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9660000000000008e-06 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032240+0000", 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0900000000000004e-06 2024-09-11T06:19:57.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164207 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.035489+0000", 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00098868999999999997, 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049816369999999997, 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164207 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035489+0000", 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035489+0000", 2024-09-11T06:19:57.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035489+0000", 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0399999999999996e-07 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035492+0000", 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6690000000000002e-06 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035498+0000", 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8289999999999996e-06 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035502+0000", 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3370000000000001e-06 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164081 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025465+0000", 2024-09-11T06:19:57.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.011012305999999999, 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015046897, 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164081 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025465+0000", 2024-09-11T06:19:57.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025465+0000", 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025466+0000", 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025468+0000", 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0559999999999999e-06 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025475+0000", 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9689999999999997e-06 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025480+0000", 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.198e-06 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164113 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027827+0000", 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0086505660000000002, 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012737818, 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164113 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027827+0000", 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027827+0000", 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027827+0000", 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6300000000000001e-07 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027829+0000", 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1119999999999999e-06 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027836+0000", 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:19:57.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027840+0000", 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.95e-06 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164144 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029265+0000", 2024-09-11T06:19:57.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0072128649999999997, 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011356913999999999, 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164144 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029265+0000", 2024-09-11T06:19:57.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029265+0000", 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029265+0000", 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029267+0000", 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2759999999999999e-06 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029273+0000", 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9540000000000001e-06 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029279+0000", 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5049999999999998e-06 2024-09-11T06:19:57.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164176 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032247+0000", 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0042302809999999998, 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084280589999999999, 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164176 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032247+0000", 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032247+0000", 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032248+0000", 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.01e-07 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032250+0000", 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1660000000000001e-06 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032256+0000", 2024-09-11T06:19:57.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.049e-06 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032262+0000", 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7610000000000004e-06 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164208 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.035588+0000", 2024-09-11T06:19:57.381 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00088905799999999997, 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421490000000004, 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164208 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035588+0000", 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035588+0000", 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035589+0000", 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2399999999999997e-07 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035593+0000", 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0090000000000001e-06 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035600+0000", 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7139999999999996e-06 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.035605+0000", 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7400000000000004e-06 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164082 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025486+0000", 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010991147999999999, 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015299076, 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164082 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025486+0000", 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025486+0000", 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025487+0000", 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9200000000000002e-07 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025489+0000", 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1919999999999999e-06 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025496+0000", 2024-09-11T06:19:57.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025501+0000", 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8080000000000004e-06 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164114 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027847+0000", 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0086308519999999996, 2024-09-11T06:19:57.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012995372999999999, 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164114 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027847+0000", 2024-09-11T06:19:57.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027847+0000", 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027847+0000", 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5100000000000001e-07 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027849+0000", 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1380000000000001e-06 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027855+0000", 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8119999999999996e-06 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027859+0000", 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.839e-06 2024-09-11T06:19:57.391 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164145 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029286+0000", 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0071919549999999999, 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011609371, 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164145 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029286+0000", 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029286+0000", 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029286+0000", 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6899999999999998e-07 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029288+0000", 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0609999999999998e-06 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029294+0000", 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9270000000000002e-06 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029299+0000", 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8740000000000003e-06 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164177 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.395 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032363+0000", 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0041146539999999997, 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085726829999999993, 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164177 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032363+0000", 2024-09-11T06:19:57.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032363+0000", 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032363+0000", 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3499999999999996e-07 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032367+0000", 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9319999999999998e-06 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032375+0000", 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5000000000000002e-06 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032381+0000", 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7089999999999999e-06 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164209 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036197+0000", 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00028026899999999998, 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047685230000000002, 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164209 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036197+0000", 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036197+0000", 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036198+0000", 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8299999999999995e-07 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036203+0000", 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8359999999999999e-06 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036219+0000", 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6367000000000001e-05 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036227+0000", 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3339999999999996e-06 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164083 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025507+0000", 2024-09-11T06:19:57.402 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010970383, 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015489519, 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164083 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025507+0000", 2024-09-11T06:19:57.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025507+0000", 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025508+0000", 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2800000000000002e-07 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025514+0000", 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7410000000000003e-06 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025522+0000", 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5320000000000001e-06 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025527+0000", 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0579999999999997e-06 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.405 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164115 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027885+0000", 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0085928770000000005, 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013139715, 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164115 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027885+0000", 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027885+0000", 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027885+0000", 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3099999999999997e-07 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027889+0000", 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3050000000000001e-06 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027904+0000", 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027910+0000", 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3779999999999998e-06 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164146 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029305+0000", 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0071725340000000004, 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011747782999999999, 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164146 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029305+0000", 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029305+0000", 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029305+0000", 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029307+0000", 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.798e-06 2024-09-11T06:19:57.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029313+0000", 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5319999999999997e-06 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029317+0000", 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7249999999999997e-06 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164178 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032401+0000", 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0040761649999999996, 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086787340000000004, 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164178 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032401+0000", 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032401+0000", 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032402+0000", 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9100000000000004e-07 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032405+0000", 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7700000000000002e-06 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032413+0000", 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4139999999999994e-06 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032419+0000", 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6489999999999996e-06 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164210 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036239+0000", 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00023863199999999999, 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048682960000000003, 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164210 2024-09-11T06:19:57.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036239+0000", 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036239+0000", 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036239+0000", 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0200000000000002e-07 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036242+0000", 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5560000000000002e-06 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036249+0000", 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7340000000000002e-06 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036254+0000", 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1200000000000001e-06 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164084 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025533+0000", 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010944016000000001, 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015619378, 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164084 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025533+0000", 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025533+0000", 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025534+0000", 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2e-07 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025536+0000", 2024-09-11T06:19:57.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025543+0000", 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0099999999999998e-06 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025548+0000", 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8400000000000002e-06 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164116 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027920+0000", 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0085577789999999997, 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013284913000000001, 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164116 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027920+0000", 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027920+0000", 2024-09-11T06:19:57.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027920+0000", 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999998e-07 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027927+0000", 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.46e-06 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027933+0000", 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4729999999999997e-06 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027938+0000", 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164147 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029816+0000", 2024-09-11T06:19:57.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0066612939999999999, 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011445824, 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164147 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029816+0000", 2024-09-11T06:19:57.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029816+0000", 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029817+0000", 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8199999999999999e-07 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029821+0000", 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1400000000000002e-06 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029830+0000", 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6400000000000003e-06 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029836+0000", 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6889999999999998e-06 2024-09-11T06:19:57.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164179 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032500+0000", 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0039776129999999996, 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088150429999999998, 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164179 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032500+0000", 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032500+0000", 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032501+0000", 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6000000000000003e-07 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032504+0000", 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.754e-06 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032512+0000", 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9109999999999993e-06 2024-09-11T06:19:57.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032518+0000", 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4739999999999996e-06 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164211 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036261+0000", 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.000216629, 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051085169999999999, 2024-09-11T06:19:57.433 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164211 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036261+0000", 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036261+0000", 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036261+0000", 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.65e-07 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036263+0000", 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.221e-06 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036271+0000", 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0209999999999999e-06 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036277+0000", 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2190000000000003e-06 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164085 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025555+0000", 2024-09-11T06:19:57.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010922948, 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015870044999999999, 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164085 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025555+0000", 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025555+0000", 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025555+0000", 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025557+0000", 2024-09-11T06:19:57.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025564+0000", 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2690000000000002e-06 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025570+0000", 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1610000000000002e-06 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164117 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027945+0000", 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0085319939999999993, 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013535301, 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164117 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027945+0000", 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027945+0000", 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027946+0000", 2024-09-11T06:19:57.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.39e-07 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027948+0000", 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2670000000000001e-06 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027954+0000", 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1519999999999997e-06 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027959+0000", 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7929999999999997e-06 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164148 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029848+0000", 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0066297860000000004, 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011685957, 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164148 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029848+0000", 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029848+0000", 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029848+0000", 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.46e-07 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029850+0000", 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.379e-06 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029857+0000", 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2360000000000001e-06 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029861+0000", 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3919999999999996e-06 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164180 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.446 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032569+0000", 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0039087649999999998, 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090204550000000001, 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164180 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032569+0000", 2024-09-11T06:19:57.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032569+0000", 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032569+0000", 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032571+0000", 2024-09-11T06:19:57.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.311e-06 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032576+0000", 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.938e-06 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032580+0000", 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5480000000000002e-06 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164212 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036283+0000", 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00019424399999999999, 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053600480000000001, 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164212 2024-09-11T06:19:57.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036283+0000", 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036283+0000", 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036284+0000", 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036286+0000", 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1950000000000002e-06 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036291+0000", 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4700000000000001e-06 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036296+0000", 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164086 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025576+0000", 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010901368999999999, 2024-09-11T06:19:57.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016126079000000001, 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164086 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025576+0000", 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025576+0000", 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025576+0000", 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.89e-07 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025579+0000", 2024-09-11T06:19:57.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1519999999999999e-06 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025586+0000", 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0979999999999996e-06 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025591+0000", 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9649999999999999e-06 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164118 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027965+0000", 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0085125370000000006, 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013787516, 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164118 2024-09-11T06:19:57.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027965+0000", 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027965+0000", 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027965+0000", 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027967+0000", 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.995e-06 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027973+0000", 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.485e-06 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027977+0000", 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6650000000000002e-06 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164149 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029869+0000", 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0066084309999999997, 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011915471, 2024-09-11T06:19:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164149 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029869+0000", 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029869+0000", 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029869+0000", 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.65e-07 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029871+0000", 2024-09-11T06:19:57.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.092e-06 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029883+0000", 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1039999999999999e-05 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029888+0000", 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-06 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164181 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032685+0000", 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0037926320000000002, 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091264669999999992, 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164181 2024-09-11T06:19:57.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032685+0000", 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032685+0000", 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032686+0000", 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4399999999999999e-07 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032690+0000", 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.335e-06 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032698+0000", 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-06 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032704+0000", 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164213 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036303+0000", 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.00017482000000000001, 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055368079999999998, 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164213 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036303+0000", 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036303+0000", 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036303+0000", 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4900000000000001e-07 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036305+0000", 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.995e-06 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036311+0000", 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7400000000000001e-06 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036316+0000", 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.887e-06 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164087 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.025597+0000", 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.01088041, 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016269520999999999, 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164087 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025597+0000", 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025597+0000", 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025597+0000", 2024-09-11T06:19:57.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.03e-07 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025600+0000", 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025608+0000", 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5620000000000004e-06 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.025613+0000", 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0610000000000003e-06 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164119 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.027984+0000", 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0084936679999999994, 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013909648, 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164119 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027984+0000", 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027984+0000", 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027984+0000", 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027986+0000", 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0820000000000001e-06 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027992+0000", 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6930000000000004e-06 2024-09-11T06:19:57.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.027996+0000", 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999999e-06 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164150 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029895+0000", 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065823519999999996, 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012033936, 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164150 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029895+0000", 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029895+0000", 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029896+0000", 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6199999999999998e-07 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029904+0000", 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0790000000000001e-06 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029910+0000", 2024-09-11T06:19:57.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.156e-06 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029915+0000", 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8409999999999999e-06 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164182 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032813+0000", 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0036648760000000001, 2024-09-11T06:19:57.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091438839999999997, 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164182 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032813+0000", 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032813+0000", 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032813+0000", 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032817+0000", 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4860000000000002e-06 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032825+0000", 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6850000000000007e-06 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032831+0000", 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8510000000000004e-06 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164214 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036344+0000", 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0001338, 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056412839999999999, 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164214 2024-09-11T06:19:57.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036344+0000", 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036344+0000", 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036344+0000", 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8999999999999997e-07 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036347+0000", 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2540000000000001e-06 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036355+0000", 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1740000000000003e-06 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036360+0000", 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164120 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028002+0000", 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0084751510000000002, 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014018037000000001, 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.487 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164120 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028002+0000", 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028002+0000", 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028003+0000", 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1199999999999998e-07 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028005+0000", 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028011+0000", 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7440000000000004e-06 2024-09-11T06:19:57.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028015+0000", 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.763e-06 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164151 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029921+0000", 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065562379999999998, 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012153683, 2024-09-11T06:19:57.490 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164151 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029921+0000", 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029921+0000", 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029922+0000", 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2199999999999999e-07 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029924+0000", 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9530000000000002e-06 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029929+0000", 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4759999999999997e-06 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029934+0000", 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5750000000000002e-06 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164183 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032851+0000", 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0036262220000000001, 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092774750000000003, 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164183 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032851+0000", 2024-09-11T06:19:57.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032851+0000", 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032852+0000", 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6499999999999999e-07 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032855+0000", 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0000000000000001e-06 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032862+0000", 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4839999999999998e-06 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032868+0000", 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5040000000000002e-06 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.496 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164215 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036380+0000", 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.7671999999999996e-05, 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058046840000000001, 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164215 2024-09-11T06:19:57.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036380+0000", 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036380+0000", 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036380+0000", 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3399999999999999e-07 2024-09-11T06:19:57.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036383+0000", 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036392+0000", 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0529999999999996e-06 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036397+0000", 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0719999999999999e-06 2024-09-11T06:19:57.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164089 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026246+0000", 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010231659000000001, 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015988254, 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164089 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026246+0000", 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026246+0000", 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026246+0000", 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1099999999999995e-07 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026250+0000", 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8210000000000003e-06 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026265+0000", 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4800999999999999e-05 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026271+0000", 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4459999999999998e-06 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164121 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028021+0000", 2024-09-11T06:19:57.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0084560369999999996, 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014242701999999999, 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164121 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028021+0000", 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028021+0000", 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028022+0000", 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2199999999999999e-07 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028024+0000", 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028030+0000", 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5790000000000003e-06 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028036+0000", 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1929999999999998e-06 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164152 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029940+0000", 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065377229999999996, 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012353484, 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164152 2024-09-11T06:19:57.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029940+0000", 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029940+0000", 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029940+0000", 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6699999999999999e-07 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029942+0000", 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.928e-06 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029948+0000", 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.976e-06 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029953+0000", 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164184 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.032989+0000", 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0034886610000000001, 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009333961, 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164184 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032989+0000", 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032989+0000", 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032990+0000", 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.85e-07 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.032993+0000", 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8600000000000003e-06 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033002+0000", 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3790000000000006e-06 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033008+0000", 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1040000000000003e-06 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164216 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036508+0000", 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999695, 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058429349999999996, 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164216 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036508+0000", 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036508+0000", 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036509+0000", 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4099999999999998e-07 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036512+0000", 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.658e-06 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036520+0000", 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5689999999999999e-06 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036526+0000", 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.648e-06 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.516 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164090 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026282+0000", 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.010195249999999999, 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016097088999999998, 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164090 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026282+0000", 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026282+0000", 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026283+0000", 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2900000000000003e-07 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026286+0000", 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026292+0000", 2024-09-11T06:19:57.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5089999999999999e-06 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026297+0000", 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3839999999999996e-06 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164153 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.029960+0000", 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0065176519999999996, 2024-09-11T06:19:57.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012446416, 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164153 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029960+0000", 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029960+0000", 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029960+0000", 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029962+0000", 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.024e-06 2024-09-11T06:19:57.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029968+0000", 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.029973+0000", 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164185 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.033298+0000", 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0031798310000000002, 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091656900000000006, 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164185 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033298+0000", 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033298+0000", 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033298+0000", 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3600000000000003e-07 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033302+0000", 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0520000000000003e-06 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033313+0000", 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0441999999999999e-05 2024-09-11T06:19:57.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033320+0000", 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6470000000000001e-06 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164217 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036545+0000", 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999328, 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059727169999999998, 2024-09-11T06:19:57.527 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164217 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036545+0000", 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036545+0000", 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036545+0000", 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2300000000000001e-07 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036548+0000", 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7310000000000002e-06 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036556+0000", 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.303e-06 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036562+0000", 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8540000000000002e-06 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164091 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026665+0000", 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0098129059999999997, 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015907602, 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164091 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026665+0000", 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026665+0000", 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026665+0000", 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8599999999999998e-07 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026695+0000", 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9407000000000002e-05 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026728+0000", 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3791000000000002e-05 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026736+0000", 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1489999999999997e-06 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164122 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028042+0000", 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0084355220000000009, 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014584435999999999, 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164122 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028042+0000", 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028042+0000", 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028042+0000", 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9400000000000001e-07 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028044+0000", 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:19:57.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028050+0000", 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1830000000000002e-06 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028054+0000", 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3309999999999997e-06 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164154 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030074+0000", 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0064031959999999999, 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012605211999999999, 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164154 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.538 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030074+0000", 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030074+0000", 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030075+0000", 2024-09-11T06:19:57.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9599999999999999e-07 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030079+0000", 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.788e-06 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030086+0000", 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5499999999999997e-06 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030092+0000", 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164186 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.033367+0000", 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0031102349999999998, 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093648020000000002, 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164186 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033367+0000", 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033367+0000", 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033368+0000", 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0200000000000001e-07 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033372+0000", 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7170000000000002e-06 2024-09-11T06:19:57.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033380+0000", 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5499999999999995e-06 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033386+0000", 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7429999999999999e-06 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164218 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036644+0000", 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9998336, 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006142453, 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164218 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036644+0000", 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036644+0000", 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036644+0000", 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4199999999999995e-07 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036648+0000", 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.349e-06 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036655+0000", 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4109999999999999e-06 2024-09-11T06:19:57.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036661+0000", 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8390000000000003e-06 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164092 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026748+0000", 2024-09-11T06:19:57.548 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0097299190000000001, 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016093462999999999, 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164092 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026748+0000", 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026748+0000", 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026748+0000", 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7100000000000002e-07 2024-09-11T06:19:57.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026751+0000", 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026757+0000", 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026762+0000", 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1309999999999997e-06 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164123 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028060+0000", 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0084179170000000005, 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014835542, 2024-09-11T06:19:57.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164123 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028060+0000", 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028060+0000", 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028060+0000", 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.27e-07 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028062+0000", 2024-09-11T06:19:57.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.272e-06 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028068+0000", 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0850000000000002e-06 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028073+0000", 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7940000000000002e-06 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164155 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030102+0000", 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0063750899999999999, 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012837893, 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164155 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030102+0000", 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030102+0000", 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030103+0000", 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.89e-07 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030105+0000", 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030111+0000", 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8590000000000001e-06 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030116+0000", 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5410000000000002e-06 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164187 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.033396+0000", 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0030814190000000002, 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095718639999999994, 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164187 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033396+0000", 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033396+0000", 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033396+0000", 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9999999999999998e-07 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033399+0000", 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3640000000000002e-06 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033405+0000", 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5139999999999998e-06 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033410+0000", 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6419999999999998e-06 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164219 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036741+0000", 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9997363, 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062545190000000001, 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164219 2024-09-11T06:19:57.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036741+0000", 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036741+0000", 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036742+0000", 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7100000000000001e-07 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036746+0000", 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.799e-06 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036753+0000", 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2620000000000001e-06 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036759+0000", 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9379999999999997e-06 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164093 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026771+0000", 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0097069310000000002, 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016254401000000002, 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164093 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026771+0000", 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026771+0000", 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026771+0000", 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026773+0000", 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2390000000000001e-06 2024-09-11T06:19:57.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026779+0000", 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9909999999999999e-06 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026784+0000", 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9930000000000003e-06 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164124 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028080+0000", 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0083976469999999994, 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014972627000000001, 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164124 2024-09-11T06:19:57.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028080+0000", 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028080+0000", 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028080+0000", 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8599999999999999e-07 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028083+0000", 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028089+0000", 2024-09-11T06:19:57.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0599999999999996e-06 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028093+0000", 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7040000000000002e-06 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164156 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030230+0000", 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0062471949999999997, 2024-09-11T06:19:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012849345, 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164156 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030230+0000", 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030230+0000", 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030231+0000", 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0999999999999998e-07 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030235+0000", 2024-09-11T06:19:57.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7730000000000001e-06 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030243+0000", 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030249+0000", 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1959999999999996e-06 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164188 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.033577+0000", 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0029007130000000001, 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0095296110000000003, 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164188 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033577+0000", 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033577+0000", 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033577+0000", 2024-09-11T06:19:57.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7899999999999998e-07 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033581+0000", 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.709e-06 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033592+0000", 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0582e-05 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033598+0000", 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4790000000000001e-06 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164220 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.036904+0000", 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9995737, 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062306719999999996, 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164220 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036904+0000", 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036904+0000", 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036904+0000", 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1299999999999999e-07 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036908+0000", 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8670000000000004e-06 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036916+0000", 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6369999999999999e-06 2024-09-11T06:19:57.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.036922+0000", 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0549999999999996e-06 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164094 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.026791+0000", 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0096862819999999992, 2024-09-11T06:19:57.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016383391000000001, 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164094 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026791+0000", 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026791+0000", 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026792+0000", 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026794+0000", 2024-09-11T06:19:57.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1789999999999998e-06 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026800+0000", 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1340000000000001e-06 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.026805+0000", 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9450000000000001e-06 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164125 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.028099+0000", 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0083784519999999998, 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015128035999999999, 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164125 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028099+0000", 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028099+0000", 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028099+0000", 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5400000000000002e-07 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028101+0000", 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9400000000000001e-06 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028107+0000", 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5230000000000003e-06 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.028111+0000", 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4159999999999997e-06 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164157 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.030259+0000", 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0062180239999999999, 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013021336999999999, 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164157 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030259+0000", 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030259+0000", 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030260+0000", 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8299999999999998e-07 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030262+0000", 2024-09-11T06:19:57.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3130000000000001e-06 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030268+0000", 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0209999999999996e-06 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.030273+0000", 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9930000000000003e-06 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164189 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.033608+0000", 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0028691540000000001, 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097252009999999993, 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164189 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.594 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033608+0000", 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033608+0000", 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033609+0000", 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3300000000000003e-07 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033611+0000", 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4760000000000001e-06 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033619+0000", 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2029999999999992e-06 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.033625+0000", 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:164221 3.e 3.ce7cf7ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:57.037025+0000", 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9994531, 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063584089999999998, 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:19:57.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "queued for pg", 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 164221 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.037025+0000", 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.037025+0000", 2024-09-11T06:19:57.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.037025+0000", 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7899999999999997e-07 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.037030+0000", 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4229999999999998e-06 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.037039+0000", 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8370000000000003e-06 2024-09-11T06:19:57.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.037045+0000", 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1099999999999999e-06 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 158 2024-09-11T06:19:57.600 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:19:57.602 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:19:57.602 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:57.603 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:57.603 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T06:19:57.604 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:19:57.605 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:57.605 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:57.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T06:19:57.606 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:57.607 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:57.608 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:57.608 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:57.609 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:57.601+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:19:57.702 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:57.701+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:57.803 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:57.802+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:57.806 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:57.806 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:57.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:19:57.904 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:57.903+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:58.004 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:58.004+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:58.011 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:58.011 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:58.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:19:58.106 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:58.105+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:58.206 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:58.206 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:58.207 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:58.205+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:58.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:19:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T06:19:58.249 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T06:19:58.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:19:58.307 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:58.306+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:58.396 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:58.397 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:58.407 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:58.407+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:58.410 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:19:58.508 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:58.508+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:58.594 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:58.595 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:58.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:19:58.609 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:58.608+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:58.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:58.709+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:58.768 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:58.768 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:58.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:19:58.795 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:58.796 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:19:58.811 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:58.810+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:58.812 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-11T06:19:58.447893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2012232955,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":157861,"num_read_kb":1124853,"num_write":21020,"num_write_kb":778908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2153,"num_bytes_recovered":390233422,"num_keys_recovered":598,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14903,"ondisk_log_size":14903,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":399228,"kb_used_data":106600,"kb_used_omap":36,"kb_used_meta":292443,"kb_avail":660203652,"statfs":{"total":676457349120,"available":676048539648,"internally_reserved":0,"allocated":109158400,"data_stored":788336797,"data_compressed":22725707,"data_compressed_allocated":68898816,"data_compressed_original":761081424,"omap_allocated":36911,"internal_metadata":299462609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,22,22,35,93,73,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95527155,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":16759,"num_read_kb":54720,"num_write":694,"num_write_kb":49832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":484,"num_bytes_recovered":89223990,"num_keys_recovered":184,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000679"},"pg_stats":[{"pgid":"3.1f","version":"188'269","reported_seq":2829,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223671+0000","last_change":"2024-09-11T06:19:49.193716+0000","last_active":"2024-09-11T06:19:56.223671+0000","last_peered":"2024-09-11T06:19:56.223671+0000","last_clean":"2024-09-11T06:19:56.223671+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:19:56.223671+0000","last_undegraded":"2024-09-11T06:19:56.223671+0000","last_fullsized":"2024-09-11T06:19:56.223671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:58:23.380107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090409500000000005,"stat_sum":{"num_bytes":62084536,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2167,"num_read_kb":25573,"num_write":433,"num_write_kb":25838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1e","version":"188'425","reported_seq":5334,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.512856+0000","last_change":"2024-09-11T06:19:49.192373+0000","last_active":"2024-09-11T06:19:56.512856+0000","last_peered":"2024-09-11T06:19:56.512856+0000","last_clean":"2024-09-11T06:19:56.512856+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:19:56.512856+0000","last_undegraded":"2024-09-11T06:19:56.512856+0000","last_fullsized":"2024-09-11T06:19:56.512856+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:44.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099800999999999991,"stat_sum":{"num_bytes":38328229,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":5410,"num_read_kb":20202,"num_write":613,"num_write_kb":16090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1d","version":"189'767","reported_seq":7941,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.419852+0000","last_change":"2024-09-11T06:19:50.127192+0000","last_active":"2024-09-11T06:19:57.419852+0000","last_peered":"2024-09-11T06:19:57.419852+0000","last_clean":"2024-09-11T06:19:57.419852+0000","last_became_active":"2024-09-11T06:19:50.121498+0000","last_became_peered":"2024-09-11T06:19:50.121498+0000","last_unstale":"2024-09-11T06:19:57.419852+0000","last_undegraded":"2024-09-11T06:19:57.419852+0000","last_fullsized":"2024-09-11T06:19:57.419852+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:00:07.247570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067563499999999995,"stat_sum":{"num_bytes":135493808,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":8990,"num_read_kb":80412,"num_write":1240,"num_write_kb":36407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":24673097,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1c","version":"188'496","reported_seq":10565,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229993+0000","last_change":"2024-09-11T06:19:56.125592+0000","last_active":"2024-09-11T06:19:57.229993+0000","last_peered":"2024-09-11T06:19:57.229993+0000","last_clean":"2024-09-11T06:19:57.229993+0000","last_became_active":"2024-09-11T06:19:56.122511+0000","last_became_peered":"2024-09-11T06:19:56.122511+0000","last_unstale":"2024-09-11T06:19:57.229993+0000","last_undegraded":"2024-09-11T06:19:57.229993+0000","last_fullsized":"2024-09-11T06:19:57.229993+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:26.655602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015929080000000001,"stat_sum":{"num_bytes":70743126,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":11269,"num_read_kb":45930,"num_write":781,"num_write_kb":15798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":132,"num_bytes_recovered":8705071,"num_keys_recovered":230,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1b","version":"188'450","reported_seq":3449,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251352+0000","last_change":"2024-09-11T06:19:56.124124+0000","last_active":"2024-09-11T06:19:57.251352+0000","last_peered":"2024-09-11T06:19:57.251352+0000","last_clean":"2024-09-11T06:19:57.251352+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:19:57.251352+0000","last_undegraded":"2024-09-11T06:19:57.251352+0000","last_fullsized":"2024-09-11T06:19:57.251352+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:36.256195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046902000000000001,"stat_sum":{"num_bytes":56105731,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2814,"num_read_kb":29553,"num_write":643,"num_write_kb":24835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1a","version":"163'532","reported_seq":9568,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223528+0000","last_change":"2024-09-11T06:19:49.192363+0000","last_active":"2024-09-11T06:19:56.223528+0000","last_peered":"2024-09-11T06:19:56.223528+0000","last_clean":"2024-09-11T06:19:56.223528+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:19:56.223528+0000","last_undegraded":"2024-09-11T06:19:56.223528+0000","last_fullsized":"2024-09-11T06:19:56.223528+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:34.799790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012741390000000001,"stat_sum":{"num_bytes":80209354,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":9922,"num_read_kb":64965,"num_write":729,"num_write_kb":25861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.19","version":"182'409","reported_seq":5480,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.119023+0000","last_change":"2024-09-11T06:19:50.128359+0000","last_active":"2024-09-11T06:19:56.119023+0000","last_peered":"2024-09-11T06:19:56.119023+0000","last_clean":"2024-09-11T06:19:56.119023+0000","last_became_active":"2024-09-11T06:19:50.122679+0000","last_became_peered":"2024-09-11T06:19:50.122679+0000","last_unstale":"2024-09-11T06:19:56.119023+0000","last_undegraded":"2024-09-11T06:19:56.119023+0000","last_fullsized":"2024-09-11T06:19:56.119023+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:06.808896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016887810000000001,"stat_sum":{"num_bytes":35249981,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5712,"num_read_kb":26304,"num_write":505,"num_write_kb":14477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":10623074,"num_keys_recovered":66,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.18","version":"188'999","reported_seq":5129,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223675+0000","last_change":"2024-09-11T06:19:49.192742+0000","last_active":"2024-09-11T06:19:56.223675+0000","last_peered":"2024-09-11T06:19:56.223675+0000","last_clean":"2024-09-11T06:19:56.223675+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:19:56.223675+0000","last_undegraded":"2024-09-11T06:19:56.223675+0000","last_fullsized":"2024-09-11T06:19:56.223675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:05.127046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048790299999999998,"stat_sum":{"num_bytes":46925386,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":8748,"num_read_kb":26484,"num_write":1498,"num_write_kb":24451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.17","version":"188'228","reported_seq":3757,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.591041+0000","last_change":"2024-09-11T06:19:50.124667+0000","last_active":"2024-09-11T06:19:56.591041+0000","last_peered":"2024-09-11T06:19:56.591041+0000","last_clean":"2024-09-11T06:19:56.591041+0000","last_became_active":"2024-09-11T06:19:50.123130+0000","last_became_peered":"2024-09-11T06:19:50.123130+0000","last_unstale":"2024-09-11T06:19:56.591041+0000","last_undegraded":"2024-09-11T06:19:56.591041+0000","last_fullsized":"2024-09-11T06:19:56.591041+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:47.295288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":66505904,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2738,"num_read_kb":33215,"num_write":332,"num_write_kb":20819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":9648066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.16","version":"187'492","reported_seq":5718,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120283+0000","last_change":"2024-09-11T06:19:50.125762+0000","last_active":"2024-09-11T06:19:56.120283+0000","last_peered":"2024-09-11T06:19:56.120283+0000","last_clean":"2024-09-11T06:19:56.120283+0000","last_became_active":"2024-09-11T06:19:50.124140+0000","last_became_peered":"2024-09-11T06:19:50.124140+0000","last_unstale":"2024-09-11T06:19:56.120283+0000","last_undegraded":"2024-09-11T06:19:56.120283+0000","last_fullsized":"2024-09-11T06:19:56.120283+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:50.618296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035913399999999999,"stat_sum":{"num_bytes":61909823,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6564,"num_read_kb":31654,"num_write":654,"num_write_kb":27116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":7072366,"num_keys_recovered":44,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.15","version":"188'419","reported_seq":3835,"reported_epoch":188,"state":"peering","last_fresh":"2024-09-11T06:19:57.058638+0000","last_change":"2024-09-11T06:19:57.229050+0000","last_active":"2024-09-11T06:19:57.229050+0000","last_peered":"2024-09-11T06:19:57.058638+0000","last_clean":"2024-09-11T06:19:57.058638+0000","last_became_active":"2024-09-11T06:19:50.121415+0000","last_became_peered":"2024-09-11T06:19:50.121415+0000","last_unstale":"2024-09-11T06:19:57.058638+0000","last_undegraded":"2024-09-11T06:19:57.058638+0000","last_fullsized":"2024-09-11T06:19:57.058638+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001489097,"stat_sum":{"num_bytes":78240148,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3247,"num_read_kb":34154,"num_write":607,"num_write_kb":35339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":25355348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,6],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.14","version":"183'339","reported_seq":4381,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.167779+0000","last_change":"2024-09-11T06:19:56.123816+0000","last_active":"2024-09-11T06:19:56.167779+0000","last_peered":"2024-09-11T06:19:56.167779+0000","last_clean":"2024-09-11T06:19:56.167779+0000","last_became_active":"2024-09-11T06:19:56.122634+0000","last_became_peered":"2024-09-11T06:19:56.122634+0000","last_unstale":"2024-09-11T06:19:56.167779+0000","last_undegraded":"2024-09-11T06:19:56.167779+0000","last_fullsized":"2024-09-11T06:19:56.167779+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:41.116661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049436200000000003,"stat_sum":{"num_bytes":71719921,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3218,"num_read_kb":59996,"num_write":356,"num_write_kb":36552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":54549826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228388+0000","last_change":"2024-09-11T06:19:47.188450+0000","last_active":"2024-09-11T06:19:57.228388+0000","last_peered":"2024-09-11T06:19:57.228388+0000","last_clean":"2024-09-11T06:19:57.228388+0000","last_became_active":"2024-09-11T06:19:47.188200+0000","last_became_peered":"2024-09-11T06:19:47.188200+0000","last_unstale":"2024-09-11T06:19:57.228388+0000","last_undegraded":"2024-09-11T06:19:57.228388+0000","last_fullsized":"2024-09-11T06:19:57.228388+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:52.925888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"189'260","reported_seq":4429,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251424+0000","last_change":"2024-09-11T06:19:49.194346+0000","last_active":"2024-09-11T06:19:57.251424+0000","last_peered":"2024-09-11T06:19:57.251424+0000","last_clean":"2024-09-11T06:19:57.251424+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:19:57.251424+0000","last_undegraded":"2024-09-11T06:19:57.251424+0000","last_fullsized":"2024-09-11T06:19:57.251424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:22.157613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000678957,"stat_sum":{"num_bytes":50194473,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3739,"num_read_kb":42414,"num_write":408,"num_write_kb":27593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":364,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251411+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:19:57.251411+0000","last_peered":"2024-09-11T06:19:57.251411+0000","last_clean":"2024-09-11T06:19:57.251411+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:19:57.251411+0000","last_undegraded":"2024-09-11T06:19:57.251411+0000","last_fullsized":"2024-09-11T06:19:57.251411+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"189'289","reported_seq":3192,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251446+0000","last_change":"2024-09-11T06:19:49.194745+0000","last_active":"2024-09-11T06:19:57.251446+0000","last_peered":"2024-09-11T06:19:57.251446+0000","last_clean":"2024-09-11T06:19:57.251446+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:19:57.251446+0000","last_undegraded":"2024-09-11T06:19:57.251446+0000","last_fullsized":"2024-09-11T06:19:57.251446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:12.130198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038148199999999999,"stat_sum":{"num_bytes":33433060,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2988,"num_read_kb":27549,"num_write":375,"num_write_kb":22335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251309+0000","last_change":"2024-09-11T06:19:47.187808+0000","last_active":"2024-09-11T06:19:57.251309+0000","last_peered":"2024-09-11T06:19:57.251309+0000","last_clean":"2024-09-11T06:19:57.251309+0000","last_became_active":"2024-09-11T06:19:47.187473+0000","last_became_peered":"2024-09-11T06:19:47.187473+0000","last_unstale":"2024-09-11T06:19:57.251309+0000","last_undegraded":"2024-09-11T06:19:57.251309+0000","last_fullsized":"2024-09-11T06:19:57.251309+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:23.868905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"188'768","reported_seq":5694,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172577+0000","last_change":"2024-09-11T06:19:49.192058+0000","last_active":"2024-09-11T06:19:56.172577+0000","last_peered":"2024-09-11T06:19:56.172577+0000","last_clean":"2024-09-11T06:19:56.172577+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:19:56.172577+0000","last_undegraded":"2024-09-11T06:19:56.172577+0000","last_fullsized":"2024-09-11T06:19:56.172577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:51:39.419529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010106399999999999,"stat_sum":{"num_bytes":124415450,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":7261,"num_read_kb":55643,"num_write":1186,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":352,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223732+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:19:56.223732+0000","last_peered":"2024-09-11T06:19:56.223732+0000","last_clean":"2024-09-11T06:19:56.223732+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:19:56.223732+0000","last_undegraded":"2024-09-11T06:19:56.223732+0000","last_fullsized":"2024-09-11T06:19:56.223732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"186'664","reported_seq":3743,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120253+0000","last_change":"2024-09-11T06:19:49.191823+0000","last_active":"2024-09-11T06:19:56.120253+0000","last_peered":"2024-09-11T06:19:56.120253+0000","last_clean":"2024-09-11T06:19:56.120253+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:19:56.120253+0000","last_undegraded":"2024-09-11T06:19:56.120253+0000","last_fullsized":"2024-09-11T06:19:56.120253+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:51:02.030588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074253100000000005,"stat_sum":{"num_bytes":28460382,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5016,"num_read_kb":26647,"num_write":883,"num_write_kb":14886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.3","version":"188'613","reported_seq":5051,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228181+0000","last_change":"2024-09-11T06:19:50.124211+0000","last_active":"2024-09-11T06:19:57.228181+0000","last_peered":"2024-09-11T06:19:57.228181+0000","last_clean":"2024-09-11T06:19:57.228181+0000","last_became_active":"2024-09-11T06:19:50.120579+0000","last_became_peered":"2024-09-11T06:19:50.120579+0000","last_unstale":"2024-09-11T06:19:57.228181+0000","last_undegraded":"2024-09-11T06:19:57.228181+0000","last_fullsized":"2024-09-11T06:19:57.228181+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:07:56.800367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022165990000000001,"stat_sum":{"num_bytes":62718774,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6497,"num_read_kb":31391,"num_write":732,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":24120938,"num_keys_recovered":111,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":51,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172525+0000","last_change":"2024-09-11T06:19:47.191122+0000","last_active":"2024-09-11T06:19:56.172525+0000","last_peered":"2024-09-11T06:19:56.172525+0000","last_clean":"2024-09-11T06:19:56.172525+0000","last_became_active":"2024-09-11T06:19:47.188131+0000","last_became_peered":"2024-09-11T06:19:47.188131+0000","last_unstale":"2024-09-11T06:19:56.172525+0000","last_undegraded":"2024-09-11T06:19:56.172525+0000","last_fullsized":"2024-09-11T06:19:56.172525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:44.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"188'497","reported_seq":5335,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223567+0000","last_change":"2024-09-11T06:19:49.192641+0000","last_active":"2024-09-11T06:19:56.223567+0000","last_peered":"2024-09-11T06:19:56.223567+0000","last_clean":"2024-09-11T06:19:56.223567+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:19:56.223567+0000","last_undegraded":"2024-09-11T06:19:56.223567+0000","last_fullsized":"2024-09-11T06:19:56.223567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:53.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071146299999999996,"stat_sum":{"num_bytes":80267661,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":4947,"num_read_kb":31965,"num_write":696,"num_write_kb":30980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223521+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:19:56.223521+0000","last_peered":"2024-09-11T06:19:56.223521+0000","last_clean":"2024-09-11T06:19:56.223521+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:19:56.223521+0000","last_undegraded":"2024-09-11T06:19:56.223521+0000","last_fullsized":"2024-09-11T06:19:56.223521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"188'730","reported_seq":3131,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172546+0000","last_change":"2024-09-11T06:19:49.192009+0000","last_active":"2024-09-11T06:19:56.172546+0000","last_peered":"2024-09-11T06:19:56.172546+0000","last_clean":"2024-09-11T06:19:56.172546+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:19:56.172546+0000","last_undegraded":"2024-09-11T06:19:56.172546+0000","last_fullsized":"2024-09-11T06:19:56.172546+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:18:31.177221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098050999999999998,"stat_sum":{"num_bytes":112278052,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3229,"num_read_kb":22731,"num_write":955,"num_write_kb":24505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223618+0000","last_change":"2024-09-11T06:19:47.188263+0000","last_active":"2024-09-11T06:19:56.223618+0000","last_peered":"2024-09-11T06:19:56.223618+0000","last_clean":"2024-09-11T06:19:56.223618+0000","last_became_active":"2024-09-11T06:19:47.187939+0000","last_became_peered":"2024-09-11T06:19:47.187939+0000","last_unstale":"2024-09-11T06:19:56.223618+0000","last_undegraded":"2024-09-11T06:19:56.223618+0000","last_fullsized":"2024-09-11T06:19:56.223618+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:37.770302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"188'511","reported_seq":4097,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251261+0000","last_change":"2024-09-11T06:19:49.194592+0000","last_active":"2024-09-11T06:19:57.251261+0000","last_peered":"2024-09-11T06:19:57.251261+0000","last_clean":"2024-09-11T06:19:57.251261+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:19:57.251261+0000","last_undegraded":"2024-09-11T06:19:57.251261+0000","last_fullsized":"2024-09-11T06:19:57.251261+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:48:24.896786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032381700000000001,"stat_sum":{"num_bytes":59378358,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":4518,"num_read_kb":23842,"num_write":727,"num_write_kb":22927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":37,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120011+0000","last_change":"2024-09-11T06:19:47.189757+0000","last_active":"2024-09-11T06:19:56.120011+0000","last_peered":"2024-09-11T06:19:56.120011+0000","last_clean":"2024-09-11T06:19:56.120011+0000","last_became_active":"2024-09-11T06:19:47.185487+0000","last_became_peered":"2024-09-11T06:19:47.185487+0000","last_unstale":"2024-09-11T06:19:56.120011+0000","last_undegraded":"2024-09-11T06:19:56.120011+0000","last_fullsized":"2024-09-11T06:19:56.120011+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:09.944076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":365,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229627+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:19:57.229627+0000","last_peered":"2024-09-11T06:19:57.229627+0000","last_clean":"2024-09-11T06:19:57.229627+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:19:57.229627+0000","last_undegraded":"2024-09-11T06:19:57.229627+0000","last_fullsized":"2024-09-11T06:19:57.229627+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"188'441","reported_seq":5361,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251251+0000","last_change":"2024-09-11T06:19:49.193802+0000","last_active":"2024-09-11T06:19:57.251251+0000","last_peered":"2024-09-11T06:19:57.251251+0000","last_clean":"2024-09-11T06:19:57.251251+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:19:57.251251+0000","last_undegraded":"2024-09-11T06:19:57.251251+0000","last_fullsized":"2024-09-11T06:19:57.251251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:50:05.140685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046523000000000002,"stat_sum":{"num_bytes":33334434,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6224,"num_read_kb":35455,"num_write":527,"num_write_kb":22174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.9","version":"187'284","reported_seq":7034,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251260+0000","last_change":"2024-09-11T06:19:50.129480+0000","last_active":"2024-09-11T06:19:57.251260+0000","last_peered":"2024-09-11T06:19:57.251260+0000","last_clean":"2024-09-11T06:19:57.251260+0000","last_became_active":"2024-09-11T06:19:50.128048+0000","last_became_peered":"2024-09-11T06:19:50.128048+0000","last_unstale":"2024-09-11T06:19:57.251260+0000","last_undegraded":"2024-09-11T06:19:57.251260+0000","last_fullsized":"2024-09-11T06:19:57.251260+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.274978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992400000000003,"stat_sum":{"num_bytes":95760503,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":6286,"num_read_kb":44468,"num_write":469,"num_write_kb":26730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":15235963,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.a","version":"189'210","reported_seq":6003,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.230467+0000","last_change":"2024-09-11T06:19:50.125552+0000","last_active":"2024-09-11T06:19:57.230467+0000","last_peered":"2024-09-11T06:19:57.230467+0000","last_clean":"2024-09-11T06:19:57.230467+0000","last_became_active":"2024-09-11T06:19:50.123705+0000","last_became_peered":"2024-09-11T06:19:50.123705+0000","last_unstale":"2024-09-11T06:19:57.230467+0000","last_undegraded":"2024-09-11T06:19:57.230467+0000","last_fullsized":"2024-09-11T06:19:57.230467+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:11.879623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094418699999999998,"stat_sum":{"num_bytes":51716839,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":5320,"num_read_kb":36761,"num_write":295,"num_write_kb":20148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":22769865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.b","version":"188'494","reported_seq":2935,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251319+0000","last_change":"2024-09-11T06:19:49.194929+0000","last_active":"2024-09-11T06:19:57.251319+0000","last_peered":"2024-09-11T06:19:57.251319+0000","last_clean":"2024-09-11T06:19:57.251319+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:19:57.251319+0000","last_undegraded":"2024-09-11T06:19:57.251319+0000","last_fullsized":"2024-09-11T06:19:57.251319+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:38.458174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048565300000000001,"stat_sum":{"num_bytes":39956180,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":2970,"num_read_kb":15088,"num_write":814,"num_write_kb":24666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.c","version":"188'519","reported_seq":2732,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228365+0000","last_change":"2024-09-11T06:19:49.194264+0000","last_active":"2024-09-11T06:19:57.228365+0000","last_peered":"2024-09-11T06:19:57.228365+0000","last_clean":"2024-09-11T06:19:57.228365+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:19:57.228365+0000","last_undegraded":"2024-09-11T06:19:57.228365+0000","last_fullsized":"2024-09-11T06:19:57.228365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:11.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002873731,"stat_sum":{"num_bytes":37030212,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3091,"num_read_kb":15528,"num_write":727,"num_write_kb":15209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.d","version":"188'456","reported_seq":3011,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229846+0000","last_change":"2024-09-11T06:19:56.125127+0000","last_active":"2024-09-11T06:19:57.229846+0000","last_peered":"2024-09-11T06:19:57.229846+0000","last_clean":"2024-09-11T06:19:57.229846+0000","last_became_active":"2024-09-11T06:19:56.122483+0000","last_became_peered":"2024-09-11T06:19:56.122483+0000","last_unstale":"2024-09-11T06:19:57.229846+0000","last_undegraded":"2024-09-11T06:19:57.229846+0000","last_fullsized":"2024-09-11T06:19:57.229846+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:12.507333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070012899999999996,"stat_sum":{"num_bytes":33118568,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2837,"num_read_kb":28141,"num_write":770,"num_write_kb":20073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":25601359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.e","version":"188'542","reported_seq":6251,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.131846+0000","last_change":"2024-09-11T06:19:56.125994+0000","last_active":"2024-09-11T06:19:56.131846+0000","last_peered":"2024-09-11T06:19:56.131846+0000","last_clean":"2024-09-11T06:19:56.131846+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:19:56.131846+0000","last_undegraded":"2024-09-11T06:19:56.131846+0000","last_fullsized":"2024-09-11T06:19:56.131846+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:28.303463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036834900000000002,"stat_sum":{"num_bytes":99594830,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":6140,"num_read_kb":43634,"num_write":693,"num_write_kb":26449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.f","version":"188'435","reported_seq":4153,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228369+0000","last_change":"2024-09-11T06:19:56.125039+0000","last_active":"2024-09-11T06:19:57.228369+0000","last_peered":"2024-09-11T06:19:57.228369+0000","last_clean":"2024-09-11T06:19:57.228369+0000","last_became_active":"2024-09-11T06:19:56.124127+0000","last_became_peered":"2024-09-11T06:19:56.124127+0000","last_unstale":"2024-09-11T06:19:57.228369+0000","last_undegraded":"2024-09-11T06:19:57.228369+0000","last_fullsized":"2024-09-11T06:19:57.228369+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:58.284935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328150000000001,"stat_sum":{"num_bytes":63473347,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":4252,"num_read_kb":30071,"num_write":548,"num_write_kb":18446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":20684206,"num_keys_recovered":71,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.10","version":"188'318","reported_seq":2745,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229737+0000","last_change":"2024-09-11T06:19:49.189008+0000","last_active":"2024-09-11T06:19:57.229737+0000","last_peered":"2024-09-11T06:19:57.229737+0000","last_clean":"2024-09-11T06:19:57.229737+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:19:57.229737+0000","last_undegraded":"2024-09-11T06:19:57.229737+0000","last_fullsized":"2024-09-11T06:19:57.229737+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:03.994337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046841500000000002,"stat_sum":{"num_bytes":66688558,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":3847,"num_read_kb":38736,"num_write":361,"num_write_kb":27515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.11","version":"164'323","reported_seq":3360,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.119110+0000","last_change":"2024-09-11T06:19:50.128631+0000","last_active":"2024-09-11T06:19:56.119110+0000","last_peered":"2024-09-11T06:19:56.119110+0000","last_clean":"2024-09-11T06:19:56.119110+0000","last_became_active":"2024-09-11T06:19:50.122616+0000","last_became_peered":"2024-09-11T06:19:50.122616+0000","last_unstale":"2024-09-11T06:19:56.119110+0000","last_undegraded":"2024-09-11T06:19:56.119110+0000","last_fullsized":"2024-09-11T06:19:56.119110+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:50:01.568681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000557669,"stat_sum":{"num_bytes":36356257,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3034,"num_read_kb":41244,"num_write":396,"num_write_kb":24272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":16507738,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.12","version":"188'264","reported_seq":2598,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.433085+0000","last_change":"2024-09-11T06:19:50.133359+0000","last_active":"2024-09-11T06:19:56.433085+0000","last_peered":"2024-09-11T06:19:56.433085+0000","last_clean":"2024-09-11T06:19:56.433085+0000","last_became_active":"2024-09-11T06:19:50.131986+0000","last_became_peered":"2024-09-11T06:19:50.131986+0000","last_unstale":"2024-09-11T06:19:56.433085+0000","last_undegraded":"2024-09-11T06:19:56.433085+0000","last_fullsized":"2024-09-11T06:19:56.433085+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:43.656253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048053100000000002,"stat_sum":{"num_bytes":40130212,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1750,"num_read_kb":21764,"num_write":410,"num_write_kb":20134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":7880826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.13","version":"187'340","reported_seq":3623,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228299+0000","last_change":"2024-09-11T06:19:50.127179+0000","last_active":"2024-09-11T06:19:57.228299+0000","last_peered":"2024-09-11T06:19:57.228299+0000","last_clean":"2024-09-11T06:19:57.228299+0000","last_became_active":"2024-09-11T06:19:50.124659+0000","last_became_peered":"2024-09-11T06:19:50.124659+0000","last_unstale":"2024-09-11T06:19:57.228299+0000","last_undegraded":"2024-09-11T06:19:57.228299+0000","last_fullsized":"2024-09-11T06:19:57.228299+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:55:26.659009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224831,"stat_sum":{"num_bytes":59820471,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3000,"num_read_kb":33239,"num_write":496,"num_write_kb":24439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":69,"num_bytes_recovered":11320632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2011642568,"num_objects":1125,"num_object_clones":0,"num_object_copies":2250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1125,"num_whiteouts":0,"num_read":157745,"num_read_kb":1124753,"num_write":20859,"num_write_kb":776490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2151,"num_bytes_recovered":390233403,"num_keys_recovered":598,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114278400,"data_stored":966394882,"data_compressed":28176409,"data_compressed_allocated":85282816,"data_compressed_original":943346125,"omap_allocated":25754,"internal_metadata":0},"log_size":14783,"ondisk_log_size":14783,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63268,"kb_used_data":14032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94308572,"statfs":{"total":96636764160,"available":96571977728,"internally_reserved":0,"allocated":14368768,"data_stored":99945342,"data_compressed":2962328,"data_compressed_allocated":8826880,"data_compressed_original":96217252,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38700,"kb_used_data":11664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333140,"statfs":{"total":96636764160,"available":96597135360,"internally_reserved":0,"allocated":11943936,"data_stored":84281096,"data_compressed":1993066,"data_compressed_allocated":6995968,"data_compressed_original":81038039,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":64424509480,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748493,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58312,"kb_used_data":20972,"kb_used_omap":18,"kb_used_meta":37293,"kb_avail":94313528,"statfs":{"total":96636764160,"available":96577052672,"internally_reserved":0,"allocated":21475328,"data_stored":160484107,"data_compressed":4757031,"data_compressed_allocated":14184448,"data_compressed_original":155452062,"omap_allocated":18586,"internal_metadata":38188902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,22,22,35,93,73,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991253,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55028,"kb_used_data":18148,"kb_used_omap":10,"kb_used_meta":36853,"kb_avail":94316812,"statfs":{"total":96636764160,"available":96580415488,"internally_reserved":0,"allocated":18583552,"data_stored":144535944,"data_compressed":4281343,"data_compressed_allocated":12738560,"data_compressed_original":140621379,"omap_allocated":10357,"internal_metadata":37738379},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73224,"kb_used_data":19832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94298616,"statfs":{"total":96636764160,"available":96561782784,"internally_reserved":0,"allocated":20307968,"data_stored":154523341,"data_compressed":4606143,"data_compressed_allocated":13606912,"data_compressed_original":149881805,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59076,"kb_used_data":9844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312764,"statfs":{"total":96636764160,"available":96576270336,"internally_reserved":0,"allocated":10080256,"data_stored":62119519,"data_compressed":1767585,"data_compressed_allocated":5341184,"data_compressed_original":58950695,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51620,"kb_used_data":12108,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320220,"statfs":{"total":96636764160,"available":96583905280,"internally_reserved":0,"allocated":12398592,"data_stored":82447448,"data_compressed":2358211,"data_compressed_allocated":7204864,"data_compressed_original":78920192,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18268160,"data_stored":156493577,"data_compressed":4646521,"data_compressed_allocated":13819904,"data_compressed_original":152961997,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16445440,"data_stored":145452085,"data_compressed":4312127,"data_compressed_allocated":12886016,"data_compressed_original":142669379,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19255296,"data_stored":159784763,"data_compressed":4759190,"data_compressed_allocated":14213120,"data_compressed_original":155861662,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20107264,"data_stored":174081139,"data_compressed":5297076,"data_compressed_allocated":15564800,"data_compressed_original":170484605,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9981952,"data_stored":87360488,"data_compressed":2063691,"data_compressed_allocated":7294976,"data_compressed_original":85232343,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12050432,"data_stored":98240062,"data_compressed":2953659,"data_compressed_allocated":8790016,"data_compressed_original":95643812,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7958528,"data_stored":63107708,"data_compressed":1776926,"data_compressed_allocated":5472256,"data_compressed_original":61047847,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10211328,"data_stored":81875060,"data_compressed":2367219,"data_compressed_allocated":7241728,"data_compressed_original":79444480,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:19:58.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:19:58.912 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:58.911+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:58.930 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:58.930 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:58.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:19:59.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:59.012+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:59.085 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:59.085 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:59.096 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:19:59.140 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:19:59.139+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:19:59.201 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:59.202 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:59.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:19:59.252 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:19:59.251+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:19:59.269 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:59.270 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:19:59.284 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-11T06:19:59.233152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2012232955,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":157861,"num_read_kb":1124853,"num_write":21020,"num_write_kb":778908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2153,"num_bytes_recovered":390233422,"num_keys_recovered":598,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14903,"ondisk_log_size":14903,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":399228,"kb_used_data":106600,"kb_used_omap":36,"kb_used_meta":292443,"kb_avail":660203652,"statfs":{"total":676457349120,"available":676048539648,"internally_reserved":0,"allocated":109158400,"data_stored":788336797,"data_compressed":22725707,"data_compressed_allocated":68898816,"data_compressed_original":761081424,"omap_allocated":36911,"internal_metadata":299462609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,22,22,35,93,73,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95527155,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":16759,"num_read_kb":54720,"num_write":694,"num_write_kb":49832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":484,"num_bytes_recovered":89223990,"num_keys_recovered":184,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.110282"},"pg_stats":[{"pgid":"3.1f","version":"188'269","reported_seq":2829,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223671+0000","last_change":"2024-09-11T06:19:49.193716+0000","last_active":"2024-09-11T06:19:56.223671+0000","last_peered":"2024-09-11T06:19:56.223671+0000","last_clean":"2024-09-11T06:19:56.223671+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:19:56.223671+0000","last_undegraded":"2024-09-11T06:19:56.223671+0000","last_fullsized":"2024-09-11T06:19:56.223671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:58:23.380107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090409500000000005,"stat_sum":{"num_bytes":62084536,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2167,"num_read_kb":25573,"num_write":433,"num_write_kb":25838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1e","version":"188'425","reported_seq":5334,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.512856+0000","last_change":"2024-09-11T06:19:49.192373+0000","last_active":"2024-09-11T06:19:56.512856+0000","last_peered":"2024-09-11T06:19:56.512856+0000","last_clean":"2024-09-11T06:19:56.512856+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:19:56.512856+0000","last_undegraded":"2024-09-11T06:19:56.512856+0000","last_fullsized":"2024-09-11T06:19:56.512856+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:44.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099800999999999991,"stat_sum":{"num_bytes":38328229,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":5410,"num_read_kb":20202,"num_write":613,"num_write_kb":16090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1d","version":"189'767","reported_seq":7941,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.419852+0000","last_change":"2024-09-11T06:19:50.127192+0000","last_active":"2024-09-11T06:19:57.419852+0000","last_peered":"2024-09-11T06:19:57.419852+0000","last_clean":"2024-09-11T06:19:57.419852+0000","last_became_active":"2024-09-11T06:19:50.121498+0000","last_became_peered":"2024-09-11T06:19:50.121498+0000","last_unstale":"2024-09-11T06:19:57.419852+0000","last_undegraded":"2024-09-11T06:19:57.419852+0000","last_fullsized":"2024-09-11T06:19:57.419852+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:00:07.247570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067563499999999995,"stat_sum":{"num_bytes":135493808,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":8990,"num_read_kb":80412,"num_write":1240,"num_write_kb":36407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":24673097,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1c","version":"188'496","reported_seq":10565,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229993+0000","last_change":"2024-09-11T06:19:56.125592+0000","last_active":"2024-09-11T06:19:57.229993+0000","last_peered":"2024-09-11T06:19:57.229993+0000","last_clean":"2024-09-11T06:19:57.229993+0000","last_became_active":"2024-09-11T06:19:56.122511+0000","last_became_peered":"2024-09-11T06:19:56.122511+0000","last_unstale":"2024-09-11T06:19:57.229993+0000","last_undegraded":"2024-09-11T06:19:57.229993+0000","last_fullsized":"2024-09-11T06:19:57.229993+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:26.655602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015929080000000001,"stat_sum":{"num_bytes":70743126,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":11269,"num_read_kb":45930,"num_write":781,"num_write_kb":15798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":132,"num_bytes_recovered":8705071,"num_keys_recovered":230,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1b","version":"188'450","reported_seq":3449,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251352+0000","last_change":"2024-09-11T06:19:56.124124+0000","last_active":"2024-09-11T06:19:57.251352+0000","last_peered":"2024-09-11T06:19:57.251352+0000","last_clean":"2024-09-11T06:19:57.251352+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:19:57.251352+0000","last_undegraded":"2024-09-11T06:19:57.251352+0000","last_fullsized":"2024-09-11T06:19:57.251352+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:36.256195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046902000000000001,"stat_sum":{"num_bytes":56105731,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2814,"num_read_kb":29553,"num_write":643,"num_write_kb":24835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1a","version":"163'532","reported_seq":9568,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223528+0000","last_change":"2024-09-11T06:19:49.192363+0000","last_active":"2024-09-11T06:19:56.223528+0000","last_peered":"2024-09-11T06:19:56.223528+0000","last_clean":"2024-09-11T06:19:56.223528+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:19:56.223528+0000","last_undegraded":"2024-09-11T06:19:56.223528+0000","last_fullsized":"2024-09-11T06:19:56.223528+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:34.799790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012741390000000001,"stat_sum":{"num_bytes":80209354,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":9922,"num_read_kb":64965,"num_write":729,"num_write_kb":25861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.19","version":"182'409","reported_seq":5480,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.119023+0000","last_change":"2024-09-11T06:19:50.128359+0000","last_active":"2024-09-11T06:19:56.119023+0000","last_peered":"2024-09-11T06:19:56.119023+0000","last_clean":"2024-09-11T06:19:56.119023+0000","last_became_active":"2024-09-11T06:19:50.122679+0000","last_became_peered":"2024-09-11T06:19:50.122679+0000","last_unstale":"2024-09-11T06:19:56.119023+0000","last_undegraded":"2024-09-11T06:19:56.119023+0000","last_fullsized":"2024-09-11T06:19:56.119023+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:06.808896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016887810000000001,"stat_sum":{"num_bytes":35249981,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5712,"num_read_kb":26304,"num_write":505,"num_write_kb":14477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":10623074,"num_keys_recovered":66,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.18","version":"188'999","reported_seq":5129,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223675+0000","last_change":"2024-09-11T06:19:49.192742+0000","last_active":"2024-09-11T06:19:56.223675+0000","last_peered":"2024-09-11T06:19:56.223675+0000","last_clean":"2024-09-11T06:19:56.223675+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:19:56.223675+0000","last_undegraded":"2024-09-11T06:19:56.223675+0000","last_fullsized":"2024-09-11T06:19:56.223675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:05.127046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048790299999999998,"stat_sum":{"num_bytes":46925386,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":8748,"num_read_kb":26484,"num_write":1498,"num_write_kb":24451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.17","version":"188'228","reported_seq":3757,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.591041+0000","last_change":"2024-09-11T06:19:50.124667+0000","last_active":"2024-09-11T06:19:56.591041+0000","last_peered":"2024-09-11T06:19:56.591041+0000","last_clean":"2024-09-11T06:19:56.591041+0000","last_became_active":"2024-09-11T06:19:50.123130+0000","last_became_peered":"2024-09-11T06:19:50.123130+0000","last_unstale":"2024-09-11T06:19:56.591041+0000","last_undegraded":"2024-09-11T06:19:56.591041+0000","last_fullsized":"2024-09-11T06:19:56.591041+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:47.295288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":66505904,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2738,"num_read_kb":33215,"num_write":332,"num_write_kb":20819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":9648066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.16","version":"187'492","reported_seq":5718,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120283+0000","last_change":"2024-09-11T06:19:50.125762+0000","last_active":"2024-09-11T06:19:56.120283+0000","last_peered":"2024-09-11T06:19:56.120283+0000","last_clean":"2024-09-11T06:19:56.120283+0000","last_became_active":"2024-09-11T06:19:50.124140+0000","last_became_peered":"2024-09-11T06:19:50.124140+0000","last_unstale":"2024-09-11T06:19:56.120283+0000","last_undegraded":"2024-09-11T06:19:56.120283+0000","last_fullsized":"2024-09-11T06:19:56.120283+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:50.618296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035913399999999999,"stat_sum":{"num_bytes":61909823,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6564,"num_read_kb":31654,"num_write":654,"num_write_kb":27116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":7072366,"num_keys_recovered":44,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.15","version":"188'419","reported_seq":3835,"reported_epoch":188,"state":"peering","last_fresh":"2024-09-11T06:19:57.058638+0000","last_change":"2024-09-11T06:19:57.229050+0000","last_active":"2024-09-11T06:19:57.229050+0000","last_peered":"2024-09-11T06:19:57.058638+0000","last_clean":"2024-09-11T06:19:57.058638+0000","last_became_active":"2024-09-11T06:19:50.121415+0000","last_became_peered":"2024-09-11T06:19:50.121415+0000","last_unstale":"2024-09-11T06:19:57.058638+0000","last_undegraded":"2024-09-11T06:19:57.058638+0000","last_fullsized":"2024-09-11T06:19:57.058638+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001489097,"stat_sum":{"num_bytes":78240148,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3247,"num_read_kb":34154,"num_write":607,"num_write_kb":35339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":25355348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,6],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.14","version":"183'339","reported_seq":4381,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.167779+0000","last_change":"2024-09-11T06:19:56.123816+0000","last_active":"2024-09-11T06:19:56.167779+0000","last_peered":"2024-09-11T06:19:56.167779+0000","last_clean":"2024-09-11T06:19:56.167779+0000","last_became_active":"2024-09-11T06:19:56.122634+0000","last_became_peered":"2024-09-11T06:19:56.122634+0000","last_unstale":"2024-09-11T06:19:56.167779+0000","last_undegraded":"2024-09-11T06:19:56.167779+0000","last_fullsized":"2024-09-11T06:19:56.167779+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:41.116661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049436200000000003,"stat_sum":{"num_bytes":71719921,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3218,"num_read_kb":59996,"num_write":356,"num_write_kb":36552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":54549826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228388+0000","last_change":"2024-09-11T06:19:47.188450+0000","last_active":"2024-09-11T06:19:57.228388+0000","last_peered":"2024-09-11T06:19:57.228388+0000","last_clean":"2024-09-11T06:19:57.228388+0000","last_became_active":"2024-09-11T06:19:47.188200+0000","last_became_peered":"2024-09-11T06:19:47.188200+0000","last_unstale":"2024-09-11T06:19:57.228388+0000","last_undegraded":"2024-09-11T06:19:57.228388+0000","last_fullsized":"2024-09-11T06:19:57.228388+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:52.925888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"189'260","reported_seq":4429,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251424+0000","last_change":"2024-09-11T06:19:49.194346+0000","last_active":"2024-09-11T06:19:57.251424+0000","last_peered":"2024-09-11T06:19:57.251424+0000","last_clean":"2024-09-11T06:19:57.251424+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:19:57.251424+0000","last_undegraded":"2024-09-11T06:19:57.251424+0000","last_fullsized":"2024-09-11T06:19:57.251424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:22.157613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000678957,"stat_sum":{"num_bytes":50194473,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3739,"num_read_kb":42414,"num_write":408,"num_write_kb":27593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":364,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251411+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:19:57.251411+0000","last_peered":"2024-09-11T06:19:57.251411+0000","last_clean":"2024-09-11T06:19:57.251411+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:19:57.251411+0000","last_undegraded":"2024-09-11T06:19:57.251411+0000","last_fullsized":"2024-09-11T06:19:57.251411+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"189'289","reported_seq":3192,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251446+0000","last_change":"2024-09-11T06:19:49.194745+0000","last_active":"2024-09-11T06:19:57.251446+0000","last_peered":"2024-09-11T06:19:57.251446+0000","last_clean":"2024-09-11T06:19:57.251446+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:19:57.251446+0000","last_undegraded":"2024-09-11T06:19:57.251446+0000","last_fullsized":"2024-09-11T06:19:57.251446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:12.130198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038148199999999999,"stat_sum":{"num_bytes":33433060,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2988,"num_read_kb":27549,"num_write":375,"num_write_kb":22335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251309+0000","last_change":"2024-09-11T06:19:47.187808+0000","last_active":"2024-09-11T06:19:57.251309+0000","last_peered":"2024-09-11T06:19:57.251309+0000","last_clean":"2024-09-11T06:19:57.251309+0000","last_became_active":"2024-09-11T06:19:47.187473+0000","last_became_peered":"2024-09-11T06:19:47.187473+0000","last_unstale":"2024-09-11T06:19:57.251309+0000","last_undegraded":"2024-09-11T06:19:57.251309+0000","last_fullsized":"2024-09-11T06:19:57.251309+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:23.868905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"188'768","reported_seq":5694,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172577+0000","last_change":"2024-09-11T06:19:49.192058+0000","last_active":"2024-09-11T06:19:56.172577+0000","last_peered":"2024-09-11T06:19:56.172577+0000","last_clean":"2024-09-11T06:19:56.172577+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:19:56.172577+0000","last_undegraded":"2024-09-11T06:19:56.172577+0000","last_fullsized":"2024-09-11T06:19:56.172577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:51:39.419529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010106399999999999,"stat_sum":{"num_bytes":124415450,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":7261,"num_read_kb":55643,"num_write":1186,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":352,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223732+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:19:56.223732+0000","last_peered":"2024-09-11T06:19:56.223732+0000","last_clean":"2024-09-11T06:19:56.223732+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:19:56.223732+0000","last_undegraded":"2024-09-11T06:19:56.223732+0000","last_fullsized":"2024-09-11T06:19:56.223732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"186'664","reported_seq":3743,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120253+0000","last_change":"2024-09-11T06:19:49.191823+0000","last_active":"2024-09-11T06:19:56.120253+0000","last_peered":"2024-09-11T06:19:56.120253+0000","last_clean":"2024-09-11T06:19:56.120253+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:19:56.120253+0000","last_undegraded":"2024-09-11T06:19:56.120253+0000","last_fullsized":"2024-09-11T06:19:56.120253+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:51:02.030588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074253100000000005,"stat_sum":{"num_bytes":28460382,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5016,"num_read_kb":26647,"num_write":883,"num_write_kb":14886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.3","version":"188'613","reported_seq":5051,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228181+0000","last_change":"2024-09-11T06:19:50.124211+0000","last_active":"2024-09-11T06:19:57.228181+0000","last_peered":"2024-09-11T06:19:57.228181+0000","last_clean":"2024-09-11T06:19:57.228181+0000","last_became_active":"2024-09-11T06:19:50.120579+0000","last_became_peered":"2024-09-11T06:19:50.120579+0000","last_unstale":"2024-09-11T06:19:57.228181+0000","last_undegraded":"2024-09-11T06:19:57.228181+0000","last_fullsized":"2024-09-11T06:19:57.228181+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:07:56.800367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022165990000000001,"stat_sum":{"num_bytes":62718774,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6497,"num_read_kb":31391,"num_write":732,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":24120938,"num_keys_recovered":111,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":51,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172525+0000","last_change":"2024-09-11T06:19:47.191122+0000","last_active":"2024-09-11T06:19:56.172525+0000","last_peered":"2024-09-11T06:19:56.172525+0000","last_clean":"2024-09-11T06:19:56.172525+0000","last_became_active":"2024-09-11T06:19:47.188131+0000","last_became_peered":"2024-09-11T06:19:47.188131+0000","last_unstale":"2024-09-11T06:19:56.172525+0000","last_undegraded":"2024-09-11T06:19:56.172525+0000","last_fullsized":"2024-09-11T06:19:56.172525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:44.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"188'497","reported_seq":5335,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223567+0000","last_change":"2024-09-11T06:19:49.192641+0000","last_active":"2024-09-11T06:19:56.223567+0000","last_peered":"2024-09-11T06:19:56.223567+0000","last_clean":"2024-09-11T06:19:56.223567+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:19:56.223567+0000","last_undegraded":"2024-09-11T06:19:56.223567+0000","last_fullsized":"2024-09-11T06:19:56.223567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:53.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071146299999999996,"stat_sum":{"num_bytes":80267661,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":4947,"num_read_kb":31965,"num_write":696,"num_write_kb":30980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223521+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:19:56.223521+0000","last_peered":"2024-09-11T06:19:56.223521+0000","last_clean":"2024-09-11T06:19:56.223521+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:19:56.223521+0000","last_undegraded":"2024-09-11T06:19:56.223521+0000","last_fullsized":"2024-09-11T06:19:56.223521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"188'730","reported_seq":3131,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172546+0000","last_change":"2024-09-11T06:19:49.192009+0000","last_active":"2024-09-11T06:19:56.172546+0000","last_peered":"2024-09-11T06:19:56.172546+0000","last_clean":"2024-09-11T06:19:56.172546+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:19:56.172546+0000","last_undegraded":"2024-09-11T06:19:56.172546+0000","last_fullsized":"2024-09-11T06:19:56.172546+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:18:31.177221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098050999999999998,"stat_sum":{"num_bytes":112278052,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3229,"num_read_kb":22731,"num_write":955,"num_write_kb":24505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223618+0000","last_change":"2024-09-11T06:19:47.188263+0000","last_active":"2024-09-11T06:19:56.223618+0000","last_peered":"2024-09-11T06:19:56.223618+0000","last_clean":"2024-09-11T06:19:56.223618+0000","last_became_active":"2024-09-11T06:19:47.187939+0000","last_became_peered":"2024-09-11T06:19:47.187939+0000","last_unstale":"2024-09-11T06:19:56.223618+0000","last_undegraded":"2024-09-11T06:19:56.223618+0000","last_fullsized":"2024-09-11T06:19:56.223618+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:37.770302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"188'511","reported_seq":4097,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251261+0000","last_change":"2024-09-11T06:19:49.194592+0000","last_active":"2024-09-11T06:19:57.251261+0000","last_peered":"2024-09-11T06:19:57.251261+0000","last_clean":"2024-09-11T06:19:57.251261+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:19:57.251261+0000","last_undegraded":"2024-09-11T06:19:57.251261+0000","last_fullsized":"2024-09-11T06:19:57.251261+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:48:24.896786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032381700000000001,"stat_sum":{"num_bytes":59378358,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":4518,"num_read_kb":23842,"num_write":727,"num_write_kb":22927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":37,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120011+0000","last_change":"2024-09-11T06:19:47.189757+0000","last_active":"2024-09-11T06:19:56.120011+0000","last_peered":"2024-09-11T06:19:56.120011+0000","last_clean":"2024-09-11T06:19:56.120011+0000","last_became_active":"2024-09-11T06:19:47.185487+0000","last_became_peered":"2024-09-11T06:19:47.185487+0000","last_unstale":"2024-09-11T06:19:56.120011+0000","last_undegraded":"2024-09-11T06:19:56.120011+0000","last_fullsized":"2024-09-11T06:19:56.120011+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:09.944076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":365,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229627+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:19:57.229627+0000","last_peered":"2024-09-11T06:19:57.229627+0000","last_clean":"2024-09-11T06:19:57.229627+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:19:57.229627+0000","last_undegraded":"2024-09-11T06:19:57.229627+0000","last_fullsized":"2024-09-11T06:19:57.229627+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"188'441","reported_seq":5361,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251251+0000","last_change":"2024-09-11T06:19:49.193802+0000","last_active":"2024-09-11T06:19:57.251251+0000","last_peered":"2024-09-11T06:19:57.251251+0000","last_clean":"2024-09-11T06:19:57.251251+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:19:57.251251+0000","last_undegraded":"2024-09-11T06:19:57.251251+0000","last_fullsized":"2024-09-11T06:19:57.251251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:50:05.140685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046523000000000002,"stat_sum":{"num_bytes":33334434,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6224,"num_read_kb":35455,"num_write":527,"num_write_kb":22174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.9","version":"187'284","reported_seq":7034,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251260+0000","last_change":"2024-09-11T06:19:50.129480+0000","last_active":"2024-09-11T06:19:57.251260+0000","last_peered":"2024-09-11T06:19:57.251260+0000","last_clean":"2024-09-11T06:19:57.251260+0000","last_became_active":"2024-09-11T06:19:50.128048+0000","last_became_peered":"2024-09-11T06:19:50.128048+0000","last_unstale":"2024-09-11T06:19:57.251260+0000","last_undegraded":"2024-09-11T06:19:57.251260+0000","last_fullsized":"2024-09-11T06:19:57.251260+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.274978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992400000000003,"stat_sum":{"num_bytes":95760503,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":6286,"num_read_kb":44468,"num_write":469,"num_write_kb":26730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":15235963,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.a","version":"189'210","reported_seq":6003,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.230467+0000","last_change":"2024-09-11T06:19:50.125552+0000","last_active":"2024-09-11T06:19:57.230467+0000","last_peered":"2024-09-11T06:19:57.230467+0000","last_clean":"2024-09-11T06:19:57.230467+0000","last_became_active":"2024-09-11T06:19:50.123705+0000","last_became_peered":"2024-09-11T06:19:50.123705+0000","last_unstale":"2024-09-11T06:19:57.230467+0000","last_undegraded":"2024-09-11T06:19:57.230467+0000","last_fullsized":"2024-09-11T06:19:57.230467+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:11.879623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094418699999999998,"stat_sum":{"num_bytes":51716839,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":5320,"num_read_kb":36761,"num_write":295,"num_write_kb":20148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":22769865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.b","version":"188'494","reported_seq":2935,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251319+0000","last_change":"2024-09-11T06:19:49.194929+0000","last_active":"2024-09-11T06:19:57.251319+0000","last_peered":"2024-09-11T06:19:57.251319+0000","last_clean":"2024-09-11T06:19:57.251319+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:19:57.251319+0000","last_undegraded":"2024-09-11T06:19:57.251319+0000","last_fullsized":"2024-09-11T06:19:57.251319+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:38.458174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048565300000000001,"stat_sum":{"num_bytes":39956180,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":2970,"num_read_kb":15088,"num_write":814,"num_write_kb":24666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.c","version":"188'519","reported_seq":2732,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228365+0000","last_change":"2024-09-11T06:19:49.194264+0000","last_active":"2024-09-11T06:19:57.228365+0000","last_peered":"2024-09-11T06:19:57.228365+0000","last_clean":"2024-09-11T06:19:57.228365+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:19:57.228365+0000","last_undegraded":"2024-09-11T06:19:57.228365+0000","last_fullsized":"2024-09-11T06:19:57.228365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:11.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002873731,"stat_sum":{"num_bytes":37030212,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3091,"num_read_kb":15528,"num_write":727,"num_write_kb":15209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.d","version":"188'456","reported_seq":3011,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229846+0000","last_change":"2024-09-11T06:19:56.125127+0000","last_active":"2024-09-11T06:19:57.229846+0000","last_peered":"2024-09-11T06:19:57.229846+0000","last_clean":"2024-09-11T06:19:57.229846+0000","last_became_active":"2024-09-11T06:19:56.122483+0000","last_became_peered":"2024-09-11T06:19:56.122483+0000","last_unstale":"2024-09-11T06:19:57.229846+0000","last_undegraded":"2024-09-11T06:19:57.229846+0000","last_fullsized":"2024-09-11T06:19:57.229846+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:12.507333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070012899999999996,"stat_sum":{"num_bytes":33118568,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2837,"num_read_kb":28141,"num_write":770,"num_write_kb":20073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":25601359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.e","version":"188'542","reported_seq":6251,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.131846+0000","last_change":"2024-09-11T06:19:56.125994+0000","last_active":"2024-09-11T06:19:56.131846+0000","last_peered":"2024-09-11T06:19:56.131846+0000","last_clean":"2024-09-11T06:19:56.131846+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:19:56.131846+0000","last_undegraded":"2024-09-11T06:19:56.131846+0000","last_fullsized":"2024-09-11T06:19:56.131846+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:28.303463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036834900000000002,"stat_sum":{"num_bytes":99594830,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":6140,"num_read_kb":43634,"num_write":693,"num_write_kb":26449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.f","version":"188'435","reported_seq":4153,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228369+0000","last_change":"2024-09-11T06:19:56.125039+0000","last_active":"2024-09-11T06:19:57.228369+0000","last_peered":"2024-09-11T06:19:57.228369+0000","last_clean":"2024-09-11T06:19:57.228369+0000","last_became_active":"2024-09-11T06:19:56.124127+0000","last_became_peered":"2024-09-11T06:19:56.124127+0000","last_unstale":"2024-09-11T06:19:57.228369+0000","last_undegraded":"2024-09-11T06:19:57.228369+0000","last_fullsized":"2024-09-11T06:19:57.228369+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:58.284935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328150000000001,"stat_sum":{"num_bytes":63473347,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":4252,"num_read_kb":30071,"num_write":548,"num_write_kb":18446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":20684206,"num_keys_recovered":71,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.10","version":"188'318","reported_seq":2745,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229737+0000","last_change":"2024-09-11T06:19:49.189008+0000","last_active":"2024-09-11T06:19:57.229737+0000","last_peered":"2024-09-11T06:19:57.229737+0000","last_clean":"2024-09-11T06:19:57.229737+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:19:57.229737+0000","last_undegraded":"2024-09-11T06:19:57.229737+0000","last_fullsized":"2024-09-11T06:19:57.229737+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:03.994337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046841500000000002,"stat_sum":{"num_bytes":66688558,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":3847,"num_read_kb":38736,"num_write":361,"num_write_kb":27515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.11","version":"164'323","reported_seq":3360,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.119110+0000","last_change":"2024-09-11T06:19:50.128631+0000","last_active":"2024-09-11T06:19:56.119110+0000","last_peered":"2024-09-11T06:19:56.119110+0000","last_clean":"2024-09-11T06:19:56.119110+0000","last_became_active":"2024-09-11T06:19:50.122616+0000","last_became_peered":"2024-09-11T06:19:50.122616+0000","last_unstale":"2024-09-11T06:19:56.119110+0000","last_undegraded":"2024-09-11T06:19:56.119110+0000","last_fullsized":"2024-09-11T06:19:56.119110+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:50:01.568681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000557669,"stat_sum":{"num_bytes":36356257,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3034,"num_read_kb":41244,"num_write":396,"num_write_kb":24272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":16507738,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.12","version":"188'264","reported_seq":2598,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.433085+0000","last_change":"2024-09-11T06:19:50.133359+0000","last_active":"2024-09-11T06:19:56.433085+0000","last_peered":"2024-09-11T06:19:56.433085+0000","last_clean":"2024-09-11T06:19:56.433085+0000","last_became_active":"2024-09-11T06:19:50.131986+0000","last_became_peered":"2024-09-11T06:19:50.131986+0000","last_unstale":"2024-09-11T06:19:56.433085+0000","last_undegraded":"2024-09-11T06:19:56.433085+0000","last_fullsized":"2024-09-11T06:19:56.433085+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:43.656253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048053100000000002,"stat_sum":{"num_bytes":40130212,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1750,"num_read_kb":21764,"num_write":410,"num_write_kb":20134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":7880826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.13","version":"187'340","reported_seq":3623,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228299+0000","last_change":"2024-09-11T06:19:50.127179+0000","last_active":"2024-09-11T06:19:57.228299+0000","last_peered":"2024-09-11T06:19:57.228299+0000","last_clean":"2024-09-11T06:19:57.228299+0000","last_became_active":"2024-09-11T06:19:50.124659+0000","last_became_peered":"2024-09-11T06:19:50.124659+0000","last_unstale":"2024-09-11T06:19:57.228299+0000","last_undegraded":"2024-09-11T06:19:57.228299+0000","last_fullsized":"2024-09-11T06:19:57.228299+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:55:26.659009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224831,"stat_sum":{"num_bytes":59820471,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3000,"num_read_kb":33239,"num_write":496,"num_write_kb":24439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":69,"num_bytes_recovered":11320632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2011642568,"num_objects":1125,"num_object_clones":0,"num_object_copies":2250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1125,"num_whiteouts":0,"num_read":157745,"num_read_kb":1124753,"num_write":20859,"num_write_kb":776490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2151,"num_bytes_recovered":390233403,"num_keys_recovered":598,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114278400,"data_stored":966394882,"data_compressed":28176409,"data_compressed_allocated":85282816,"data_compressed_original":943346125,"omap_allocated":25754,"internal_metadata":0},"log_size":14783,"ondisk_log_size":14783,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63268,"kb_used_data":14032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94308572,"statfs":{"total":96636764160,"available":96571977728,"internally_reserved":0,"allocated":14368768,"data_stored":99945342,"data_compressed":2962328,"data_compressed_allocated":8826880,"data_compressed_original":96217252,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38700,"kb_used_data":11664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333140,"statfs":{"total":96636764160,"available":96597135360,"internally_reserved":0,"allocated":11943936,"data_stored":84281096,"data_compressed":1993066,"data_compressed_allocated":6995968,"data_compressed_original":81038039,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":64424509480,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748493,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58312,"kb_used_data":20972,"kb_used_omap":18,"kb_used_meta":37293,"kb_avail":94313528,"statfs":{"total":96636764160,"available":96577052672,"internally_reserved":0,"allocated":21475328,"data_stored":160484107,"data_compressed":4757031,"data_compressed_allocated":14184448,"data_compressed_original":155452062,"omap_allocated":18586,"internal_metadata":38188902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,22,22,35,93,73,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991253,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55028,"kb_used_data":18148,"kb_used_omap":10,"kb_used_meta":36853,"kb_avail":94316812,"statfs":{"total":96636764160,"available":96580415488,"internally_reserved":0,"allocated":18583552,"data_stored":144535944,"data_compressed":4281343,"data_compressed_allocated":12738560,"data_compressed_original":140621379,"omap_allocated":10357,"internal_metadata":37738379},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73224,"kb_used_data":19832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94298616,"statfs":{"total":96636764160,"available":96561782784,"internally_reserved":0,"allocated":20307968,"data_stored":154523341,"data_compressed":4606143,"data_compressed_allocated":13606912,"data_compressed_original":149881805,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59076,"kb_used_data":9844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312764,"statfs":{"total":96636764160,"available":96576270336,"internally_reserved":0,"allocated":10080256,"data_stored":62119519,"data_compressed":1767585,"data_compressed_allocated":5341184,"data_compressed_original":58950695,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51620,"kb_used_data":12108,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320220,"statfs":{"total":96636764160,"available":96583905280,"internally_reserved":0,"allocated":12398592,"data_stored":82447448,"data_compressed":2358211,"data_compressed_allocated":7204864,"data_compressed_original":78920192,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18268160,"data_stored":156493577,"data_compressed":4646521,"data_compressed_allocated":13819904,"data_compressed_original":152961997,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16445440,"data_stored":145452085,"data_compressed":4312127,"data_compressed_allocated":12886016,"data_compressed_original":142669379,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19255296,"data_stored":159784763,"data_compressed":4759190,"data_compressed_allocated":14213120,"data_compressed_original":155861662,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20107264,"data_stored":174081139,"data_compressed":5297076,"data_compressed_allocated":15564800,"data_compressed_original":170484605,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9981952,"data_stored":87360488,"data_compressed":2063691,"data_compressed_allocated":7294976,"data_compressed_original":85232343,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12050432,"data_stored":98240062,"data_compressed":2953659,"data_compressed_allocated":8790016,"data_compressed_original":95643812,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7958528,"data_stored":63107708,"data_compressed":1776926,"data_compressed_allocated":5472256,"data_compressed_original":61047847,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10211328,"data_stored":81875060,"data_compressed":2367219,"data_compressed_allocated":7241728,"data_compressed_original":79444480,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:19:59.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T06:19:59.321 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:19:59.319+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:19:59.362 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:59.363 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:59.372 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:19:59.421 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:19:59.420+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:19:59.519 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:59.519 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:59.524 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:19:59.523+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:19:59.528 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:19:59.607 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:19:59.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:19:59.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:59.623+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:59.631 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:59.631 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:59.640 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:19:59.726 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:19:59.725+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:19:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:19:59.777 INFO:teuthology.orchestra.run.smithi070.stdout:{"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":199,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":191,"num_osds":8,"num_up_osds":8,"osd_up_since":1726035537,"num_in_osds":7,"osd_in_since":1726035586,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":40},{"state_name":"peering","count":1}],"num_pgs":41,"num_pools":3,"num_objects":1129,"data_bytes":2012232955,"bytes_used":408809472,"bytes_avail":676048539648,"bytes_total":676457349120,"inactive_pgs_ratio":0.024390242993831635,"recovering_objects_per_sec":120,"recovering_bytes_per_sec":22302206,"recovering_keys_per_sec":45,"num_objects_recovered":484,"num_bytes_recovered":89223990,"num_keys_recovered":184,"read_bytes_sec":14005939,"write_bytes_sec":12754823,"read_op_per_sec":4189,"write_op_per_sec":173},"fsmap":{"epoch":1,"btime":"2024-09-11T06:16:40:294392+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-11T06:19:56.447569+0000","services":{}},"progress_events":{}} 2024-09-11T06:19:59.785 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:59.785 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:59.792 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-11T06:19:59.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:19:59.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:19:59.827 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:19:59.827 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:19:59.837 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:59.835+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:59.851 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:19:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:19:59.870 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:19:59.870 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:19:59.890 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:19:59.890 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:19:59.898 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:19:59.898 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:19:59.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:19:59.915 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:19:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:19:59.947 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:19:59.947 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:19:59.950 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:19:59.948+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:19:59.970 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:19:59.970 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:19:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:19:59.989 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:00.041 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:00.040+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:00.057 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:00.057 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:00.057 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:00.057 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:00.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:00.116 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:20:00.129 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:00.127+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:20:00.161 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:20:00.173 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-09-11T06:20:00.117229+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2012232955,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":157861,"num_read_kb":1124853,"num_write":21020,"num_write_kb":778908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2153,"num_bytes_recovered":390233422,"num_keys_recovered":598,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14903,"ondisk_log_size":14903,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":401948,"kb_used_data":105168,"kb_used_omap":36,"kb_used_meta":296603,"kb_avail":660200932,"statfs":{"total":676457349120,"available":676045754368,"internally_reserved":0,"allocated":107692032,"data_stored":779836744,"data_compressed":22169565,"data_compressed_allocated":67821568,"data_compressed_original":752897616,"omap_allocated":36911,"internal_metadata":303722449},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,22,22,35,93,73,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95527155,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":16759,"num_read_kb":54720,"num_write":694,"num_write_kb":49832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":484,"num_bytes_recovered":89223990,"num_keys_recovered":184,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.999300"},"pg_stats":[{"pgid":"3.1f","version":"188'269","reported_seq":2829,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223671+0000","last_change":"2024-09-11T06:19:49.193716+0000","last_active":"2024-09-11T06:19:56.223671+0000","last_peered":"2024-09-11T06:19:56.223671+0000","last_clean":"2024-09-11T06:19:56.223671+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:19:56.223671+0000","last_undegraded":"2024-09-11T06:19:56.223671+0000","last_fullsized":"2024-09-11T06:19:56.223671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:58:23.380107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090409500000000005,"stat_sum":{"num_bytes":62084536,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2167,"num_read_kb":25573,"num_write":433,"num_write_kb":25838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1e","version":"188'425","reported_seq":5334,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.512856+0000","last_change":"2024-09-11T06:19:49.192373+0000","last_active":"2024-09-11T06:19:56.512856+0000","last_peered":"2024-09-11T06:19:56.512856+0000","last_clean":"2024-09-11T06:19:56.512856+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:19:56.512856+0000","last_undegraded":"2024-09-11T06:19:56.512856+0000","last_fullsized":"2024-09-11T06:19:56.512856+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:44.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099800999999999991,"stat_sum":{"num_bytes":38328229,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":5410,"num_read_kb":20202,"num_write":613,"num_write_kb":16090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1d","version":"189'767","reported_seq":7941,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.419852+0000","last_change":"2024-09-11T06:19:50.127192+0000","last_active":"2024-09-11T06:19:57.419852+0000","last_peered":"2024-09-11T06:19:57.419852+0000","last_clean":"2024-09-11T06:19:57.419852+0000","last_became_active":"2024-09-11T06:19:50.121498+0000","last_became_peered":"2024-09-11T06:19:50.121498+0000","last_unstale":"2024-09-11T06:19:57.419852+0000","last_undegraded":"2024-09-11T06:19:57.419852+0000","last_fullsized":"2024-09-11T06:19:57.419852+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:00:07.247570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067563499999999995,"stat_sum":{"num_bytes":135493808,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":8990,"num_read_kb":80412,"num_write":1240,"num_write_kb":36407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":24673097,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1c","version":"188'496","reported_seq":10565,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229993+0000","last_change":"2024-09-11T06:19:56.125592+0000","last_active":"2024-09-11T06:19:57.229993+0000","last_peered":"2024-09-11T06:19:57.229993+0000","last_clean":"2024-09-11T06:19:57.229993+0000","last_became_active":"2024-09-11T06:19:56.122511+0000","last_became_peered":"2024-09-11T06:19:56.122511+0000","last_unstale":"2024-09-11T06:19:57.229993+0000","last_undegraded":"2024-09-11T06:19:57.229993+0000","last_fullsized":"2024-09-11T06:19:57.229993+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:26.655602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015929080000000001,"stat_sum":{"num_bytes":70743126,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":11269,"num_read_kb":45930,"num_write":781,"num_write_kb":15798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":132,"num_bytes_recovered":8705071,"num_keys_recovered":230,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1b","version":"188'450","reported_seq":3449,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251352+0000","last_change":"2024-09-11T06:19:56.124124+0000","last_active":"2024-09-11T06:19:57.251352+0000","last_peered":"2024-09-11T06:19:57.251352+0000","last_clean":"2024-09-11T06:19:57.251352+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:19:57.251352+0000","last_undegraded":"2024-09-11T06:19:57.251352+0000","last_fullsized":"2024-09-11T06:19:57.251352+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:36.256195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046902000000000001,"stat_sum":{"num_bytes":56105731,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2814,"num_read_kb":29553,"num_write":643,"num_write_kb":24835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.1a","version":"163'532","reported_seq":9568,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223528+0000","last_change":"2024-09-11T06:19:49.192363+0000","last_active":"2024-09-11T06:19:56.223528+0000","last_peered":"2024-09-11T06:19:56.223528+0000","last_clean":"2024-09-11T06:19:56.223528+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:19:56.223528+0000","last_undegraded":"2024-09-11T06:19:56.223528+0000","last_fullsized":"2024-09-11T06:19:56.223528+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:34.799790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012741390000000001,"stat_sum":{"num_bytes":80209354,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":9922,"num_read_kb":64965,"num_write":729,"num_write_kb":25861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.19","version":"182'409","reported_seq":5480,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.119023+0000","last_change":"2024-09-11T06:19:50.128359+0000","last_active":"2024-09-11T06:19:56.119023+0000","last_peered":"2024-09-11T06:19:56.119023+0000","last_clean":"2024-09-11T06:19:56.119023+0000","last_became_active":"2024-09-11T06:19:50.122679+0000","last_became_peered":"2024-09-11T06:19:50.122679+0000","last_unstale":"2024-09-11T06:19:56.119023+0000","last_undegraded":"2024-09-11T06:19:56.119023+0000","last_fullsized":"2024-09-11T06:19:56.119023+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:06.808896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016887810000000001,"stat_sum":{"num_bytes":35249981,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5712,"num_read_kb":26304,"num_write":505,"num_write_kb":14477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":10623074,"num_keys_recovered":66,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.18","version":"188'999","reported_seq":5129,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223675+0000","last_change":"2024-09-11T06:19:49.192742+0000","last_active":"2024-09-11T06:19:56.223675+0000","last_peered":"2024-09-11T06:19:56.223675+0000","last_clean":"2024-09-11T06:19:56.223675+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:19:56.223675+0000","last_undegraded":"2024-09-11T06:19:56.223675+0000","last_fullsized":"2024-09-11T06:19:56.223675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:05.127046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048790299999999998,"stat_sum":{"num_bytes":46925386,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":8748,"num_read_kb":26484,"num_write":1498,"num_write_kb":24451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.17","version":"188'228","reported_seq":3757,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.591041+0000","last_change":"2024-09-11T06:19:50.124667+0000","last_active":"2024-09-11T06:19:56.591041+0000","last_peered":"2024-09-11T06:19:56.591041+0000","last_clean":"2024-09-11T06:19:56.591041+0000","last_became_active":"2024-09-11T06:19:50.123130+0000","last_became_peered":"2024-09-11T06:19:50.123130+0000","last_unstale":"2024-09-11T06:19:56.591041+0000","last_undegraded":"2024-09-11T06:19:56.591041+0000","last_fullsized":"2024-09-11T06:19:56.591041+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:47.295288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045990099999999997,"stat_sum":{"num_bytes":66505904,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2738,"num_read_kb":33215,"num_write":332,"num_write_kb":20819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":9648066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.16","version":"187'492","reported_seq":5718,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120283+0000","last_change":"2024-09-11T06:19:50.125762+0000","last_active":"2024-09-11T06:19:56.120283+0000","last_peered":"2024-09-11T06:19:56.120283+0000","last_clean":"2024-09-11T06:19:56.120283+0000","last_became_active":"2024-09-11T06:19:50.124140+0000","last_became_peered":"2024-09-11T06:19:50.124140+0000","last_unstale":"2024-09-11T06:19:56.120283+0000","last_undegraded":"2024-09-11T06:19:56.120283+0000","last_fullsized":"2024-09-11T06:19:56.120283+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:50.618296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035913399999999999,"stat_sum":{"num_bytes":61909823,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":6564,"num_read_kb":31654,"num_write":654,"num_write_kb":27116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":7072366,"num_keys_recovered":44,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.15","version":"188'419","reported_seq":3835,"reported_epoch":188,"state":"peering","last_fresh":"2024-09-11T06:19:57.058638+0000","last_change":"2024-09-11T06:19:57.229050+0000","last_active":"2024-09-11T06:19:57.229050+0000","last_peered":"2024-09-11T06:19:57.058638+0000","last_clean":"2024-09-11T06:19:57.058638+0000","last_became_active":"2024-09-11T06:19:50.121415+0000","last_became_peered":"2024-09-11T06:19:50.121415+0000","last_unstale":"2024-09-11T06:19:57.058638+0000","last_undegraded":"2024-09-11T06:19:57.058638+0000","last_fullsized":"2024-09-11T06:19:57.058638+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001489097,"stat_sum":{"num_bytes":78240148,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3247,"num_read_kb":34154,"num_write":607,"num_write_kb":35339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":25355348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,6],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.14","version":"183'339","reported_seq":4381,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.167779+0000","last_change":"2024-09-11T06:19:56.123816+0000","last_active":"2024-09-11T06:19:56.167779+0000","last_peered":"2024-09-11T06:19:56.167779+0000","last_clean":"2024-09-11T06:19:56.167779+0000","last_became_active":"2024-09-11T06:19:56.122634+0000","last_became_peered":"2024-09-11T06:19:56.122634+0000","last_unstale":"2024-09-11T06:19:56.167779+0000","last_undegraded":"2024-09-11T06:19:56.167779+0000","last_fullsized":"2024-09-11T06:19:56.167779+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:41.116661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049436200000000003,"stat_sum":{"num_bytes":71719921,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3218,"num_read_kb":59996,"num_write":356,"num_write_kb":36552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":54549826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228388+0000","last_change":"2024-09-11T06:19:47.188450+0000","last_active":"2024-09-11T06:19:57.228388+0000","last_peered":"2024-09-11T06:19:57.228388+0000","last_clean":"2024-09-11T06:19:57.228388+0000","last_became_active":"2024-09-11T06:19:47.188200+0000","last_became_peered":"2024-09-11T06:19:47.188200+0000","last_unstale":"2024-09-11T06:19:57.228388+0000","last_undegraded":"2024-09-11T06:19:57.228388+0000","last_fullsized":"2024-09-11T06:19:57.228388+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:52.925888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"189'260","reported_seq":4429,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251424+0000","last_change":"2024-09-11T06:19:49.194346+0000","last_active":"2024-09-11T06:19:57.251424+0000","last_peered":"2024-09-11T06:19:57.251424+0000","last_clean":"2024-09-11T06:19:57.251424+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:19:57.251424+0000","last_undegraded":"2024-09-11T06:19:57.251424+0000","last_fullsized":"2024-09-11T06:19:57.251424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:22.157613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000678957,"stat_sum":{"num_bytes":50194473,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3739,"num_read_kb":42414,"num_write":408,"num_write_kb":27593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":364,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251411+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:19:57.251411+0000","last_peered":"2024-09-11T06:19:57.251411+0000","last_clean":"2024-09-11T06:19:57.251411+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:19:57.251411+0000","last_undegraded":"2024-09-11T06:19:57.251411+0000","last_fullsized":"2024-09-11T06:19:57.251411+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"189'289","reported_seq":3192,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251446+0000","last_change":"2024-09-11T06:19:49.194745+0000","last_active":"2024-09-11T06:19:57.251446+0000","last_peered":"2024-09-11T06:19:57.251446+0000","last_clean":"2024-09-11T06:19:57.251446+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:19:57.251446+0000","last_undegraded":"2024-09-11T06:19:57.251446+0000","last_fullsized":"2024-09-11T06:19:57.251446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:12.130198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038148199999999999,"stat_sum":{"num_bytes":33433060,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2988,"num_read_kb":27549,"num_write":375,"num_write_kb":22335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251309+0000","last_change":"2024-09-11T06:19:47.187808+0000","last_active":"2024-09-11T06:19:57.251309+0000","last_peered":"2024-09-11T06:19:57.251309+0000","last_clean":"2024-09-11T06:19:57.251309+0000","last_became_active":"2024-09-11T06:19:47.187473+0000","last_became_peered":"2024-09-11T06:19:47.187473+0000","last_unstale":"2024-09-11T06:19:57.251309+0000","last_undegraded":"2024-09-11T06:19:57.251309+0000","last_fullsized":"2024-09-11T06:19:57.251309+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:23.868905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"188'768","reported_seq":5694,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172577+0000","last_change":"2024-09-11T06:19:49.192058+0000","last_active":"2024-09-11T06:19:56.172577+0000","last_peered":"2024-09-11T06:19:56.172577+0000","last_clean":"2024-09-11T06:19:56.172577+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:19:56.172577+0000","last_undegraded":"2024-09-11T06:19:56.172577+0000","last_fullsized":"2024-09-11T06:19:56.172577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:51:39.419529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010106399999999999,"stat_sum":{"num_bytes":124415450,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":7261,"num_read_kb":55643,"num_write":1186,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":352,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223732+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:19:56.223732+0000","last_peered":"2024-09-11T06:19:56.223732+0000","last_clean":"2024-09-11T06:19:56.223732+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:19:56.223732+0000","last_undegraded":"2024-09-11T06:19:56.223732+0000","last_fullsized":"2024-09-11T06:19:56.223732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"186'664","reported_seq":3743,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120253+0000","last_change":"2024-09-11T06:19:49.191823+0000","last_active":"2024-09-11T06:19:56.120253+0000","last_peered":"2024-09-11T06:19:56.120253+0000","last_clean":"2024-09-11T06:19:56.120253+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:19:56.120253+0000","last_undegraded":"2024-09-11T06:19:56.120253+0000","last_fullsized":"2024-09-11T06:19:56.120253+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:51:02.030588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074253100000000005,"stat_sum":{"num_bytes":28460382,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5016,"num_read_kb":26647,"num_write":883,"num_write_kb":14886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.3","version":"188'613","reported_seq":5051,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228181+0000","last_change":"2024-09-11T06:19:50.124211+0000","last_active":"2024-09-11T06:19:57.228181+0000","last_peered":"2024-09-11T06:19:57.228181+0000","last_clean":"2024-09-11T06:19:57.228181+0000","last_became_active":"2024-09-11T06:19:50.120579+0000","last_became_peered":"2024-09-11T06:19:50.120579+0000","last_unstale":"2024-09-11T06:19:57.228181+0000","last_undegraded":"2024-09-11T06:19:57.228181+0000","last_fullsized":"2024-09-11T06:19:57.228181+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:07:56.800367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022165990000000001,"stat_sum":{"num_bytes":62718774,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6497,"num_read_kb":31391,"num_write":732,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":24120938,"num_keys_recovered":111,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":51,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172525+0000","last_change":"2024-09-11T06:19:47.191122+0000","last_active":"2024-09-11T06:19:56.172525+0000","last_peered":"2024-09-11T06:19:56.172525+0000","last_clean":"2024-09-11T06:19:56.172525+0000","last_became_active":"2024-09-11T06:19:47.188131+0000","last_became_peered":"2024-09-11T06:19:47.188131+0000","last_unstale":"2024-09-11T06:19:56.172525+0000","last_undegraded":"2024-09-11T06:19:56.172525+0000","last_fullsized":"2024-09-11T06:19:56.172525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:44.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"188'497","reported_seq":5335,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223567+0000","last_change":"2024-09-11T06:19:49.192641+0000","last_active":"2024-09-11T06:19:56.223567+0000","last_peered":"2024-09-11T06:19:56.223567+0000","last_clean":"2024-09-11T06:19:56.223567+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:19:56.223567+0000","last_undegraded":"2024-09-11T06:19:56.223567+0000","last_fullsized":"2024-09-11T06:19:56.223567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:53.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071146299999999996,"stat_sum":{"num_bytes":80267661,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":4947,"num_read_kb":31965,"num_write":696,"num_write_kb":30980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223521+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:19:56.223521+0000","last_peered":"2024-09-11T06:19:56.223521+0000","last_clean":"2024-09-11T06:19:56.223521+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:19:56.223521+0000","last_undegraded":"2024-09-11T06:19:56.223521+0000","last_fullsized":"2024-09-11T06:19:56.223521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"188'730","reported_seq":3131,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.172546+0000","last_change":"2024-09-11T06:19:49.192009+0000","last_active":"2024-09-11T06:19:56.172546+0000","last_peered":"2024-09-11T06:19:56.172546+0000","last_clean":"2024-09-11T06:19:56.172546+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:19:56.172546+0000","last_undegraded":"2024-09-11T06:19:56.172546+0000","last_fullsized":"2024-09-11T06:19:56.172546+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:18:31.177221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098050999999999998,"stat_sum":{"num_bytes":112278052,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3229,"num_read_kb":22731,"num_write":955,"num_write_kb":24505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.223618+0000","last_change":"2024-09-11T06:19:47.188263+0000","last_active":"2024-09-11T06:19:56.223618+0000","last_peered":"2024-09-11T06:19:56.223618+0000","last_clean":"2024-09-11T06:19:56.223618+0000","last_became_active":"2024-09-11T06:19:47.187939+0000","last_became_peered":"2024-09-11T06:19:47.187939+0000","last_unstale":"2024-09-11T06:19:56.223618+0000","last_undegraded":"2024-09-11T06:19:56.223618+0000","last_fullsized":"2024-09-11T06:19:56.223618+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:37.770302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"188'511","reported_seq":4097,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251261+0000","last_change":"2024-09-11T06:19:49.194592+0000","last_active":"2024-09-11T06:19:57.251261+0000","last_peered":"2024-09-11T06:19:57.251261+0000","last_clean":"2024-09-11T06:19:57.251261+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:19:57.251261+0000","last_undegraded":"2024-09-11T06:19:57.251261+0000","last_fullsized":"2024-09-11T06:19:57.251261+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:48:24.896786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032381700000000001,"stat_sum":{"num_bytes":59378358,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":4518,"num_read_kb":23842,"num_write":727,"num_write_kb":22927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":37,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.120011+0000","last_change":"2024-09-11T06:19:47.189757+0000","last_active":"2024-09-11T06:19:56.120011+0000","last_peered":"2024-09-11T06:19:56.120011+0000","last_clean":"2024-09-11T06:19:56.120011+0000","last_became_active":"2024-09-11T06:19:47.185487+0000","last_became_peered":"2024-09-11T06:19:47.185487+0000","last_unstale":"2024-09-11T06:19:56.120011+0000","last_undegraded":"2024-09-11T06:19:56.120011+0000","last_fullsized":"2024-09-11T06:19:56.120011+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:09.944076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":365,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229627+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:19:57.229627+0000","last_peered":"2024-09-11T06:19:57.229627+0000","last_clean":"2024-09-11T06:19:57.229627+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:19:57.229627+0000","last_undegraded":"2024-09-11T06:19:57.229627+0000","last_fullsized":"2024-09-11T06:19:57.229627+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"188'441","reported_seq":5361,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251251+0000","last_change":"2024-09-11T06:19:49.193802+0000","last_active":"2024-09-11T06:19:57.251251+0000","last_peered":"2024-09-11T06:19:57.251251+0000","last_clean":"2024-09-11T06:19:57.251251+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:19:57.251251+0000","last_undegraded":"2024-09-11T06:19:57.251251+0000","last_fullsized":"2024-09-11T06:19:57.251251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:50:05.140685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046523000000000002,"stat_sum":{"num_bytes":33334434,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":6224,"num_read_kb":35455,"num_write":527,"num_write_kb":22174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.9","version":"187'284","reported_seq":7034,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251260+0000","last_change":"2024-09-11T06:19:50.129480+0000","last_active":"2024-09-11T06:19:57.251260+0000","last_peered":"2024-09-11T06:19:57.251260+0000","last_clean":"2024-09-11T06:19:57.251260+0000","last_became_active":"2024-09-11T06:19:50.128048+0000","last_became_peered":"2024-09-11T06:19:50.128048+0000","last_unstale":"2024-09-11T06:19:57.251260+0000","last_undegraded":"2024-09-11T06:19:57.251260+0000","last_fullsized":"2024-09-11T06:19:57.251260+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.274978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992400000000003,"stat_sum":{"num_bytes":95760503,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":6286,"num_read_kb":44468,"num_write":469,"num_write_kb":26730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":15235963,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.a","version":"189'210","reported_seq":6003,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.230467+0000","last_change":"2024-09-11T06:19:50.125552+0000","last_active":"2024-09-11T06:19:57.230467+0000","last_peered":"2024-09-11T06:19:57.230467+0000","last_clean":"2024-09-11T06:19:57.230467+0000","last_became_active":"2024-09-11T06:19:50.123705+0000","last_became_peered":"2024-09-11T06:19:50.123705+0000","last_unstale":"2024-09-11T06:19:57.230467+0000","last_undegraded":"2024-09-11T06:19:57.230467+0000","last_fullsized":"2024-09-11T06:19:57.230467+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:11.879623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094418699999999998,"stat_sum":{"num_bytes":51716839,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":5320,"num_read_kb":36761,"num_write":295,"num_write_kb":20148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":22769865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.b","version":"188'494","reported_seq":2935,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.251319+0000","last_change":"2024-09-11T06:19:49.194929+0000","last_active":"2024-09-11T06:19:57.251319+0000","last_peered":"2024-09-11T06:19:57.251319+0000","last_clean":"2024-09-11T06:19:57.251319+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:19:57.251319+0000","last_undegraded":"2024-09-11T06:19:57.251319+0000","last_fullsized":"2024-09-11T06:19:57.251319+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:38.458174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048565300000000001,"stat_sum":{"num_bytes":39956180,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":2970,"num_read_kb":15088,"num_write":814,"num_write_kb":24666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.c","version":"188'519","reported_seq":2732,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228365+0000","last_change":"2024-09-11T06:19:49.194264+0000","last_active":"2024-09-11T06:19:57.228365+0000","last_peered":"2024-09-11T06:19:57.228365+0000","last_clean":"2024-09-11T06:19:57.228365+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:19:57.228365+0000","last_undegraded":"2024-09-11T06:19:57.228365+0000","last_fullsized":"2024-09-11T06:19:57.228365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:57:11.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002873731,"stat_sum":{"num_bytes":37030212,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3091,"num_read_kb":15528,"num_write":727,"num_write_kb":15209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.d","version":"188'456","reported_seq":3011,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229846+0000","last_change":"2024-09-11T06:19:56.125127+0000","last_active":"2024-09-11T06:19:57.229846+0000","last_peered":"2024-09-11T06:19:57.229846+0000","last_clean":"2024-09-11T06:19:57.229846+0000","last_became_active":"2024-09-11T06:19:56.122483+0000","last_became_peered":"2024-09-11T06:19:56.122483+0000","last_unstale":"2024-09-11T06:19:57.229846+0000","last_undegraded":"2024-09-11T06:19:57.229846+0000","last_fullsized":"2024-09-11T06:19:57.229846+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:27:12.507333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070012899999999996,"stat_sum":{"num_bytes":33118568,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2837,"num_read_kb":28141,"num_write":770,"num_write_kb":20073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":25601359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.e","version":"188'542","reported_seq":6251,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.131846+0000","last_change":"2024-09-11T06:19:56.125994+0000","last_active":"2024-09-11T06:19:56.131846+0000","last_peered":"2024-09-11T06:19:56.131846+0000","last_clean":"2024-09-11T06:19:56.131846+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:19:56.131846+0000","last_undegraded":"2024-09-11T06:19:56.131846+0000","last_fullsized":"2024-09-11T06:19:56.131846+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:28.303463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036834900000000002,"stat_sum":{"num_bytes":99594830,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":6140,"num_read_kb":43634,"num_write":693,"num_write_kb":26449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.f","version":"188'435","reported_seq":4153,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228369+0000","last_change":"2024-09-11T06:19:56.125039+0000","last_active":"2024-09-11T06:19:57.228369+0000","last_peered":"2024-09-11T06:19:57.228369+0000","last_clean":"2024-09-11T06:19:57.228369+0000","last_became_active":"2024-09-11T06:19:56.124127+0000","last_became_peered":"2024-09-11T06:19:56.124127+0000","last_unstale":"2024-09-11T06:19:57.228369+0000","last_undegraded":"2024-09-11T06:19:57.228369+0000","last_fullsized":"2024-09-11T06:19:57.228369+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:58.284935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328150000000001,"stat_sum":{"num_bytes":63473347,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":4252,"num_read_kb":30071,"num_write":548,"num_write_kb":18446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":20684206,"num_keys_recovered":71,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.10","version":"188'318","reported_seq":2745,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.229737+0000","last_change":"2024-09-11T06:19:49.189008+0000","last_active":"2024-09-11T06:19:57.229737+0000","last_peered":"2024-09-11T06:19:57.229737+0000","last_clean":"2024-09-11T06:19:57.229737+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:19:57.229737+0000","last_undegraded":"2024-09-11T06:19:57.229737+0000","last_fullsized":"2024-09-11T06:19:57.229737+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:03.994337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046841500000000002,"stat_sum":{"num_bytes":66688558,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":3847,"num_read_kb":38736,"num_write":361,"num_write_kb":27515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.11","version":"164'323","reported_seq":3360,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.119110+0000","last_change":"2024-09-11T06:19:50.128631+0000","last_active":"2024-09-11T06:19:56.119110+0000","last_peered":"2024-09-11T06:19:56.119110+0000","last_clean":"2024-09-11T06:19:56.119110+0000","last_became_active":"2024-09-11T06:19:50.122616+0000","last_became_peered":"2024-09-11T06:19:50.122616+0000","last_unstale":"2024-09-11T06:19:56.119110+0000","last_undegraded":"2024-09-11T06:19:56.119110+0000","last_fullsized":"2024-09-11T06:19:56.119110+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:50:01.568681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000557669,"stat_sum":{"num_bytes":36356257,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3034,"num_read_kb":41244,"num_write":396,"num_write_kb":24272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":16507738,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.12","version":"188'264","reported_seq":2598,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-11T06:19:56.433085+0000","last_change":"2024-09-11T06:19:50.133359+0000","last_active":"2024-09-11T06:19:56.433085+0000","last_peered":"2024-09-11T06:19:56.433085+0000","last_clean":"2024-09-11T06:19:56.433085+0000","last_became_active":"2024-09-11T06:19:50.131986+0000","last_became_peered":"2024-09-11T06:19:50.131986+0000","last_unstale":"2024-09-11T06:19:56.433085+0000","last_undegraded":"2024-09-11T06:19:56.433085+0000","last_fullsized":"2024-09-11T06:19:56.433085+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:43.656253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048053100000000002,"stat_sum":{"num_bytes":40130212,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1750,"num_read_kb":21764,"num_write":410,"num_write_kb":20134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":7880826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"4e","length":"1"}]},{"pgid":"3.13","version":"187'340","reported_seq":3623,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-11T06:19:57.228299+0000","last_change":"2024-09-11T06:19:50.127179+0000","last_active":"2024-09-11T06:19:57.228299+0000","last_peered":"2024-09-11T06:19:57.228299+0000","last_clean":"2024-09-11T06:19:57.228299+0000","last_became_active":"2024-09-11T06:19:50.124659+0000","last_became_peered":"2024-09-11T06:19:50.124659+0000","last_unstale":"2024-09-11T06:19:57.228299+0000","last_undegraded":"2024-09-11T06:19:57.228299+0000","last_fullsized":"2024-09-11T06:19:57.228299+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:55:26.659009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224831,"stat_sum":{"num_bytes":59820471,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3000,"num_read_kb":33239,"num_write":496,"num_write_kb":24439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":69,"num_bytes_recovered":11320632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"4e","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2011642568,"num_objects":1125,"num_object_clones":0,"num_object_copies":2250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1125,"num_whiteouts":0,"num_read":157745,"num_read_kb":1124753,"num_write":20859,"num_write_kb":776490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2151,"num_bytes_recovered":390233403,"num_keys_recovered":598,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":112836608,"data_stored":958931650,"data_compressed":27618396,"data_compressed_allocated":84279296,"data_compressed_original":936223181,"omap_allocated":25754,"internal_metadata":0},"log_size":14783,"ondisk_log_size":14783,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63268,"kb_used_data":14032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94308572,"statfs":{"total":96636764160,"available":96571977728,"internally_reserved":0,"allocated":14368768,"data_stored":99945342,"data_compressed":2962328,"data_compressed_allocated":8826880,"data_compressed_original":96217252,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38700,"kb_used_data":11664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333140,"statfs":{"total":96636764160,"available":96597135360,"internally_reserved":0,"allocated":11943936,"data_stored":84281096,"data_compressed":1993066,"data_compressed_allocated":6995968,"data_compressed_original":81038039,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":64424509480,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748493,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58312,"kb_used_data":20972,"kb_used_omap":18,"kb_used_meta":37293,"kb_avail":94313528,"statfs":{"total":96636764160,"available":96577052672,"internally_reserved":0,"allocated":21475328,"data_stored":160484107,"data_compressed":4757031,"data_compressed_allocated":14184448,"data_compressed_original":155452062,"omap_allocated":18586,"internal_metadata":38188902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,22,22,35,93,73,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991253,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55028,"kb_used_data":18148,"kb_used_omap":10,"kb_used_meta":36853,"kb_avail":94316812,"statfs":{"total":96636764160,"available":96580415488,"internally_reserved":0,"allocated":18583552,"data_stored":144535944,"data_compressed":4281343,"data_compressed_allocated":12738560,"data_compressed_original":140621379,"omap_allocated":10357,"internal_metadata":37738379},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73224,"kb_used_data":19832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94298616,"statfs":{"total":96636764160,"available":96561782784,"internally_reserved":0,"allocated":20307968,"data_stored":154523341,"data_compressed":4606143,"data_compressed_allocated":13606912,"data_compressed_original":149881805,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59076,"kb_used_data":9844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312764,"statfs":{"total":96636764160,"available":96576270336,"internally_reserved":0,"allocated":10080256,"data_stored":62119519,"data_compressed":1767585,"data_compressed_allocated":5341184,"data_compressed_original":58950695,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54340,"kb_used_data":10676,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94317500,"statfs":{"total":96636764160,"available":96581120000,"internally_reserved":0,"allocated":10932224,"data_stored":73947395,"data_compressed":1802069,"data_compressed_allocated":6127616,"data_compressed_original":70736384,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18268160,"data_stored":156493577,"data_compressed":4646521,"data_compressed_allocated":13819904,"data_compressed_original":152961997,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16445440,"data_stored":145452085,"data_compressed":4312127,"data_compressed_allocated":12886016,"data_compressed_original":142669379,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19255296,"data_stored":159784763,"data_compressed":4759190,"data_compressed_allocated":14213120,"data_compressed_original":155861662,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20107264,"data_stored":174081139,"data_compressed":5297076,"data_compressed_allocated":15564800,"data_compressed_original":170484605,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9981952,"data_stored":87360488,"data_compressed":2063691,"data_compressed_allocated":7294976,"data_compressed_original":85232343,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12050432,"data_stored":98240062,"data_compressed":2953659,"data_compressed_allocated":8790016,"data_compressed_original":95643812,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7958528,"data_stored":63107708,"data_compressed":1776926,"data_compressed_allocated":5472256,"data_compressed_original":61047847,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8769536,"data_stored":74411828,"data_compressed":1809206,"data_compressed_allocated":6238208,"data_compressed_original":72321536,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:20:00.176 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:00.176 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:00.176 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:00.176 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:00.176 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:00.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:00.229 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:00.228+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:00.252 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-11T06:20:00.330 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:00.329+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:00.332 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.212470076000002, 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.333 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.334 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.334 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:20:00.334 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.334 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.334 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.334 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:20:00.335 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.336 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.338 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.212412530000002, 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.339 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.340 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:00.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.341 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.341 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.341 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.341 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:20:00.341 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:20:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.212387020999998, 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:20:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.212163853, 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:20:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.212129187000002, 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:20:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:20:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.365 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.212105025, 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.366 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.367 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:20:00.368 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.369 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.370 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211854473999999, 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.371 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:20:00.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211827092999997, 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:20:00.376 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:20:00.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211803953999997, 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.381 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:00.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:20:00.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:00.386 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211575369999998, 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.387 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:00.391 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211538236000003, 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.392 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:00.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:20:00.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211511047000002, 2024-09-11T06:20:00.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:20:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:20:00.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:20:00.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211242442, 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.404 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:20:00.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.409 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211201140999997, 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:00.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.414 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.211176033999998, 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.415 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:20:00.419 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.21093527, 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:00.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:20:00.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.210900963999997, 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:20:00.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.429 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.210880197000002, 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.430 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:20:00.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.210649674000003, 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.435 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:20:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:20:00.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118795 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 60.210608506, 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99200256799999997, 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:00.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118795 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120454+0000", 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.06e-07 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120457+0000", 2024-09-11T06:20:00.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459999999999998e-06 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120464+0000", 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1350000000000003e-06 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120470+0000", 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120511+0000", 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1316000000000002e-05 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120517+0000", 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6790000000000002e-06 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112451+0000", 2024-09-11T06:20:00.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.991934078 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112456+0000", 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.445 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:00.447 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:00.447 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:00.445+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:00.547 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:00.546+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:00.591 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:00.591 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:00.591 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:00.591 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:00.600 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:00.649 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:00.648+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:00.743 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:00.743 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:00.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:00.747+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:00.751 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:00.850 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:00.849+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:00.895 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:00.895 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.65410325100001, 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.900 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.654090513, 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.901 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:00.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:00.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.65407938000001, 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.906 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.910 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.654068792, 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:00.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.65405829700001, 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:00.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:00.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.65404798399999, 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:00.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.654037442, 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.924 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:00.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.654027136, 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.929 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.933 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.65401155800001, 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:00.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.65399255299999, 2024-09-11T06:20:00.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:00.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.59446317999999, 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.943 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.947 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.59444470899999, 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.948 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:00.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:00.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.59442621900001, 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:00.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:00.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.957 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.59440915100001, 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:00.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.59439112000001, 2024-09-11T06:20:00.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:00.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.594368936, 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.967 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:00.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.59435094400001, 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.972 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:00.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.59433329000001, 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:00.976 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:00.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:00.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.594310374, 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.981 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:00.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:00.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:00.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.985 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.985 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 132.594291986, 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:00.986 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:00.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:00.990 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:00.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:00.992 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:00.990+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:01.093 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:01.091+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:01.110 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:01.110 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:01.111 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:01.111 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:01.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:01.194 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:01.192+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:01.233 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:01.233 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:01.234 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:01.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:01.286 INFO:teuthology.orchestra.run.smithi070.stdout:5713 writesame 0x5024274 thru 0x50302fe data_size 0x1(0xc08b bytes) 2024-09-11T06:20:01.295 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:01.293+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:01.309 INFO:teuthology.orchestra.run.smithi070.stdout:5714 write 0xdb6ddae thru 0xdb7c631 (0xe884 bytes) 2024-09-11T06:20:01.318 INFO:teuthology.orchestra.run.smithi070.stdout:5718 write 0x182434d thru 0x182ad39 (0x69ed bytes) 2024-09-11T06:20:01.323 INFO:teuthology.orchestra.run.smithi070.stdout:5719 punch from 0x25fa821 to 0x26093be, (0xeb9d bytes) 2024-09-11T06:20:01.323 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:01.323 INFO:teuthology.orchestra.run.smithi070.stdout:5721 write 0x1c4b952 thru 0x1c59927 (0xdfd6 bytes) 2024-09-11T06:20:01.328 INFO:teuthology.orchestra.run.smithi070.stdout:5722 write 0x9e1ed1d thru 0x9e2bab4 (0xcd98 bytes) 2024-09-11T06:20:01.338 INFO:teuthology.orchestra.run.smithi070.stdout:5724 punch from 0xbea061c to 0xbea8232, (0x7c16 bytes) 2024-09-11T06:20:01.338 INFO:teuthology.orchestra.run.smithi070.stdout:5725 write 0xd242c46 thru 0xd2455ef (0x29aa bytes) 2024-09-11T06:20:01.345 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:01.345 INFO:teuthology.orchestra.run.smithi070.stdout:5728 clone 40 order 23 su 262144 sc 10 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 6.0268511619999998, 2024-09-11T06:20:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.9809793029999998, 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:20:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:20:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162708 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 598016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.943572+0000", 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4158391569999997, 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061088824, 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162708 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943572+0000", 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943572+0000", 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943994+0000", 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000421879 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943999+0000", 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4989999999999996e-06 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944009+0000", 2024-09-11T06:20:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8840000000000006e-06 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944016+0000", 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5970000000000003e-06 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004018+0000", 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060001985000000001 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004415+0000", 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000397227 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004661+0000", 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024575299999999998 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162709 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 614400~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.944028+0000", 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.415383458, 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060993565, 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162709 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944028+0000", 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944028+0000", 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944458+0000", 2024-09-11T06:20:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000430097 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944463+0000", 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8010000000000003e-06 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944474+0000", 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1226000000000001e-05 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944481+0000", 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0840000000000003e-06 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004821+0000", 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060340335000000002 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004914+0000", 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2666999999999999e-05 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005022+0000", 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107355 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162710 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 630784~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.944493+0000", 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.414918524, 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060739695000000003, 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162710 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944493+0000", 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944493+0000", 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944493+0000", 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3300000000000002e-07 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944495+0000", 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0389999999999999e-06 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944500+0000", 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3980000000000001e-06 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944503+0000", 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005056+0000", 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060552096999999999 2024-09-11T06:20:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005133+0000", 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7272000000000001e-05 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005233+0000", 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9777000000000004e-05 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162711 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 647168~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.944508+0000", 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4149035139999997, 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060937771000000002, 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162711 2024-09-11T06:20:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944508+0000", 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944508+0000", 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944905+0000", 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039675700000000002 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944909+0000", 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944920+0000", 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0900000000000001e-05 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944927+0000", 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0589999999999997e-06 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005262+0000", 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060334705000000002 2024-09-11T06:20:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005340+0000", 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8227999999999997e-05 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005446+0000", 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162713 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 679936~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.944969+0000", 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4144421119999997, 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060893915, 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162713 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944969+0000", 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944969+0000", 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945384+0000", 2024-09-11T06:20:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041483699999999999 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945390+0000", 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4299999999999997e-06 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945401+0000", 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1474999999999999e-05 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945409+0000", 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4939999999999997e-06 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005685+0000", 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060276731 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005763+0000", 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8058000000000004e-05 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005863+0000", 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9889999999999994e-05 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162715 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 712704~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.945447+0000", 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4139643910000004, 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060834469000000002, 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162715 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945447+0000", 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945447+0000", 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945448+0000", 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945450+0000", 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4480000000000001e-06 2024-09-11T06:20:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945457+0000", 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7909999999999999e-06 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945462+0000", 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3979999999999998e-06 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006107+0000", 2024-09-11T06:20:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060645229000000002 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006184+0000", 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7016999999999998e-05 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006281+0000", 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7072999999999997e-05 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162716 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 729088~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.945469+0000", 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4139421040000002, 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061019364, 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162716 2024-09-11T06:20:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945469+0000", 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945469+0000", 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945851+0000", 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000381214 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945856+0000", 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945864+0000", 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000005e-06 2024-09-11T06:20:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945870+0000", 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006312+0000", 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.06044223 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006389+0000", 2024-09-11T06:20:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6684e-05 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006489+0000", 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9946999999999997e-05 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162717 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 745472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.945882+0000", 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4135297940000005, 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060815635, 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162717 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945882+0000", 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945882+0000", 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945882+0000", 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1900000000000003e-07 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945885+0000", 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5119999999999998e-06 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945891+0000", 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9030000000000001e-06 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945895+0000", 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8350000000000003e-06 2024-09-11T06:20:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006521+0000", 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060625433999999999 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006598+0000", 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7447999999999994e-05 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006697+0000", 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8984e-05 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162718 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 761856~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.945914+0000", 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.413497725, 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061005516000000003, 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162718 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945914+0000", 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945914+0000", 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946090+0000", 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000175976 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946094+0000", 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946103+0000", 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0080000000000008e-06 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946132+0000", 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8884e-05 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006729+0000", 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060596670999999998 2024-09-11T06:20:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006806+0000", 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7411999999999997e-05 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006919+0000", 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011305400000000001 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162719 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 778240~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.946155+0000", 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4132568839999999, 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060984917, 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162719 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946155+0000", 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946155+0000", 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946384+0000", 2024-09-11T06:20:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022901400000000001 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946392+0000", 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6209999999999993e-06 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946402+0000", 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7149999999999993e-06 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946409+0000", 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8430000000000004e-06 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006950+0000", 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060541550999999999 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007032+0000", 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1766000000000003e-05 2024-09-11T06:20:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007139+0000", 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107407 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162720 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 794624~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.946427+0000", 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4129846690000001, 2024-09-11T06:20:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060915457999999999, 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162720 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946427+0000", 2024-09-11T06:20:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946427+0000", 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946651+0000", 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000224315 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946655+0000", 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6909999999999999e-06 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946669+0000", 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4129e-05 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946676+0000", 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6850000000000004e-06 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007169+0000", 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060493361000000002 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007248+0000", 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9511000000000005e-05 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007342+0000", 2024-09-11T06:20:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3765999999999996e-05 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162721 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 811008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.946689+0000", 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4127225499999998, 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060865127999999998, 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162721 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946689+0000", 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946689+0000", 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946904+0000", 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215589 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946909+0000", 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7380000000000002e-06 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946919+0000", 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0152999999999999e-05 2024-09-11T06:20:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946926+0000", 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007373+0000", 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060446606 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007452+0000", 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9641000000000005e-05 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007554+0000", 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101582 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162722 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 827392~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.946938+0000", 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4124729440000001, 2024-09-11T06:20:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060822503, 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162722 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946938+0000", 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946938+0000", 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947194+0000", 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025544499999999998 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947199+0000", 2024-09-11T06:20:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9840000000000001e-06 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947210+0000", 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0791000000000001e-05 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947222+0000", 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2413e-05 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007584+0000", 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060362351000000002 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007663+0000", 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8090999999999995e-05 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007761+0000", 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8428e-05 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162723 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 843776~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.947243+0000", 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.412168512, 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060726087999999998, 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162723 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947243+0000", 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947243+0000", 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947377+0000", 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013396400000000001 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947382+0000", 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7720000000000002e-06 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947392+0000", 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0628000000000001e-05 2024-09-11T06:20:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947399+0000", 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8639999999999998e-06 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007792+0000", 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060393065000000003 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007868+0000", 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6265000000000002e-05 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007969+0000", 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010053 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162724 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 860160~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.947411+0000", 2024-09-11T06:20:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4119999390000002, 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060786494000000003, 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162724 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947411+0000", 2024-09-11T06:20:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947411+0000", 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947537+0000", 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012546000000000001 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947542+0000", 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2639999999999999e-06 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947567+0000", 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4766e-05 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947574+0000", 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1049999999999997e-06 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008000+0000", 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060426353000000002 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008096+0000", 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6057000000000005e-05 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008198+0000", 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101489 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162725 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 876544~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.947586+0000", 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4118253149999997, 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060720481, 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162725 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947586+0000", 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947586+0000", 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947716+0000", 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012972799999999999 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947720+0000", 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2570000000000001e-06 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947727+0000", 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0929999999999997e-06 2024-09-11T06:20:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947731+0000", 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2119999999999997e-06 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008220+0000", 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060488874999999998 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008259+0000", 2024-09-11T06:20:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9069000000000002e-05 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008307+0000", 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7246999999999997e-05 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162727 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 909312~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.947885+0000", 2024-09-11T06:20:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4115267639999995, 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060763084000000002, 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162727 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947885+0000", 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947885+0000", 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948070+0000", 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018563600000000001 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948075+0000", 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948087+0000", 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1782e-05 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948094+0000", 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5270000000000001e-06 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008477+0000", 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060382425000000003 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008555+0000", 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7965000000000003e-05 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008648+0000", 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3150000000000001e-05 2024-09-11T06:20:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162728 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 925696~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.948112+0000", 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4112991590000004, 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060781810999999998, 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162728 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948112+0000", 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948112+0000", 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948902+0000", 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000790089 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948908+0000", 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948917+0000", 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9889999999999998e-06 2024-09-11T06:20:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948924+0000", 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.199e-06 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008699+0000", 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.059774450999999999 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008789+0000", 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0124000000000007e-05 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008894+0000", 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105399 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.457 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:01.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:01.459 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:01.457+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:01.560 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:01.559+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:01.603 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:01.604 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:01.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:01.660 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:01.659+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:01.715 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:01.715 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:01.716 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:01.724 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:01.762 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:01.760+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:01.863 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:01.861+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:01.868 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.746483374, 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:01.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:20:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.750238511999999, 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:20:01.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:20:01.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.750187601, 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.881 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:20:01.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.750000297, 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:20:01.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:20:01.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749963337000001, 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:20:01.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749938480000001, 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:20:01.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:20:01.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749898516000002, 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:20:01.905 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:20:01.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:20:01.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.74986814, 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:20:01.911 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:20:01.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:20:01.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749847374000002, 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:20:01.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749814503, 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:20:01.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749794645000001, 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:20:01.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:20:01.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749774467999998, 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:01.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749763102999999, 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:01.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:20:01.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:01.945 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749735665999999, 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:01.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.74970141, 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:20:01.951 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:20:01.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:20:01.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:20:01.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749687946999998, 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:20:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:20:01.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749656217999998, 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:01.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:01.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749644060000001, 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.969 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:20:01.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749619210999999, 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.974 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:20:01.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.749605981999999, 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:01.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:20:01.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:01.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:01.983 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:01.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:01.985 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:01.983+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:02.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:02.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:02.084+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:02.092 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:02.092 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:02.092 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:02.092 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:02.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:02.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:20:02.167 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:02.168 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:02.186 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:02.184+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:02.199 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:02.199 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:02.230 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:02.230 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:02.255 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:02.255 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:02.264 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:02.265 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:02.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:02.283 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:02.283 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:02.303 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:02.304 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:02.304 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:02.303+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:02.320 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:02.353 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:02.353 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:02.402 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:02.402 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:02.402 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:02.401+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:02.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:02.489 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:02.487+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:02.554 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:02.555 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:02.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:02.607 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:02.606+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:02.666 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:02.667 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:02.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:02.690 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:02.689+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:02.791 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:02.790+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:02.819 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:02.819 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:02.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:02.892 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:02.891+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:02.945 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:02.945 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:02.954 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:02.993 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:02.992+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:03.058 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:03.058 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:03.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:03.094 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:03.093+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:03.169 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:03.169 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:03.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:20:03.178 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:03.222 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:03.220+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:03.245 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:20:03.298 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:03.295+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:03.303 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:03.303 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:03.318 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:03.405 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:03.403+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:03.467 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:03.467 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:03.482 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:03.523 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:03.521+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:03.595 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:20:03.596 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:20:03.601 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:03.599+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:03.619 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-11T06:20:03.245688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2058421564,"num_objects":1264,"num_object_clones":0,"num_object_copies":2528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1264,"num_whiteouts":0,"num_read":182683,"num_read_kb":1173523,"num_write":21522,"num_write_kb":817291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2239,"num_bytes_recovered":405046911,"num_keys_recovered":598,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15255,"ondisk_log_size":15255,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":414864,"kb_used_data":113896,"kb_used_omap":36,"kb_used_meta":300763,"kb_avail":660188016,"statfs":{"total":676457349120,"available":676032528384,"internally_reserved":0,"allocated":116629504,"data_stored":883021008,"data_compressed":23521464,"data_compressed_allocated":75149312,"data_compressed_original":855038075,"omap_allocated":36911,"internal_metadata":307982289},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,22,22,35,93,73,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46188609,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":24822,"num_read_kb":48670,"num_write":502,"num_write_kb":38383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":14813489,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.012536"},"pg_stats":[{"pgid":"3.1f","version":"193'274","reported_seq":2852,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.242913+0000","last_change":"2024-09-11T06:20:00.126780+0000","last_active":"2024-09-11T06:20:02.242913+0000","last_peered":"2024-09-11T06:20:02.242913+0000","last_clean":"2024-09-11T06:20:02.242913+0000","last_became_active":"2024-09-11T06:18:19.334728+0000","last_became_peered":"2024-09-11T06:18:19.334728+0000","last_unstale":"2024-09-11T06:20:02.242913+0000","last_undegraded":"2024-09-11T06:20:02.242913+0000","last_fullsized":"2024-09-11T06:20:02.242913+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:35.963247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035492299999999999,"stat_sum":{"num_bytes":63221176,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2167,"num_read_kb":25573,"num_write":438,"num_write_kb":26952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":6402492,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.1e","version":"193'431","reported_seq":5359,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.242868+0000","last_change":"2024-09-11T06:20:00.126431+0000","last_active":"2024-09-11T06:20:02.242868+0000","last_peered":"2024-09-11T06:20:02.242868+0000","last_clean":"2024-09-11T06:20:02.242868+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:20:02.242868+0000","last_undegraded":"2024-09-11T06:20:02.242868+0000","last_fullsized":"2024-09-11T06:20:02.242868+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:36:33.650831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041862099999999999,"stat_sum":{"num_bytes":38470137,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5411,"num_read_kb":20311,"num_write":619,"num_write_kb":16227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.1d","version":"194'769","reported_seq":10292,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.286245+0000","last_change":"2024-09-11T06:20:00.123877+0000","last_active":"2024-09-11T06:20:02.286245+0000","last_peered":"2024-09-11T06:20:02.286245+0000","last_clean":"2024-09-11T06:20:02.286245+0000","last_became_active":"2024-09-11T06:19:50.121498+0000","last_became_peered":"2024-09-11T06:19:50.121498+0000","last_unstale":"2024-09-11T06:20:02.286245+0000","last_undegraded":"2024-09-11T06:20:02.286245+0000","last_fullsized":"2024-09-11T06:20:02.286245+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:38.089229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094985899999999995,"stat_sum":{"num_bytes":135778496,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":11326,"num_read_kb":85052,"num_write":1242,"num_write_kb":36416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":24673097,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.1c","version":"194'504","reported_seq":10589,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.275740+0000","last_change":"2024-09-11T06:20:00.119884+0000","last_active":"2024-09-11T06:20:02.275740+0000","last_peered":"2024-09-11T06:20:02.275740+0000","last_clean":"2024-09-11T06:20:02.275740+0000","last_became_active":"2024-09-11T06:19:56.122511+0000","last_became_peered":"2024-09-11T06:19:56.122511+0000","last_unstale":"2024-09-11T06:20:02.275740+0000","last_undegraded":"2024-09-11T06:20:02.275740+0000","last_fullsized":"2024-09-11T06:20:02.275740+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:04.768153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013498620000000001,"stat_sum":{"num_bytes":72494085,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":11271,"num_read_kb":45932,"num_write":789,"num_write_kb":17517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":132,"num_bytes_recovered":8705071,"num_keys_recovered":230,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.1b","version":"193'456","reported_seq":3472,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.249735+0000","last_change":"2024-09-11T06:20:00.119542+0000","last_active":"2024-09-11T06:20:02.249735+0000","last_peered":"2024-09-11T06:20:02.249735+0000","last_clean":"2024-09-11T06:20:02.249735+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:20:02.249735+0000","last_undegraded":"2024-09-11T06:20:02.249735+0000","last_fullsized":"2024-09-11T06:20:02.249735+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:55:54.450602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078932099999999995,"stat_sum":{"num_bytes":57993987,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2815,"num_read_kb":29584,"num_write":649,"num_write_kb":25801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.1a","version":"193'535","reported_seq":9599,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.273782+0000","last_change":"2024-09-11T06:20:00.126382+0000","last_active":"2024-09-11T06:20:02.273782+0000","last_peered":"2024-09-11T06:20:02.273782+0000","last_clean":"2024-09-11T06:20:02.273782+0000","last_became_active":"2024-09-11T06:18:22.354987+0000","last_became_peered":"2024-09-11T06:18:22.354987+0000","last_unstale":"2024-09-11T06:20:02.273782+0000","last_undegraded":"2024-09-11T06:20:02.273782+0000","last_fullsized":"2024-09-11T06:20:02.273782+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:12.747157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040163800000000001,"stat_sum":{"num_bytes":80758985,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":9932,"num_read_kb":64975,"num_write":732,"num_write_kb":26396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":13961522,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.19","version":"193'415","reported_seq":5555,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.119580+0000","last_change":"2024-09-11T06:20:00.121750+0000","last_active":"2024-09-11T06:20:01.119580+0000","last_peered":"2024-09-11T06:20:01.119580+0000","last_clean":"2024-09-11T06:20:01.119580+0000","last_became_active":"2024-09-11T06:19:50.122679+0000","last_became_peered":"2024-09-11T06:19:50.122679+0000","last_unstale":"2024-09-11T06:20:01.119580+0000","last_undegraded":"2024-09-11T06:20:01.119580+0000","last_fullsized":"2024-09-11T06:20:01.119580+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:54:28.247043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020997640000000001,"stat_sum":{"num_bytes":36421437,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5791,"num_read_kb":26334,"num_write":509,"num_write_kb":15621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":10623074,"num_keys_recovered":66,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.18","version":"191'1005","reported_seq":5154,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.242920+0000","last_change":"2024-09-11T06:20:00.126996+0000","last_active":"2024-09-11T06:20:02.242920+0000","last_peered":"2024-09-11T06:20:02.242920+0000","last_clean":"2024-09-11T06:20:02.242920+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:20:02.242920+0000","last_undegraded":"2024-09-11T06:20:02.242920+0000","last_fullsized":"2024-09-11T06:20:02.242920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1005,"log_dups_size":0,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:01.576766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052430599999999999,"stat_sum":{"num_bytes":49090122,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":8749,"num_read_kb":26560,"num_write":1504,"num_write_kb":26565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.17","version":"193'234","reported_seq":3782,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.242922+0000","last_change":"2024-09-11T06:20:00.127269+0000","last_active":"2024-09-11T06:20:02.242922+0000","last_peered":"2024-09-11T06:20:02.242922+0000","last_clean":"2024-09-11T06:20:02.242922+0000","last_became_active":"2024-09-11T06:19:50.123130+0000","last_became_peered":"2024-09-11T06:19:50.123130+0000","last_unstale":"2024-09-11T06:20:02.242922+0000","last_undegraded":"2024-09-11T06:20:02.242922+0000","last_fullsized":"2024-09-11T06:20:02.242922+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:38.369413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038221099999999998,"stat_sum":{"num_bytes":68113584,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2739,"num_read_kb":33304,"num_write":338,"num_write_kb":20851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":9648066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.16","version":"190'493","reported_seq":7622,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.119577+0000","last_change":"2024-09-11T06:20:00.121696+0000","last_active":"2024-09-11T06:20:01.119577+0000","last_peered":"2024-09-11T06:20:01.119577+0000","last_clean":"2024-09-11T06:20:01.119577+0000","last_became_active":"2024-09-11T06:19:50.124140+0000","last_became_peered":"2024-09-11T06:19:50.124140+0000","last_unstale":"2024-09-11T06:20:01.119577+0000","last_undegraded":"2024-09-11T06:20:01.119577+0000","last_fullsized":"2024-09-11T06:20:01.119577+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:08.443993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022615909999999999,"stat_sum":{"num_bytes":62434111,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":8452,"num_read_kb":35347,"num_write":655,"num_write_kb":27628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":7072366,"num_keys_recovered":44,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.15","version":"193'426","reported_seq":4040,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.270826+0000","last_change":"2024-09-11T06:20:01.127921+0000","last_active":"2024-09-11T06:20:02.270826+0000","last_peered":"2024-09-11T06:20:02.270826+0000","last_clean":"2024-09-11T06:20:02.270826+0000","last_became_active":"2024-09-11T06:20:01.126371+0000","last_became_peered":"2024-09-11T06:20:01.126371+0000","last_unstale":"2024-09-11T06:20:02.270826+0000","last_undegraded":"2024-09-11T06:20:02.270826+0000","last_fullsized":"2024-09-11T06:20:02.270826+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:04.847666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000437713,"stat_sum":{"num_bytes":80562052,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3248,"num_read_kb":34154,"num_write":614,"num_write_kb":36883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":40168837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.14","version":"183'339","reported_seq":8426,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.119455+0000","last_change":"2024-09-11T06:20:00.121311+0000","last_active":"2024-09-11T06:20:01.119455+0000","last_peered":"2024-09-11T06:20:01.119455+0000","last_clean":"2024-09-11T06:20:01.119455+0000","last_became_active":"2024-09-11T06:19:56.122634+0000","last_became_peered":"2024-09-11T06:19:56.122634+0000","last_unstale":"2024-09-11T06:20:01.119455+0000","last_undegraded":"2024-09-11T06:20:01.119455+0000","last_fullsized":"2024-09-11T06:20:01.119455+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:50:06.936080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018013269999999999,"stat_sum":{"num_bytes":71719921,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":7248,"num_read_kb":67976,"num_write":356,"num_write_kb":36552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":131,"num_bytes_recovered":54549826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.270857+0000","last_change":"2024-09-11T06:19:47.188450+0000","last_active":"2024-09-11T06:20:02.270857+0000","last_peered":"2024-09-11T06:20:02.270857+0000","last_clean":"2024-09-11T06:20:02.270857+0000","last_became_active":"2024-09-11T06:19:47.188200+0000","last_became_peered":"2024-09-11T06:19:47.188200+0000","last_unstale":"2024-09-11T06:20:02.270857+0000","last_undegraded":"2024-09-11T06:20:02.270857+0000","last_fullsized":"2024-09-11T06:20:02.270857+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:52.925888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"193'267","reported_seq":4453,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.249699+0000","last_change":"2024-09-11T06:20:00.119859+0000","last_active":"2024-09-11T06:20:02.249699+0000","last_peered":"2024-09-11T06:20:02.249699+0000","last_clean":"2024-09-11T06:20:02.249699+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:20:02.249699+0000","last_undegraded":"2024-09-11T06:20:02.249699+0000","last_fullsized":"2024-09-11T06:20:02.249699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:59:04.581126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066419099999999996,"stat_sum":{"num_bytes":52029481,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3740,"num_read_kb":42414,"num_write":415,"num_write_kb":29389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.249715+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:20:02.249715+0000","last_peered":"2024-09-11T06:20:02.249715+0000","last_clean":"2024-09-11T06:20:02.249715+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:20:02.249715+0000","last_undegraded":"2024-09-11T06:20:02.249715+0000","last_fullsized":"2024-09-11T06:20:02.249715+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"193'292","reported_seq":3211,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.249741+0000","last_change":"2024-09-11T06:20:00.119469+0000","last_active":"2024-09-11T06:20:02.249741+0000","last_peered":"2024-09-11T06:20:02.249741+0000","last_clean":"2024-09-11T06:20:02.249741+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:20:02.249741+0000","last_undegraded":"2024-09-11T06:20:02.249741+0000","last_fullsized":"2024-09-11T06:20:02.249741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:17:43.824936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073625199999999996,"stat_sum":{"num_bytes":34414052,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":2988,"num_read_kb":27549,"num_write":378,"num_write_kb":22859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.249625+0000","last_change":"2024-09-11T06:19:47.187808+0000","last_active":"2024-09-11T06:20:02.249625+0000","last_peered":"2024-09-11T06:20:02.249625+0000","last_clean":"2024-09-11T06:20:02.249625+0000","last_became_active":"2024-09-11T06:19:47.187473+0000","last_became_peered":"2024-09-11T06:19:47.187473+0000","last_unstale":"2024-09-11T06:20:02.249625+0000","last_undegraded":"2024-09-11T06:20:02.249625+0000","last_fullsized":"2024-09-11T06:20:02.249625+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:23.868905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"193'787","reported_seq":5781,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.346019+0000","last_change":"2024-09-11T06:20:00.125174+0000","last_active":"2024-09-11T06:20:01.346019+0000","last_peered":"2024-09-11T06:20:01.346019+0000","last_clean":"2024-09-11T06:20:01.346019+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:20:01.346019+0000","last_undegraded":"2024-09-11T06:20:01.346019+0000","last_fullsized":"2024-09-11T06:20:01.346019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:30:34.980960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017841840000000001,"stat_sum":{"num_bytes":126219483,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":7392,"num_read_kb":55901,"num_write":1205,"num_write_kb":34827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":364,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.242783+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:20:02.242783+0000","last_peered":"2024-09-11T06:20:02.242783+0000","last_clean":"2024-09-11T06:20:02.242783+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:20:02.242783+0000","last_undegraded":"2024-09-11T06:20:02.242783+0000","last_fullsized":"2024-09-11T06:20:02.242783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"191'667","reported_seq":3761,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.119704+0000","last_change":"2024-09-11T06:20:00.122586+0000","last_active":"2024-09-11T06:20:01.119704+0000","last_peered":"2024-09-11T06:20:01.119704+0000","last_clean":"2024-09-11T06:20:01.119704+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:20:01.119704+0000","last_undegraded":"2024-09-11T06:20:01.119704+0000","last_fullsized":"2024-09-11T06:20:01.119704+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:01.592614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021100899999999998,"stat_sum":{"num_bytes":30033246,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":5016,"num_read_kb":26647,"num_write":886,"num_write_kb":16422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.3","version":"192'620","reported_seq":5078,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.270627+0000","last_change":"2024-09-11T06:20:00.123068+0000","last_active":"2024-09-11T06:20:02.270627+0000","last_peered":"2024-09-11T06:20:02.270627+0000","last_clean":"2024-09-11T06:20:02.270627+0000","last_became_active":"2024-09-11T06:19:50.120579+0000","last_became_peered":"2024-09-11T06:19:50.120579+0000","last_unstale":"2024-09-11T06:20:02.270627+0000","last_undegraded":"2024-09-11T06:20:02.270627+0000","last_fullsized":"2024-09-11T06:20:02.270627+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:36:22.080299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084417100000000001,"stat_sum":{"num_bytes":63568694,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":6501,"num_read_kb":31393,"num_write":734,"num_write_kb":27198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":24120938,"num_keys_recovered":111,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":61,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.123205+0000","last_change":"2024-09-11T06:19:47.191122+0000","last_active":"2024-09-11T06:20:01.123205+0000","last_peered":"2024-09-11T06:20:01.123205+0000","last_clean":"2024-09-11T06:20:01.123205+0000","last_became_active":"2024-09-11T06:19:47.188131+0000","last_became_peered":"2024-09-11T06:19:47.188131+0000","last_unstale":"2024-09-11T06:20:01.123205+0000","last_undegraded":"2024-09-11T06:20:01.123205+0000","last_fullsized":"2024-09-11T06:20:01.123205+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:44.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"193'500","reported_seq":5356,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.242689+0000","last_change":"2024-09-11T06:20:00.127224+0000","last_active":"2024-09-11T06:20:02.242689+0000","last_peered":"2024-09-11T06:20:02.242689+0000","last_clean":"2024-09-11T06:20:02.242689+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:20:02.242689+0000","last_undegraded":"2024-09-11T06:20:02.242689+0000","last_fullsized":"2024-09-11T06:20:02.242689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:26.858869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056930800000000003,"stat_sum":{"num_bytes":80822669,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":4947,"num_read_kb":31965,"num_write":699,"num_write_kb":31524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":250,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.242640+0000","last_change":"2024-09-11T06:18:01.253223+0000","last_active":"2024-09-11T06:20:02.242640+0000","last_peered":"2024-09-11T06:20:02.242640+0000","last_clean":"2024-09-11T06:20:02.242640+0000","last_became_active":"2024-09-11T06:18:01.252605+0000","last_became_peered":"2024-09-11T06:18:01.252605+0000","last_unstale":"2024-09-11T06:20:02.242640+0000","last_undegraded":"2024-09-11T06:20:02.242640+0000","last_fullsized":"2024-09-11T06:20:02.242640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:59.812082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"193'768","reported_seq":3187,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.343942+0000","last_change":"2024-09-11T06:20:00.124022+0000","last_active":"2024-09-11T06:20:01.343942+0000","last_peered":"2024-09-11T06:20:01.343942+0000","last_clean":"2024-09-11T06:20:01.343942+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:20:01.343942+0000","last_undegraded":"2024-09-11T06:20:01.343942+0000","last_fullsized":"2024-09-11T06:20:01.343942+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:08.186830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000632477,"stat_sum":{"num_bytes":115948565,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3378,"num_read_kb":22853,"num_write":1013,"num_write_kb":28136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.242737+0000","last_change":"2024-09-11T06:19:47.188263+0000","last_active":"2024-09-11T06:20:02.242737+0000","last_peered":"2024-09-11T06:20:02.242737+0000","last_clean":"2024-09-11T06:20:02.242737+0000","last_became_active":"2024-09-11T06:19:47.187939+0000","last_became_peered":"2024-09-11T06:19:47.187939+0000","last_unstale":"2024-09-11T06:20:02.242737+0000","last_undegraded":"2024-09-11T06:20:02.242737+0000","last_fullsized":"2024-09-11T06:20:02.242737+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:37.770302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"193'513","reported_seq":4118,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.249608+0000","last_change":"2024-09-11T06:20:00.119236+0000","last_active":"2024-09-11T06:20:02.249608+0000","last_peered":"2024-09-11T06:20:02.249608+0000","last_clean":"2024-09-11T06:20:02.249608+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:20:02.249608+0000","last_undegraded":"2024-09-11T06:20:02.249608+0000","last_fullsized":"2024-09-11T06:20:02.249608+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:58.705697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052076800000000001,"stat_sum":{"num_bytes":59378358,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":4521,"num_read_kb":24009,"num_write":729,"num_write_kb":22941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":47,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.119994+0000","last_change":"2024-09-11T06:19:47.189757+0000","last_active":"2024-09-11T06:20:01.119994+0000","last_peered":"2024-09-11T06:20:01.119994+0000","last_clean":"2024-09-11T06:20:01.119994+0000","last_became_active":"2024-09-11T06:19:47.185487+0000","last_became_peered":"2024-09-11T06:19:47.185487+0000","last_unstale":"2024-09-11T06:20:01.119994+0000","last_undegraded":"2024-09-11T06:20:01.119994+0000","last_fullsized":"2024-09-11T06:20:01.119994+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:09.944076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":375,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.275415+0000","last_change":"2024-09-11T06:18:19.333879+0000","last_active":"2024-09-11T06:20:02.275415+0000","last_peered":"2024-09-11T06:20:02.275415+0000","last_clean":"2024-09-11T06:20:02.275415+0000","last_became_active":"2024-09-11T06:18:19.333542+0000","last_became_peered":"2024-09-11T06:18:19.333542+0000","last_unstale":"2024-09-11T06:20:02.275415+0000","last_undegraded":"2024-09-11T06:20:02.275415+0000","last_fullsized":"2024-09-11T06:20:02.275415+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.304756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"194'446","reported_seq":5383,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.253904+0000","last_change":"2024-09-11T06:20:00.119809+0000","last_active":"2024-09-11T06:20:02.253904+0000","last_peered":"2024-09-11T06:20:02.253904+0000","last_clean":"2024-09-11T06:20:02.253904+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:20:02.253904+0000","last_undegraded":"2024-09-11T06:20:02.253904+0000","last_fullsized":"2024-09-11T06:20:02.253904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:53:51.560869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090120100000000002,"stat_sum":{"num_bytes":34346290,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6226,"num_read_kb":35456,"num_write":532,"num_write_kb":22732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.9","version":"193'290","reported_seq":7459,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.249678+0000","last_change":"2024-09-11T06:20:00.119237+0000","last_active":"2024-09-11T06:20:02.249678+0000","last_peered":"2024-09-11T06:20:02.249678+0000","last_clean":"2024-09-11T06:20:02.249678+0000","last_became_active":"2024-09-11T06:19:50.128048+0000","last_became_peered":"2024-09-11T06:19:50.128048+0000","last_unstale":"2024-09-11T06:20:02.249678+0000","last_undegraded":"2024-09-11T06:20:02.249678+0000","last_fullsized":"2024-09-11T06:20:02.249678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:08.143422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052440799999999997,"stat_sum":{"num_bytes":97642615,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":6689,"num_read_kb":45193,"num_write":475,"num_write_kb":28294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":15235963,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.a","version":"194'218","reported_seq":7726,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.295831+0000","last_change":"2024-09-11T06:20:00.120233+0000","last_active":"2024-09-11T06:20:02.295831+0000","last_peered":"2024-09-11T06:20:02.295831+0000","last_clean":"2024-09-11T06:20:02.295831+0000","last_became_active":"2024-09-11T06:19:50.123705+0000","last_became_peered":"2024-09-11T06:19:50.123705+0000","last_unstale":"2024-09-11T06:20:02.295831+0000","last_undegraded":"2024-09-11T06:20:02.295831+0000","last_fullsized":"2024-09-11T06:20:02.295831+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:40.797158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010272390000000001,"stat_sum":{"num_bytes":52224785,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":7022,"num_read_kb":40093,"num_write":303,"num_write_kb":20363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":22769865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.b","version":"193'500","reported_seq":2958,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.249835+0000","last_change":"2024-09-11T06:20:00.119671+0000","last_active":"2024-09-11T06:20:02.249835+0000","last_peered":"2024-09-11T06:20:02.249835+0000","last_clean":"2024-09-11T06:20:02.249835+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:20:02.249835+0000","last_undegraded":"2024-09-11T06:20:02.249835+0000","last_fullsized":"2024-09-11T06:20:02.249835+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:34.566151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085065800000000001,"stat_sum":{"num_bytes":42056073,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2971,"num_read_kb":15168,"num_write":820,"num_write_kb":26175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.c","version":"193'528","reported_seq":2757,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.270742+0000","last_change":"2024-09-11T06:20:00.123253+0000","last_active":"2024-09-11T06:20:02.270742+0000","last_peered":"2024-09-11T06:20:02.270742+0000","last_clean":"2024-09-11T06:20:02.270742+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:20:02.270742+0000","last_undegraded":"2024-09-11T06:20:02.270742+0000","last_fullsized":"2024-09-11T06:20:02.270742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:43:28.354761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090429599999999996,"stat_sum":{"num_bytes":38694774,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3091,"num_read_kb":15528,"num_write":736,"num_write_kb":16397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.d","version":"193'462","reported_seq":3034,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.275808+0000","last_change":"2024-09-11T06:20:00.119906+0000","last_active":"2024-09-11T06:20:02.275808+0000","last_peered":"2024-09-11T06:20:02.275808+0000","last_clean":"2024-09-11T06:20:02.275808+0000","last_became_active":"2024-09-11T06:19:56.122483+0000","last_became_peered":"2024-09-11T06:19:56.122483+0000","last_unstale":"2024-09-11T06:20:02.275808+0000","last_undegraded":"2024-09-11T06:20:02.275808+0000","last_fullsized":"2024-09-11T06:20:02.275808+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:23:57.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095520000000001,"stat_sum":{"num_bytes":35640672,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2838,"num_read_kb":28283,"num_write":776,"num_write_kb":22538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":25601359,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.e","version":"191'547","reported_seq":19620,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.119725+0000","last_change":"2024-09-11T06:20:00.123047+0000","last_active":"2024-09-11T06:20:01.119725+0000","last_peered":"2024-09-11T06:20:01.119725+0000","last_clean":"2024-09-11T06:20:01.119725+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:20:01.119725+0000","last_undegraded":"2024-09-11T06:20:01.119725+0000","last_fullsized":"2024-09-11T06:20:01.119725+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:46.302420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001785378,"stat_sum":{"num_bytes":101802574,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":19489,"num_read_kb":70156,"num_write":698,"num_write_kb":28605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.f","version":"193'443","reported_seq":4178,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.270853+0000","last_change":"2024-09-11T06:20:00.123596+0000","last_active":"2024-09-11T06:20:02.270853+0000","last_peered":"2024-09-11T06:20:02.270853+0000","last_clean":"2024-09-11T06:20:02.270853+0000","last_became_active":"2024-09-11T06:19:56.124127+0000","last_became_peered":"2024-09-11T06:19:56.124127+0000","last_unstale":"2024-09-11T06:20:02.270853+0000","last_undegraded":"2024-09-11T06:20:02.270853+0000","last_fullsized":"2024-09-11T06:20:02.270853+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:55.556743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070249699999999995,"stat_sum":{"num_bytes":66391747,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":4253,"num_read_kb":30079,"num_write":556,"num_write_kb":20448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":20684206,"num_keys_recovered":71,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.10","version":"194'327","reported_seq":2782,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.296545+0000","last_change":"2024-09-11T06:20:00.120232+0000","last_active":"2024-09-11T06:20:02.296545+0000","last_peered":"2024-09-11T06:20:02.296545+0000","last_clean":"2024-09-11T06:20:02.296545+0000","last_became_active":"2024-09-11T06:18:19.332403+0000","last_became_peered":"2024-09-11T06:18:19.332403+0000","last_unstale":"2024-09-11T06:20:02.296545+0000","last_undegraded":"2024-09-11T06:20:02.296545+0000","last_fullsized":"2024-09-11T06:20:02.296545+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:46.092104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001407812,"stat_sum":{"num_bytes":68314670,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":3881,"num_read_kb":38763,"num_write":370,"num_write_kb":28668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":10080366,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.11","version":"191'330","reported_seq":3382,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.119801+0000","last_change":"2024-09-11T06:20:00.121953+0000","last_active":"2024-09-11T06:20:01.119801+0000","last_peered":"2024-09-11T06:20:01.119801+0000","last_clean":"2024-09-11T06:20:01.119801+0000","last_became_active":"2024-09-11T06:19:50.122616+0000","last_became_peered":"2024-09-11T06:19:50.122616+0000","last_unstale":"2024-09-11T06:20:01.119801+0000","last_undegraded":"2024-09-11T06:20:01.119801+0000","last_fullsized":"2024-09-11T06:20:01.119801+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:52.388196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021030269999999999,"stat_sum":{"num_bytes":38625235,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":3034,"num_read_kb":41244,"num_write":403,"num_write_kb":26488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":16507738,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.12","version":"193'408","reported_seq":2761,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-11T06:20:01.123259+0000","last_change":"2024-09-11T06:20:00.125281+0000","last_active":"2024-09-11T06:20:01.123259+0000","last_peered":"2024-09-11T06:20:01.123259+0000","last_clean":"2024-09-11T06:20:01.123259+0000","last_became_active":"2024-09-11T06:19:50.131986+0000","last_became_peered":"2024-09-11T06:19:50.131986+0000","last_unstale":"2024-09-11T06:20:01.123259+0000","last_undegraded":"2024-09-11T06:20:01.123259+0000","last_fullsized":"2024-09-11T06:20:01.123259+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:48.145583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017754979999999999,"stat_sum":{"num_bytes":42335782,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":2440,"num_read_kb":22314,"num_write":691,"num_write_kb":22569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":7880826,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"50","length":"1"}]},{"pgid":"3.13","version":"189'341","reported_seq":3641,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-11T06:20:02.270703+0000","last_change":"2024-09-11T06:20:00.123483+0000","last_active":"2024-09-11T06:20:02.270703+0000","last_peered":"2024-09-11T06:20:02.270703+0000","last_clean":"2024-09-11T06:20:02.270703+0000","last_became_active":"2024-09-11T06:19:50.124659+0000","last_became_peered":"2024-09-11T06:19:50.124659+0000","last_unstale":"2024-09-11T06:20:02.270703+0000","last_undegraded":"2024-09-11T06:20:02.270703+0000","last_fullsized":"2024-09-11T06:20:02.270703+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:55.910005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098619399999999992,"stat_sum":{"num_bytes":60283319,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3001,"num_read_kb":33313,"num_write":497,"num_write_kb":24891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":69,"num_bytes_recovered":11320632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"50","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2057831177,"num_objects":1260,"num_object_clones":0,"num_object_copies":2520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":0,"num_read":182567,"num_read_kb":1173423,"num_write":21361,"num_write_kb":814873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2237,"num_bytes_recovered":405046892,"num_keys_recovered":598,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118865920,"data_stored":1034721295,"data_compressed":28375087,"data_compressed_allocated":89464832,"data_compressed_original":1011479248,"omap_allocated":25754,"internal_metadata":0},"log_size":15135,"ondisk_log_size":15135,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":17338,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63948,"kb_used_data":14704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307892,"statfs":{"total":96636764160,"available":96571281408,"internally_reserved":0,"allocated":15056896,"data_stored":107000362,"data_compressed":3013972,"data_compressed_allocated":9297920,"data_compressed_original":103145636,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39700,"kb_used_data":12668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332140,"statfs":{"total":96636764160,"available":96596111360,"internally_reserved":0,"allocated":12972032,"data_stored":96092734,"data_compressed":2126544,"data_compressed_allocated":7811072,"data_compressed_original":92716918,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":64424509481,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748494,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59756,"kb_used_data":22420,"kb_used_omap":18,"kb_used_meta":37293,"kb_avail":94312084,"statfs":{"total":96636764160,"available":96575574016,"internally_reserved":0,"allocated":22958080,"data_stored":180567231,"data_compressed":4958855,"data_compressed_allocated":15556608,"data_compressed_original":175473310,"omap_allocated":18586,"internal_metadata":38188902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,22,22,35,93,73,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991254,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60544,"kb_used_data":19496,"kb_used_omap":10,"kb_used_meta":41013,"kb_avail":94311296,"statfs":{"total":96636764160,"available":96574767104,"internally_reserved":0,"allocated":19963904,"data_stored":160527636,"data_compressed":4436684,"data_compressed_allocated":13819904,"data_compressed_original":156434697,"omap_allocated":10357,"internal_metadata":41998219},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74592,"kb_used_data":21192,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94297248,"statfs":{"total":96636764160,"available":96560381952,"internally_reserved":0,"allocated":21700608,"data_stored":171261985,"data_compressed":4803381,"data_compressed_allocated":14770176,"data_compressed_original":166479507,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61984,"kb_used_data":12740,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94309856,"statfs":{"total":96636764160,"available":96573292544,"internally_reserved":0,"allocated":13045760,"data_stored":93623665,"data_compressed":2379959,"data_compressed_allocated":7766016,"data_compressed_original":90051623,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54340,"kb_used_data":10676,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94317500,"statfs":{"total":96636764160,"available":96581120000,"internally_reserved":0,"allocated":10932224,"data_stored":73947395,"data_compressed":1802069,"data_compressed_allocated":6127616,"data_compressed_original":70736384,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19382272,"data_stored":170116834,"data_compressed":4803381,"data_compressed_allocated":14770176,"data_compressed_original":166479507,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17588224,"data_stored":158792140,"data_compressed":4428015,"data_compressed_allocated":13783040,"data_compressed_original":155861257,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18919424,"data_stored":164614511,"data_compressed":4525603,"data_compressed_allocated":14270464,"data_compressed_original":161010334,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20107264,"data_stored":174081139,"data_compressed":5297076,"data_compressed_allocated":15564800,"data_compressed_original":170484605,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10653696,"data_stored":94947711,"data_compressed":2126544,"data_compressed_allocated":7811072,"data_compressed_original":92716918,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12677120,"data_stored":105264827,"data_compressed":3005303,"data_compressed_allocated":9261056,"data_compressed_original":102572196,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10768384,"data_stored":92492305,"data_compressed":2379959,"data_compressed_allocated":7766016,"data_compressed_original":90032895,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8769536,"data_stored":74411828,"data_compressed":1809206,"data_compressed_allocated":6238208,"data_compressed_original":72321536,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:20:03.621 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T06:20:03.621 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:03.622 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T06:20:03.622 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 1.000000 2024-09-11T06:20:03.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-11T06:20:03.669 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:03.669 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:03.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:03.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:03.724+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:03.786 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:03.786 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:03.796 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:03.837 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:03.835+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:03.901 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:03.900+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:03.948 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:03.948 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:03.957 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:04.003 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:04.001+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:04.060 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:04.060 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:04.069 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:04.103 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:04.103+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:04.204 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:04.202+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:04.212 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:04.213 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:04.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:04.253 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-11T06:20:04.313 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:04.312+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:04.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:04.366 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:04.366 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:04.375 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:04.418 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:04.416+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:04.479 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:04.479 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:04.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:04.485 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:04.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:04.502 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:04.506 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:04.506+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:04.519 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:04.519 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:04.536 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:04.536 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:04.553 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:04.553 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:04.569 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:04.570 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:04.586 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:04.586 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:04.593 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:04.594 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:04.594 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:04.594 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:04.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:04.606 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:04.606 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:04.607 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:04.606+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:04.709 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:04.709 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:04.709 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:04.709 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:04.710 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:04.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:04.708+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:04.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:04.810 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:04.809+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:04.821 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:04.821 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4872799329999999, 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:04.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:20:04.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:20:04.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:20:04.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4414080739999999, 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.829 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:04.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:20:04.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:20:04.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.836 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162708 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 598016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.836 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.943572+0000", 2024-09-11T06:20:04.836 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8762679279999999, 2024-09-11T06:20:04.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061088824, 2024-09-11T06:20:04.836 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162708 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943572+0000", 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943572+0000", 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943994+0000", 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000421879 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943999+0000", 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4989999999999996e-06 2024-09-11T06:20:04.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944009+0000", 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8840000000000006e-06 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944016+0000", 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5970000000000003e-06 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004018+0000", 2024-09-11T06:20:04.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060001985000000001 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004415+0000", 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000397227 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004661+0000", 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024575299999999998 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162709 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 614400~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.944028+0000", 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8758122290000001, 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060993565, 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162709 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944028+0000", 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944028+0000", 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944458+0000", 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000430097 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944463+0000", 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8010000000000003e-06 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944474+0000", 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1226000000000001e-05 2024-09-11T06:20:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944481+0000", 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0840000000000003e-06 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004821+0000", 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060340335000000002 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.004914+0000", 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2666999999999999e-05 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005022+0000", 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107355 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162710 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 630784~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.944493+0000", 2024-09-11T06:20:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8753472950000001, 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060739695000000003, 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162710 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944493+0000", 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944493+0000", 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944493+0000", 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3300000000000002e-07 2024-09-11T06:20:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944495+0000", 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0389999999999999e-06 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944500+0000", 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3980000000000001e-06 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944503+0000", 2024-09-11T06:20:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.579e-06 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005056+0000", 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060552096999999999 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005133+0000", 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7272000000000001e-05 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005233+0000", 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9777000000000004e-05 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162711 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 647168~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.944508+0000", 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8753322849999998, 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060937771000000002, 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162711 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944508+0000", 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944508+0000", 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944905+0000", 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039675700000000002 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944909+0000", 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-11T06:20:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944920+0000", 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0900000000000001e-05 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944927+0000", 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0589999999999997e-06 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005262+0000", 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060334705000000002 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005340+0000", 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8227999999999997e-05 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005446+0000", 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010566 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162713 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 679936~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.944969+0000", 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8748708829999998, 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060893915, 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162713 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944969+0000", 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944969+0000", 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945384+0000", 2024-09-11T06:20:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041483699999999999 2024-09-11T06:20:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945390+0000", 2024-09-11T06:20:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4299999999999997e-06 2024-09-11T06:20:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945401+0000", 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1474999999999999e-05 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945409+0000", 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4939999999999997e-06 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005685+0000", 2024-09-11T06:20:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060276731 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005763+0000", 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8058000000000004e-05 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.005863+0000", 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9889999999999994e-05 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162715 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 712704~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.945447+0000", 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8743931619999996, 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060834469000000002, 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162715 2024-09-11T06:20:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945447+0000", 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945447+0000", 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945448+0000", 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.13e-07 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945450+0000", 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4480000000000001e-06 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945457+0000", 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7909999999999999e-06 2024-09-11T06:20:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945462+0000", 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3979999999999998e-06 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006107+0000", 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060645229000000002 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006184+0000", 2024-09-11T06:20:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7016999999999998e-05 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006281+0000", 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7072999999999997e-05 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162716 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 729088~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.945469+0000", 2024-09-11T06:20:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8743708750000003, 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061019364, 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162716 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945469+0000", 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945469+0000", 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945851+0000", 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000381214 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945856+0000", 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945864+0000", 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000005e-06 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945870+0000", 2024-09-11T06:20:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1410000000000002e-06 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006312+0000", 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.06044223 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006389+0000", 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6684e-05 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006489+0000", 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9946999999999997e-05 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162717 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 745472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.945882+0000", 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8739585649999997, 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060815635, 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162717 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945882+0000", 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945882+0000", 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945882+0000", 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1900000000000003e-07 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945885+0000", 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5119999999999998e-06 2024-09-11T06:20:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945891+0000", 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9030000000000001e-06 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945895+0000", 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8350000000000003e-06 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006521+0000", 2024-09-11T06:20:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060625433999999999 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006598+0000", 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7447999999999994e-05 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006697+0000", 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8984e-05 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162718 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 761856~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.945914+0000", 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8739264960000002, 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061005516000000003, 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162718 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945914+0000", 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945914+0000", 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946090+0000", 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000175976 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946094+0000", 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946103+0000", 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0080000000000008e-06 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946132+0000", 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8884e-05 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006729+0000", 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060596670999999998 2024-09-11T06:20:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006806+0000", 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7411999999999997e-05 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006919+0000", 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011305400000000001 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162719 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 778240~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.946155+0000", 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8736856550000001, 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060984917, 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162719 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946155+0000", 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946155+0000", 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946384+0000", 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022901400000000001 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946392+0000", 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6209999999999993e-06 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946402+0000", 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7149999999999993e-06 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946409+0000", 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8430000000000004e-06 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.006950+0000", 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060541550999999999 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007032+0000", 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1766000000000003e-05 2024-09-11T06:20:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007139+0000", 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107407 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162720 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 794624~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.946427+0000", 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8734134400000002, 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060915457999999999, 2024-09-11T06:20:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162720 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946427+0000", 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946427+0000", 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946651+0000", 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000224315 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946655+0000", 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6909999999999999e-06 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946669+0000", 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4129e-05 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946676+0000", 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6850000000000004e-06 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007169+0000", 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060493361000000002 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007248+0000", 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9511000000000005e-05 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007342+0000", 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3765999999999996e-05 2024-09-11T06:20:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162721 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 811008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.946689+0000", 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8731513209999999, 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060865127999999998, 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162721 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946689+0000", 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946689+0000", 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946904+0000", 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215589 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946909+0000", 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7380000000000002e-06 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946919+0000", 2024-09-11T06:20:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0152999999999999e-05 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946926+0000", 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8190000000000003e-06 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007373+0000", 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060446606 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007452+0000", 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9641000000000005e-05 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007554+0000", 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101582 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162722 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 827392~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.946938+0000", 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8729017150000002, 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060822503, 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162722 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946938+0000", 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946938+0000", 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947194+0000", 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025544499999999998 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947199+0000", 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9840000000000001e-06 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947210+0000", 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0791000000000001e-05 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947222+0000", 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2413e-05 2024-09-11T06:20:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007584+0000", 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060362351000000002 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007663+0000", 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8090999999999995e-05 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007761+0000", 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8428e-05 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162723 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 843776~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.947243+0000", 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8725972830000002, 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060726087999999998, 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162723 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947243+0000", 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947243+0000", 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947377+0000", 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013396400000000001 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947382+0000", 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7720000000000002e-06 2024-09-11T06:20:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947392+0000", 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0628000000000001e-05 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947399+0000", 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8639999999999998e-06 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007792+0000", 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060393065000000003 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007868+0000", 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6265000000000002e-05 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.007969+0000", 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010053 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162724 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 860160~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.947411+0000", 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8724287100000003, 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060786494000000003, 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162724 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947411+0000", 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947411+0000", 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947537+0000", 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012546000000000001 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947542+0000", 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2639999999999999e-06 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947567+0000", 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4766e-05 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947574+0000", 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1049999999999997e-06 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008000+0000", 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060426353000000002 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008096+0000", 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6057000000000005e-05 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008198+0000", 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101489 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162725 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 876544~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.947586+0000", 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8722540859999999, 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060720481, 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162725 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947586+0000", 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947586+0000", 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947716+0000", 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012972799999999999 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947720+0000", 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2570000000000001e-06 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947727+0000", 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0929999999999997e-06 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947731+0000", 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2119999999999997e-06 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008220+0000", 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060488874999999998 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008259+0000", 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9069000000000002e-05 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008307+0000", 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7246999999999997e-05 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162727 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 909312~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.947885+0000", 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8719555349999997, 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060763084000000002, 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162727 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947885+0000", 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947885+0000", 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948070+0000", 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018563600000000001 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948075+0000", 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5990000000000004e-06 2024-09-11T06:20:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948087+0000", 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1782e-05 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948094+0000", 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5270000000000001e-06 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008477+0000", 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060382425000000003 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008555+0000", 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7965000000000003e-05 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008648+0000", 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3150000000000001e-05 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162728 3.a 3:558da04a:::rbd_data.116db1306a51.0000000000000007:4f [read 925696~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.948112+0000", 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8717279300000005, 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.060781810999999998, 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162728 2024-09-11T06:20:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948112+0000", 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948112+0000", 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948902+0000", 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000790089 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948908+0000", 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948917+0000", 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9889999999999998e-06 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948924+0000", 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.199e-06 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008699+0000", 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.059774450999999999 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008789+0000", 2024-09-11T06:20:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0124000000000007e-05 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:57.008894+0000", 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105399 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:04.923 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:04.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:04.925 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:04.924+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:05.026 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:05.024+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:05.068 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:05.068 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:05.069 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:05.077 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:05.127 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:05.126+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:05.180 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:05.180 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:05.180 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:05.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:05.233 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:05.232+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:05.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:20:05.273 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.179360267999996, 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.302 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:05.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:20:05.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.307 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.183115405999999, 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:20:05.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:20:05.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:20:05.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:05.314 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.183064495, 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:20:05.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:20:05.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:20:05.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:20:05.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:20:05.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182877190999999, 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:05.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:20:05.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182840231, 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:20:05.327 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:20:05.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:20:05.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182815374, 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:20:05.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:20:05.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:20:05.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:20:05.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:20:05.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182775410000001, 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:20:05.340 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:20:05.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:20:05.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:20:05.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182745034, 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:20:05.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182724268000001, 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:20:05.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:20:05.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182691396999999, 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:20:05.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:20:05.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:20:05.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182671539000001, 2024-09-11T06:20:05.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:05.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:05.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182651362000001, 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:20:05.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:20:05.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182639996999999, 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:20:05.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182612559999999, 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:20:05.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182578304, 2024-09-11T06:20:05.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:20:05.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:20:05.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:05.392 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182564841000001, 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:05.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:20:05.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182533112000002, 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:20:05.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:20:05.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182520954000001, 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182496104999998, 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:20:05.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:20:05.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:20:05.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:05.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.182482876000002, 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.420 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.420 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:05.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:05.422 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:05.420+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:05.475 INFO:teuthology.orchestra.run.smithi070.stdout:5729 trunc from 0xdb7c632 to 0xe927ffd 2024-09-11T06:20:05.484 INFO:teuthology.orchestra.run.smithi070.stdout:5731 write 0x15e90be thru 0x15ea42a (0x136d bytes) 2024-09-11T06:20:05.486 INFO:teuthology.orchestra.run.smithi070.stdout:5732 punch from 0xe6c4019 to 0xe6d30ce, (0xf0b5 bytes) 2024-09-11T06:20:05.486 INFO:teuthology.orchestra.run.smithi070.stdout:5734 read 0xe76f715 thru 0xe77aa9d (0xb389 bytes) 2024-09-11T06:20:05.487 INFO:teuthology.orchestra.run.smithi070.stdout:5735 writesame 0x7874b9f thru 0x788024d data_size 0x33(0xb6af bytes) 2024-09-11T06:20:05.489 INFO:teuthology.orchestra.run.smithi070.stdout:5736 write 0xde335da thru 0xde37b34 (0x455b bytes) 2024-09-11T06:20:05.490 INFO:teuthology.orchestra.run.smithi070.stdout:5737 read 0xbf31847 thru 0xbf33465 (0x1c1f bytes) 2024-09-11T06:20:05.490 INFO:teuthology.orchestra.run.smithi070.stdout:5738 writesame 0x94311f2 thru 0x9436f40 data_size 0x1(0x5d4f bytes) 2024-09-11T06:20:05.503 INFO:teuthology.orchestra.run.smithi070.stdout:5739 write 0x5c88736 thru 0x5c88af5 (0x3c0 bytes) 2024-09-11T06:20:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:5740 punch from 0x365e050 to 0x3669b49, (0xbaf9 bytes) 2024-09-11T06:20:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:5741 punch from 0xde119d3 to 0xde1abfb, (0x9228 bytes) 2024-09-11T06:20:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:5742 writesame 0x66d0cf0 thru 0x66de72a data_size 0x17(0xda3b bytes) 2024-09-11T06:20:05.507 INFO:teuthology.orchestra.run.smithi070.stdout:5744 writesame 0x261f2c6 thru 0x262cd94 data_size 0x11(0xdacf bytes) 2024-09-11T06:20:05.510 INFO:teuthology.orchestra.run.smithi070.stdout:5745 write 0x7a19743 thru 0x7a1ebf0 (0x54ae bytes) 2024-09-11T06:20:05.515 INFO:teuthology.orchestra.run.smithi070.stdout:5747 trunc from 0xe927ffd to 0xbaceabe 2024-09-11T06:20:05.522 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:05.521+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:05.526 INFO:teuthology.orchestra.run.smithi070.stdout:5748 writesame 0x908f1e thru 0x9162cd data_size 0x2(0xd3b0 bytes) 2024-09-11T06:20:05.550 INFO:teuthology.orchestra.run.smithi070.stdout:5749 trunc from 0xbaceabe to 0x29e3202 2024-09-11T06:20:05.577 INFO:teuthology.orchestra.run.smithi070.stdout:5750 read 0x18c83a6 thru 0x18c9aa0 (0x16fb bytes) 2024-09-11T06:20:05.578 INFO:teuthology.orchestra.run.smithi070.stdout:5751 read 0x103fa0 thru 0x10d351 (0x93b2 bytes) 2024-09-11T06:20:05.578 INFO:teuthology.orchestra.run.smithi070.stdout:5753 write 0x1439f7f thru 0x144022b (0x62ad bytes) 2024-09-11T06:20:05.585 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:05.586 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:05.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:05.600 INFO:teuthology.orchestra.run.smithi070.stdout:5755 writesame 0xe734403 thru 0xe735347 data_size 0x1(0xf45 bytes) 2024-09-11T06:20:05.600 INFO:teuthology.orchestra.run.smithi070.stdout:5756 read 0xc272dcc thru 0xc278442 (0x5677 bytes) 2024-09-11T06:20:05.601 INFO:teuthology.orchestra.run.smithi070.stdout:5757 write 0x950dc7e thru 0x9517300 (0x9683 bytes) 2024-09-11T06:20:05.604 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.604 INFO:teuthology.orchestra.run.smithi070.stdout:5759 punch from 0x2e43735 to 0x2e486c9, (0x4f94 bytes) 2024-09-11T06:20:05.605 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.605 INFO:teuthology.orchestra.run.smithi070.stdout:5761 writesame 0x6d2be0 thru 0x6daca4 data_size 0x13(0x80c5 bytes) 2024-09-11T06:20:05.606 INFO:teuthology.orchestra.run.smithi070.stdout:5762 writesame 0x94682af thru 0x9471334 data_size 0xd(0x9086 bytes) 2024-09-11T06:20:05.615 INFO:teuthology.orchestra.run.smithi070.stdout:5763 writesame 0xed02257 thru 0xed0eb66 data_size 0x8(0xc910 bytes) 2024-09-11T06:20:05.616 INFO:teuthology.orchestra.run.smithi070.stdout:5765 writesame 0x484e5d5 thru 0x48596f0 data_size 0x5(0xb11c bytes) 2024-09-11T06:20:05.620 INFO:teuthology.orchestra.run.smithi070.stdout:5767 read 0xdf7419c thru 0xdf79201 (0x5066 bytes) 2024-09-11T06:20:05.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:05.622+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:05.624 INFO:teuthology.orchestra.run.smithi070.stdout:5768 trunc from 0xed0eb67 to 0xbe328f8 2024-09-11T06:20:05.630 INFO:teuthology.orchestra.run.smithi070.stdout:5770 punch from 0x442ecc0 to 0x4430ec6, (0x2206 bytes) 2024-09-11T06:20:05.630 INFO:teuthology.orchestra.run.smithi070.stdout:5771 read 0xb568679 thru 0xb56c52d (0x3eb5 bytes) 2024-09-11T06:20:05.630 INFO:teuthology.orchestra.run.smithi070.stdout:5772 write 0x78e6ff7 thru 0x78f137b (0xa385 bytes) 2024-09-11T06:20:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:5773 read 0x23f577d thru 0x240473c (0xefc0 bytes) 2024-09-11T06:20:05.631 INFO:teuthology.orchestra.run.smithi070.stdout:5774 read 0x9df3873 thru 0x9e020c0 (0xe84e bytes) 2024-09-11T06:20:05.639 INFO:teuthology.orchestra.run.smithi070.stdout:5775 writesame 0xd9b97ca thru 0xd9c0b83 data_size 0x1(0x73ba bytes) 2024-09-11T06:20:05.639 INFO:teuthology.orchestra.run.smithi070.stdout:5778 write 0xa02e4de thru 0xa037433 (0x8f56 bytes) 2024-09-11T06:20:05.642 INFO:teuthology.orchestra.run.smithi070.stdout:5779 write 0x339708 thru 0x33c16c (0x2a65 bytes) 2024-09-11T06:20:05.644 INFO:teuthology.orchestra.run.smithi070.stdout:5781 read 0x5487911 thru 0x5490a62 (0x9152 bytes) 2024-09-11T06:20:05.645 INFO:teuthology.orchestra.run.smithi070.stdout:5782 write 0xbf2d274 thru 0xbf3b7b9 (0xe546 bytes) 2024-09-11T06:20:05.647 INFO:teuthology.orchestra.run.smithi070.stdout:5783 write 0xba8135f thru 0xba8f476 (0xe118 bytes) 2024-09-11T06:20:05.653 INFO:teuthology.orchestra.run.smithi070.stdout:5784 trunc from 0xd9c0b84 to 0xad5c627 2024-09-11T06:20:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:5786 write 0x66a97f9 thru 0x66aaaf7 (0x12ff bytes) 2024-09-11T06:20:05.671 INFO:teuthology.orchestra.run.smithi070.stdout:5787 write 0xc5ed146 thru 0xc5fccdd (0xfb98 bytes) 2024-09-11T06:20:05.680 INFO:teuthology.orchestra.run.smithi070.stdout:5788 trunc from 0xc5fccde to 0x7f042be 2024-09-11T06:20:05.703 INFO:teuthology.orchestra.run.smithi070.stdout:5789 writesame 0xc6bd83f thru 0xc6c8db9 data_size 0x1(0xb57b bytes) 2024-09-11T06:20:05.703 INFO:teuthology.orchestra.run.smithi070.stdout:5790 read 0x2281a11 thru 0x228a586 (0x8b76 bytes) 2024-09-11T06:20:05.703 INFO:teuthology.orchestra.run.smithi070.stdout:5791 write 0x4db4e54 thru 0x4db97bf (0x496c bytes) 2024-09-11T06:20:05.705 INFO:teuthology.orchestra.run.smithi070.stdout:5792 write 0x851f1d1 thru 0x8528184 (0x8fb4 bytes) 2024-09-11T06:20:05.710 INFO:teuthology.orchestra.run.smithi070.stdout:5794 trunc from 0xc6c8dba to 0xab4adca 2024-09-11T06:20:05.716 INFO:teuthology.orchestra.run.smithi070.stdout:5795 read 0x5bd6753 thru 0x5bdce42 (0x66f0 bytes) 2024-09-11T06:20:05.716 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.716 INFO:teuthology.orchestra.run.smithi070.stdout:5797 write 0x5eb98b8 thru 0x5ec8b04 (0xf24d bytes) 2024-09-11T06:20:05.719 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:05.719 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:05.720 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:05.720 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:05.720 INFO:teuthology.orchestra.run.smithi070.stdout:5798 punch from 0x6cfd4e5 to 0x6d0360c, (0x6127 bytes) 2024-09-11T06:20:05.724 INFO:teuthology.orchestra.run.smithi070.stdout:5799 trunc from 0xab4adca to 0xe83faec 2024-09-11T06:20:05.724 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:05.722+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:05.729 INFO:teuthology.orchestra.run.smithi070.stdout:5800 read 0x7526c43 thru 0x7528cf5 (0x20b3 bytes) 2024-09-11T06:20:05.730 INFO:teuthology.orchestra.run.smithi070.stdout:5801 writesame 0xdbb1158 thru 0xdbbc15d data_size 0x1(0xb006 bytes) 2024-09-11T06:20:05.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:05.754 INFO:teuthology.orchestra.run.smithi070.stdout:5802 writesame 0x7082eb9 thru 0x708fce8 data_size 0x8(0xce30 bytes) 2024-09-11T06:20:05.757 INFO:teuthology.orchestra.run.smithi070.stdout:5803 writesame 0x44643fc thru 0x446ffd0 data_size 0x3b(0xbbd5 bytes) 2024-09-11T06:20:05.759 INFO:teuthology.orchestra.run.smithi070.stdout:5804 read 0x840a8a8 thru 0x840e72a (0x3e83 bytes) 2024-09-11T06:20:05.759 INFO:teuthology.orchestra.run.smithi070.stdout:5805 punch from 0x5405e89 to 0x5409215, (0x338c bytes) 2024-09-11T06:20:05.759 INFO:teuthology.orchestra.run.smithi070.stdout:5806 write 0x55f73bd thru 0x55f8b20 (0x1764 bytes) 2024-09-11T06:20:05.761 INFO:teuthology.orchestra.run.smithi070.stdout:5807 read 0x8e8b9b0 thru 0x8e9b510 (0xfb61 bytes) 2024-09-11T06:20:05.761 INFO:teuthology.orchestra.run.smithi070.stdout:5809 writesame 0x2407b95 thru 0x240cce9 data_size 0x1(0x5155 bytes) 2024-09-11T06:20:05.772 INFO:teuthology.orchestra.run.smithi070.stdout:5810 read 0xdc3786c thru 0xdc385cf (0xd64 bytes) 2024-09-11T06:20:05.772 INFO:teuthology.orchestra.run.smithi070.stdout:5812 write 0xd1a728e thru 0xd1b1e35 (0xaba8 bytes) 2024-09-11T06:20:05.773 INFO:teuthology.orchestra.run.smithi070.stdout:5813 punch from 0xc15c8b to 0xc25505, (0xf87a bytes) 2024-09-11T06:20:05.773 INFO:teuthology.orchestra.run.smithi070.stdout:5814 read 0x2922e36 thru 0x292389c (0xa67 bytes) 2024-09-11T06:20:05.774 INFO:teuthology.orchestra.run.smithi070.stdout:5816 writesame 0xcdf94ea thru 0xcdf9c93 data_size 0x9(0x7aa bytes) 2024-09-11T06:20:05.777 INFO:teuthology.orchestra.run.smithi070.stdout:5817 read 0xd62fda1 thru 0xd634782 (0x49e2 bytes) 2024-09-11T06:20:05.777 INFO:teuthology.orchestra.run.smithi070.stdout:5818 punch from 0x8d25a3b to 0x8d2c3ac, (0x6971 bytes) 2024-09-11T06:20:05.778 INFO:teuthology.orchestra.run.smithi070.stdout:5820 read 0x356d20 thru 0x36666a (0xf94b bytes) 2024-09-11T06:20:05.778 INFO:teuthology.orchestra.run.smithi070.stdout:5823 write 0x4b6014e thru 0x4b61cc5 (0x1b78 bytes) 2024-09-11T06:20:05.779 INFO:teuthology.orchestra.run.smithi070.stdout:5824 punch from 0x3602af5 to 0x3605794, (0x2c9f bytes) 2024-09-11T06:20:05.780 INFO:teuthology.orchestra.run.smithi070.stdout:5825 read 0x8530f1a thru 0x85314fe (0x5e5 bytes) 2024-09-11T06:20:05.780 INFO:teuthology.orchestra.run.smithi070.stdout:5828 read 0x9b0abdd thru 0x9b1016a (0x558e bytes) 2024-09-11T06:20:05.780 INFO:teuthology.orchestra.run.smithi070.stdout:5829 writesame 0xc6064b2 thru 0xc61196c data_size 0x1(0xb4bb bytes) 2024-09-11T06:20:05.800 INFO:teuthology.orchestra.run.smithi070.stdout:5830 read 0x7614b22 thru 0x7619077 (0x4556 bytes) 2024-09-11T06:20:05.801 INFO:teuthology.orchestra.run.smithi070.stdout:5833 punch from 0x1d039e5 to 0x1d04b85, (0x11a0 bytes) 2024-09-11T06:20:05.801 INFO:teuthology.orchestra.run.smithi070.stdout:5834 read 0xc3453cd thru 0xc346c69 (0x189d bytes) 2024-09-11T06:20:05.801 INFO:teuthology.orchestra.run.smithi070.stdout:5835 write 0x2e78cf8 thru 0x2e87cfa (0xf003 bytes) 2024-09-11T06:20:05.803 INFO:teuthology.orchestra.run.smithi070.stdout:5841 read 0xa5bfa63 thru 0xa5c22ca (0x2868 bytes) 2024-09-11T06:20:05.803 INFO:teuthology.orchestra.run.smithi070.stdout:5842 read 0xd47e480 thru 0xd4894be (0xb03f bytes) 2024-09-11T06:20:05.803 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.804 INFO:teuthology.orchestra.run.smithi070.stdout:5844 writesame 0x5c03dff thru 0x5c042cf data_size 0x3(0x4d1 bytes) 2024-09-11T06:20:05.805 INFO:teuthology.orchestra.run.smithi070.stdout:5846 read 0x3237af7 thru 0x3240543 (0x8a4d bytes) 2024-09-11T06:20:05.805 INFO:teuthology.orchestra.run.smithi070.stdout:5847 read 0x57348cc thru 0x5735200 (0x935 bytes) 2024-09-11T06:20:05.805 INFO:teuthology.orchestra.run.smithi070.stdout:5848 read 0x4cc6119 thru 0x4cd18d4 (0xb7bc bytes) 2024-09-11T06:20:05.806 INFO:teuthology.orchestra.run.smithi070.stdout:5851 write 0x3374cbe thru 0x3381192 (0xc4d5 bytes) 2024-09-11T06:20:05.807 INFO:teuthology.orchestra.run.smithi070.stdout:5854 write 0x402eec3 thru 0x4037ef1 (0x902f bytes) 2024-09-11T06:20:05.809 INFO:teuthology.orchestra.run.smithi070.stdout:5856 read 0x4efcec9 thru 0x4f01047 (0x417f bytes) 2024-09-11T06:20:05.809 INFO:teuthology.orchestra.run.smithi070.stdout:5857 read 0x573037f thru 0x57366ff (0x6381 bytes) 2024-09-11T06:20:05.809 INFO:teuthology.orchestra.run.smithi070.stdout:5858 writesame 0x68266ad thru 0x682d3b6 data_size 0x11(0x6d0a bytes) 2024-09-11T06:20:05.825 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:05.824+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:05.829 INFO:teuthology.orchestra.run.smithi070.stdout:5859 trunc from 0xe83faec to 0x552a8b 2024-09-11T06:20:05.845 INFO:teuthology.orchestra.run.smithi070.stdout:5862 read 0x39d3f thru 0x40e09 (0x70cb bytes) 2024-09-11T06:20:05.845 INFO:teuthology.orchestra.run.smithi070.stdout:5863 read 0x3487c2 thru 0x352fc8 (0xa807 bytes) 2024-09-11T06:20:05.846 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.860 INFO:teuthology.orchestra.run.smithi070.stdout:5867 trunc from 0x552a8b to 0xc8a6fe5 2024-09-11T06:20:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:5868 punch from 0xda55a2 to 0xda7e1b, (0x2879 bytes) 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 166.06897278599999, 2024-09-11T06:20:05.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:05.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:20:05.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:20:05.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.698539489000002, 2024-09-11T06:20:05.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:20:05.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.696136108000001, 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:20:05.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.891 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153432 3.f 3:f42e81df:::rbd_data.116ddf3f5156.000000000000000f:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.541615966, 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79802703600000002, 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153432 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330773+0000", 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.278e-06 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330953+0000", 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017961999999999999 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330983+0000", 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0188e-05 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330994+0000", 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331072+0000", 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8141999999999998e-05 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331081+0000", 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2890000000000003e-06 2024-09-11T06:20:05.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125207+0000", 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79412554300000004 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125321+0000", 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011482299999999999 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125455+0000", 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013386800000000001 2024-09-11T06:20:05.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128673+0000", 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032178269999999999 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128700+0000", 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128754+0000", 2024-09-11T06:20:05.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4716999999999998e-05 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128798+0000", 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3448000000000001e-05 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161945 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 931840~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9833641540000002, 2024-09-11T06:20:05.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053842806999999999, 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161945 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889025+0000", 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9570000000000001e-06 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889030+0000", 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5820000000000001e-06 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889035+0000", 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5889999999999996e-06 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942690+0000", 2024-09-11T06:20:05.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053655228999999999 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942767+0000", 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-05 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942865+0000", 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8157000000000002e-05 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161946 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 948224~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9833445740000002, 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054041921999999999, 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161946 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890912+0000", 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018701760000000001 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890917+0000", 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890928+0000", 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896999999999999e-05 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890935+0000", 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7149999999999998e-06 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942905+0000", 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051969594000000001 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942980+0000", 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4464999999999999e-05 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943084+0000", 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104558 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161955 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1095680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9812436800000004, 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053898585999999998, 2024-09-11T06:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161955 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891145+0000", 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891151+0000", 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891156+0000", 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944860+0000", 2024-09-11T06:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053704094000000001 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944943+0000", 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3394999999999997e-05 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945042+0000", 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000005e-05 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.911 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161956 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1112064~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9812244470000007, 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054087369000000003, 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161956 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892929+0000", 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001766349 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892933+0000", 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892944+0000", 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0479000000000001e-05 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892950+0000", 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.708e-06 2024-09-11T06:20:05.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945075+0000", 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052124987999999997 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945154+0000", 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8792e-05 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945250+0000", 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5638999999999997e-05 2024-09-11T06:20:05.915 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161965 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1259520~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9793332279999998, 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053970817999999997, 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161965 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894904+0000", 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018509830000000001 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894909+0000", 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.087e-06 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894916+0000", 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894922+0000", 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.767e-06 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946853+0000", 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931484999999999 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946931+0000", 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7737000000000005e-05 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947024+0000", 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3546000000000002e-05 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161974 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1406976~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9772767190000007, 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053855649999999998, 2024-09-11T06:20:05.920 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161974 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895113+0000", 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:20:05.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895119+0000", 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895124+0000", 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948788+0000", 2024-09-11T06:20:05.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053664195999999997 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948866+0000", 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7417999999999996e-05 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948966+0000", 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9907000000000004e-05 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161975 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1423360~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9772556629999993, 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054030427999999998, 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161975 2024-09-11T06:20:05.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896902+0000", 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017710829999999999 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896910+0000", 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896919+0000", 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7310000000000005e-06 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896926+0000", 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948997+0000", 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052071477999999997 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949068+0000", 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-05 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949162+0000", 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3071000000000004e-05 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161984 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1570816~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9753597579999997, 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053945050000000001, 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161984 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898905+0000", 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001878036 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898910+0000", 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898922+0000", 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-05 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898928+0000", 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950784+0000", 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051855483000000001 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950853+0000", 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9239000000000006e-05 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950972+0000", 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118876 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.933 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161994 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1734656~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9732258120000008, 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053886363999999999, 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161994 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899163+0000", 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899170+0000", 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.866e-06 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899175+0000", 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952814+0000", 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053638689000000003 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952892+0000", 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7890000000000001e-05 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953047+0000", 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015576300000000001 2024-09-11T06:20:05.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161995 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1751040~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9732059900000003, 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054070368000000001, 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161995 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900905+0000", 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017245850000000001 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900910+0000", 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900923+0000", 2024-09-11T06:20:05.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2619999999999999e-05 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900930+0000", 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4059999999999999e-06 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953077+0000", 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052147129 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953152+0000", 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5265999999999994e-05 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953251+0000", 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8666999999999996e-05 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162003 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1882112~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.942 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9711869459999996, 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054417001, 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162003 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:05.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901202+0000", 2024-09-11T06:20:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901209+0000", 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901214+0000", 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955009+0000", 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053795526000000003 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955110+0000", 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010130500000000001 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955617+0000", 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050644199999999996 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162004 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9711669589999996, 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054432803000000002, 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162004 2024-09-11T06:20:05.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901222+0000", 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901227+0000", 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7099999999999998e-06 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901231+0000", 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.357e-06 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955645+0000", 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054413571000000001 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955653+0000", 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.950 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162005 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9711502480000007, 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054450025999999999, 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162005 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901291+0000", 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4326000000000001e-05 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901294+0000", 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3459999999999998e-06 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901302+0000", 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0239999999999997e-06 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901308+0000", 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955677+0000", 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054368593999999999 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955687+0000", 2024-09-11T06:20:05.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8500000000000006e-06 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162006 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9710694360000005, 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054418451, 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162006 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902903+0000", 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015855590000000001 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902908+0000", 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:20:05.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902922+0000", 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3949e-05 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902929+0000", 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3150000000000003e-06 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955725+0000", 2024-09-11T06:20:05.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052795684000000002 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955736+0000", 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183479 3.15 3:ac303efb:::rbd_data.116d42e0aa2c.0000000000000010:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5787296150000003, 2024-09-11T06:20:05.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83363719300000005, 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183479 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293658+0000", 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293663+0000", 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293676+0000", 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2734999999999999e-05 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293683+0000", 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6559999999999992e-06 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293746+0000", 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2748000000000003e-05 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293759+0000", 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2767e-05 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.126963+0000", 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83320435800000003 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127119+0000", 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015564999999999999 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127294+0000", 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017540899999999999 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183484 3.15 3:a84be19c:::rbd_data.116d42e0aa2c.0000000000000015:head [sparse-read 0~4259840] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.5782751890000002, 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83354649000000003, 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183484 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.965 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:05.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8700000000000005e-07 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294116+0000", 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294126+0000", 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6339999999999996e-06 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:05.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294131+0000", 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3990000000000003e-06 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294186+0000", 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5438e-05 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294196+0000", 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9769999999999995e-06 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127600+0000", 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83340399499999995 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127658+0000", 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7710000000000001e-05 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:05.969 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:05.971 INFO:teuthology.orchestra.run.smithi070.stdout:5869 write 0xeb7fbc8 thru 0xeb82d7b (0x31b4 bytes) 2024-09-11T06:20:05.971 INFO:teuthology.orchestra.run.smithi070.stdout:5870 trunc from 0xeb82d7c to 0xb0e368b 2024-09-11T06:20:05.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:5876 write 0x8a2daae thru 0x8a365fe (0x8b51 bytes) 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:5877 write 0x5e6d4be thru 0x5e7a703 (0xd246 bytes) 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:5879 trunc from 0xb0e368b to 0x6fe94ac 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:5880 punch from 0x495b98c to 0x495c011, (0x685 bytes) 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:5883 writesame 0x7851d0d thru 0x785ca7a data_size 0x4f(0xad6e bytes) 2024-09-11T06:20:05.974 INFO:teuthology.orchestra.run.smithi070.stdout:5884 write 0x645cb6a thru 0x646b805 (0xec9c bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5888 punch from 0x53bbc0a to 0x53c1464, (0x585a bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5889 write 0x211ca8 thru 0x215b25 (0x3e7e bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5890 trunc from 0x785ca7b to 0x51ea1cc 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5891 write 0x6b37a28 thru 0x6b46541 (0xeb1a bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5894 read 0x5950f75 thru 0x5960a34 (0xfac0 bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5895 write 0x3ddb4f1 thru 0x3de16e2 (0x61f2 bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5896 punch from 0x16a82c7 to 0x16aeb02, (0x683b bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5898 trunc from 0x6b46542 to 0xcb4e954 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5900 write 0xa1447bd thru 0xa147387 (0x2bcb bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5902 writesame 0xec9f576 thru 0xecabc47 data_size 0x33(0xc6d2 bytes) 2024-09-11T06:20:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:5904 read 0xb95bcfe thru 0xb95e5cf (0x28d2 bytes) 2024-09-11T06:20:05.976 INFO:teuthology.orchestra.run.smithi070.stdout:5905 trunc from 0xecabc48 to 0xd5c8509 2024-09-11T06:20:05.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:05.969+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:05.981 INFO:teuthology.orchestra.run.smithi070.stdout:5907 read 0x9faa1e6 thru 0x9fae8b8 (0x46d3 bytes) 2024-09-11T06:20:05.981 INFO:teuthology.orchestra.run.smithi070.stdout:5908 writesame 0x694e6a8 thru 0x69529b4 data_size 0x1(0x430d bytes) 2024-09-11T06:20:05.990 INFO:teuthology.orchestra.run.smithi070.stdout:5909 read 0x5e9a80d thru 0x5ea248e (0x7c82 bytes) 2024-09-11T06:20:05.990 INFO:teuthology.orchestra.run.smithi070.stdout:5910 read 0x14b3dfa thru 0x14c0be9 (0xcdf0 bytes) 2024-09-11T06:20:05.991 INFO:teuthology.orchestra.run.smithi070.stdout:5911 writesame 0x3b2a07a thru 0x3b37f78 data_size 0x3(0xdeff bytes) 2024-09-11T06:20:06.000 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:06.010 INFO:teuthology.orchestra.run.smithi070.stdout:5913 trunc from 0xd5c8509 to 0x6013ec9 2024-09-11T06:20:06.026 INFO:teuthology.orchestra.run.smithi070.stdout:5914 punch from 0x40b7b6 to 0x40f83e, (0x4088 bytes) 2024-09-11T06:20:06.026 INFO:teuthology.orchestra.run.smithi070.stdout:5915 read 0x11abfaf thru 0x11b420b (0x825d bytes) 2024-09-11T06:20:06.039 INFO:teuthology.orchestra.run.smithi070.stdout:5916 write 0xa42ce7e thru 0xa42f795 (0x2918 bytes) 2024-09-11T06:20:06.041 INFO:teuthology.orchestra.run.smithi070.stdout:5917 write 0xd6c7cf thru 0xd70c82 (0x44b4 bytes) 2024-09-11T06:20:06.042 INFO:teuthology.orchestra.run.smithi070.stdout:5918 write 0x90f710b thru 0x90fe2f9 (0x71ef bytes) 2024-09-11T06:20:06.044 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:06.044 INFO:teuthology.orchestra.run.smithi070.stdout:5921 read 0x526383c thru 0x526ea8a (0xb24f bytes) 2024-09-11T06:20:06.057 INFO:teuthology.orchestra.run.smithi070.stdout:5922 trunc from 0xa42f796 to 0x9f8bf7 2024-09-11T06:20:06.071 INFO:teuthology.orchestra.run.smithi070.stdout:5923 trunc from 0x9f8bf7 to 0x576848 2024-09-11T06:20:06.071 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:06.070+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:06.095 INFO:teuthology.orchestra.run.smithi070.stdout:5925 write 0x9daab95 thru 0x9db3218 (0x8684 bytes) 2024-09-11T06:20:06.099 INFO:teuthology.orchestra.run.smithi070.stdout:5929 punch from 0xe57d7b to 0xe5eb7b, (0x6e00 bytes) 2024-09-11T06:20:06.106 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:06.106 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:06.106 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:06.108 INFO:teuthology.orchestra.run.smithi070.stdout:5930 trunc from 0x9db3219 to 0x20c28ac 2024-09-11T06:20:06.117 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:06.120 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:06.120 INFO:teuthology.orchestra.run.smithi070.stdout:5934 read 0x131f316 thru 0x132cc2b (0xd916 bytes) 2024-09-11T06:20:06.131 INFO:teuthology.orchestra.run.smithi070.stdout:5935 writesame 0x659f9f2 thru 0x65a8584 data_size 0x1(0x8b93 bytes) 2024-09-11T06:20:06.131 INFO:teuthology.orchestra.run.smithi070.stdout:5937 punch from 0x673422 to 0x680664, (0xd242 bytes) 2024-09-11T06:20:06.131 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:5940 write 0xcf990c2 thru 0xcf9aeed (0x1e2c bytes) 2024-09-11T06:20:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:5941 read 0xc9098f8 thru 0xc90bae3 (0x21ec bytes) 2024-09-11T06:20:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:5945 read 0x366a5f thru 0x373b5c (0xd0fe bytes) 2024-09-11T06:20:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:5948 read 0x2e71b48 thru 0x2e772e8 (0x57a1 bytes) 2024-09-11T06:20:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:5949 trunc from 0xcf9aeee to 0x6a5c649 2024-09-11T06:20:06.172 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:06.170+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:5950 write 0xa4cfc4e thru 0xa4df891 (0xfc44 bytes) 2024-09-11T06:20:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:5951 read 0xa038f2c thru 0xa03972f (0x804 bytes) 2024-09-11T06:20:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:5952 punch from 0x86c3d45 to 0x86c9b96, (0x5e51 bytes) 2024-09-11T06:20:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:5954 punch from 0x3f31f9c to 0x3f409b9, (0xea1d bytes) 2024-09-11T06:20:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:5955 writesame 0xc0272ba thru 0xc0297f7 data_size 0x15(0x253e bytes) 2024-09-11T06:20:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:5957 write 0xab5284f thru 0xab55bab (0x335d bytes) 2024-09-11T06:20:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:5959 write 0xb4848f6 thru 0xb48bda1 (0x74ac bytes) 2024-09-11T06:20:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:5962 writesame 0xc7fddff thru 0xc800ff2 data_size 0x2e(0x31f4 bytes) 2024-09-11T06:20:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:5963 punch from 0x8734069 to 0x8736bd7, (0x2b6e bytes) 2024-09-11T06:20:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:5964 read 0x229be8f thru 0x229d353 (0x14c5 bytes) 2024-09-11T06:20:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:5965 read 0x3b2a391 thru 0x3b36b04 (0xc774 bytes) 2024-09-11T06:20:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:5966 clone 41 order 18 su 1024 sc 2 2024-09-11T06:20:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:06.233 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:06.233 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:06.233 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:06.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:06.258 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:20:06.274 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:06.272+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 186.74532634900001, 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:20:06.367 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:20:06.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:20:06.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 186.45089077099999, 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:20:06.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 101.184327577, 2024-09-11T06:20:06.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.383 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.220644985999996, 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:20:06.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:20:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.220627559999997, 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:20:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:20:06.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.220610304000004, 2024-09-11T06:20:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:20:06.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.246400106999999, 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.398 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:20:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:20:06.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:20:06.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.246307404999996, 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.246101594999999, 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:20:06.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:20:06.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.246016028, 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:20:06.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.245802769999997, 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:20:06.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:20:06.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.245719450999999, 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:20:06.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:20:06.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:20:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.245462567999994, 2024-09-11T06:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:20:06.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:20:06.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:06.431 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.245401129000001, 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:06.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.245155303999994, 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:20:06.436 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:20:06.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:06.441 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.245087177000002, 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:06.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:06.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:20:06.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:20:06.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.244819515000003, 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:20:06.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.244747474999997, 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:06.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.244576715999997, 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:20:06.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.244471494999999, 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:06.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:20:06.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:20:06.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:06.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:06.466 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:06.467 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:06.468 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:06.466+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:06.567 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:06.567+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:06.572 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:06.572 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:06.572 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:06.581 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:06.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:06.668 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:06.667+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:06.683 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:06.683 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:06.683 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:06.683 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:06.684 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:06.692 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:06.737 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:06.738 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:06.754 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:06.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:06.767+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:06.770 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:06.770 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:06.785 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:06.797 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:06.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124096 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2637824~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401612079000003, 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039912982999999999, 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124096 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393997+0000", 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393998+0000", 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:20:06.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.393999+0000", 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.764e-06 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394004+0000", 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7489999999999998e-06 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394008+0000", 2024-09-11T06:20:06.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.092e-06 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433714+0000", 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039705419999999998 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433804+0000", 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0447999999999999e-05 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433910+0000", 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00010616999999999999 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124097 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2646016~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401594445000001, 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040088436999999998, 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124097 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394015+0000", 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394017+0000", 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9970000000000001e-06 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394023+0000", 2024-09-11T06:20:06.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9449999999999998e-06 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394028+0000", 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3769999999999998e-06 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.433952+0000", 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039924460000000002 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434009+0000", 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6860000000000001e-05 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434103+0000", 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4455000000000003e-05 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124098 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401576575, 2024-09-11T06:20:06.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040258124999999999, 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124098 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394033+0000", 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394035+0000", 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6780000000000001e-06 2024-09-11T06:20:06.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394040+0000", 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1540000000000001e-06 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394044+0000", 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2189999999999998e-06 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434130+0000", 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040085549999999998 2024-09-11T06:20:06.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434208+0000", 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7865000000000001e-05 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434291+0000", 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3347e-05 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124099 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401560205999999, 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040461951000000003, 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124099 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.811 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394049+0000", 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394050+0000", 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.89e-07 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394052+0000", 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9460000000000001e-06 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394057+0000", 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7529999999999998e-06 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394063+0000", 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3550000000000004e-06 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434323+0000", 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040260038999999997 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434378+0000", 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5631999999999999e-05 2024-09-11T06:20:06.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434511+0000", 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013283699999999999 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124100 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401527231000003, 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040582739999999999, 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.815 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124100 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394082+0000", 2024-09-11T06:20:06.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394083+0000", 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1600000000000001e-07 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394087+0000", 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4700000000000004e-06 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394093+0000", 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1569999999999997e-06 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394098+0000", 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9860000000000002e-06 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434548+0000", 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040450016999999998 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434595+0000", 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6255999999999999e-05 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434665+0000", 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0338000000000003e-05 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.819 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124101 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401504332999998, 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040783649999999998, 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124101 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.820 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394105+0000", 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5499999999999999e-07 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394107+0000", 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8959999999999999e-06 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394113+0000", 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8440000000000003e-06 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394117+0000", 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.335e-06 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434695+0000", 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040577692999999998 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434783+0000", 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.7538000000000001e-05 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434889+0000", 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000105989 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.823 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124102 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401486065, 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040992853000000003, 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.824 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124102 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394123+0000", 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.825 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394124+0000", 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394126+0000", 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0829999999999998e-06 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394131+0000", 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6879999999999996e-06 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394136+0000", 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5430000000000004e-06 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.434919+0000", 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040782773000000001 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435005+0000", 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6594000000000005e-05 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435116+0000", 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110776 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124103 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401467666999999, 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041211651000000002, 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.828 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124103 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394142+0000", 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394144+0000", 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7689999999999999e-06 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394150+0000", 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6699999999999999e-06 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394154+0000", 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4610000000000001e-06 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435146+0000", 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.040991684 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435239+0000", 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.3428000000000001e-05 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435353+0000", 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114219 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124104 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.832 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401449554000003, 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041465574999999998, 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124104 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394160+0000", 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.834 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394162+0000", 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.776e-06 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394168+0000", 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7080000000000002e-06 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394172+0000", 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5059999999999997e-06 2024-09-11T06:20:06.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435385+0000", 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041212998000000001 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435477+0000", 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1528999999999997e-05 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435625+0000", 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000148677 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124105 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401431676999998, 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041619452000000001, 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.837 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124105 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:20:06.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394178+0000", 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0699999999999998e-07 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394180+0000", 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0930000000000001e-06 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394186+0000", 2024-09-11T06:20:06.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5389999999999998e-06 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394191+0000", 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7039999999999999e-06 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435663+0000", 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041471806 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435721+0000", 2024-09-11T06:20:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7655999999999998e-05 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435797+0000", 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6247000000000004e-05 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124106 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401407886000001, 2024-09-11T06:20:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041713447000000001, 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124106 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394202+0000", 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4999999999999998e-07 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394204+0000", 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1710000000000001e-06 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394210+0000", 2024-09-11T06:20:06.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2269999999999998e-06 2024-09-11T06:20:06.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394215+0000", 2024-09-11T06:20:06.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435816+0000", 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041600683999999999 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435858+0000", 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2518999999999997e-05 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435915+0000", 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6514000000000001e-05 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124107 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401388117000003, 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041835280000000002, 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.846 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124107 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394221+0000", 2024-09-11T06:20:06.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394222+0000", 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9000000000000002e-07 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394223+0000", 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.793e-06 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394229+0000", 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3399999999999997e-06 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394233+0000", 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5879999999999999e-06 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435931+0000", 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041697761 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.435972+0000", 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0806000000000002e-05 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436057+0000", 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4602000000000001e-05 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124108 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401370395999997, 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042155791999999997, 2024-09-11T06:20:06.850 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124108 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394239+0000", 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1899999999999998e-07 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394241+0000", 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0109999999999999e-06 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394247+0000", 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8810000000000001e-06 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394252+0000", 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4800000000000003e-06 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436174+0000", 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.041922012000000002 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436274+0000", 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000100054 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436395+0000", 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012093499999999999 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.854 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124109 3.8 3:14832130:::rbd_data.116da7b621ae.0000000000000000:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 62.401351904999999, 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042294403000000001, 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124109 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394257+0000", 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394258+0000", 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3999999999999997e-07 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394269+0000", 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0974e-05 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394275+0000", 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3450000000000002e-06 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.394280+0000", 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.826e-06 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436426+0000", 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.042146175000000001 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436472+0000", 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5667000000000002e-05 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.436552+0000", 2024-09-11T06:20:06.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0075999999999997e-05 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 29.309353925, 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.859 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:20:06.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:20:06.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:20:06.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:20:06.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:06.865 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.397827983999999, 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72623960399999998, 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397783+0000", 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.147e-06 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398274+0000", 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049154799999999996 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398283+0000", 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1179999999999998e-06 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398288+0000", 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398330+0000", 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1692e-05 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398336+0000", 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4689999999999996e-06 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124013+0000", 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72567764599999995 2024-09-11T06:20:06.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124021+0000", 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.254752578, 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58344928699999998, 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.870 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540858+0000", 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541443+0000", 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058485600000000003 2024-09-11T06:20:06.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541451+0000", 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0639999999999994e-06 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541456+0000", 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541523+0000", 2024-09-11T06:20:06.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7529999999999999e-05 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541534+0000", 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124290+0000", 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58275560900000001 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124306+0000", 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6065e-05 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3:dd3750b5:::rbd_data.116ddf3f5156.0000000000000013:head [write 0~409600 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.248491231999999, 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58172919000000001, 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.875 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.876 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547119+0000", 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547621+0000", 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000501645 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547629+0000", 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6589999999999996e-06 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547634+0000", 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.848e-06 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547686+0000", 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.147e-05 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547695+0000", 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124336+0000", 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.57664082699999997 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124428+0000", 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2153999999999999e-05 2024-09-11T06:20:06.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124519+0000", 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0313000000000001e-05 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.125614+0000", 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001095794 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:06.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128786+0000", 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031712770000000001 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128821+0000", 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5602000000000002e-05 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128847+0000", 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6109999999999999e-05 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:155183 3.9 3:9299d6ad:::rbd_data.116db1306a51.0000000000000003:4f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.555929+0000", 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.239680447, 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039864150000000001, 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 155183 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.882 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.555929+0000", 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.555929+0000", 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.555929+0000", 2024-09-11T06:20:06.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.555930+0000", 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.094e-06 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.555933+0000", 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.937e-06 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.555936+0000", 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6589999999999999e-06 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.595650+0000", 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039713577999999999 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.595724+0000", 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4616999999999994e-05 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.595793+0000", 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8897000000000001e-05 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:155184 3.9 3:9299d6ad:::rbd_data.116db1306a51.0000000000000003:4f [read 358400~2048 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.555951+0000", 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 11.239658091999999, 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.039981893999999997, 2024-09-11T06:20:06.886 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 155184 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.555951+0000", 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.555951+0000", 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.557752+0000", 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001800435 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.557757+0000", 2024-09-11T06:20:06.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2719999999999997e-06 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.557764+0000", 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1579999999999999e-06 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.557769+0000", 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.595820+0000", 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.038050807999999998 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.595866+0000", 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5479000000000003e-05 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.595933+0000", 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7533000000000005e-05 2024-09-11T06:20:06.890 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:06.891 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:06.891 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:06.892 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:06.892 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:06.893 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:06.893 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:06.894 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:06.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:06.891+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:06.894 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:06.894 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:06.895 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:06.895 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:06.993 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:06.992+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:07.036 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:07.036 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:07.044 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:07.094 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:07.092+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:07.146 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:07.147 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:07.155 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:07.194 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:07.193+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:07.295 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:07.294+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:07.312 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:07.312 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:07.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:07.409 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:07.407+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:07.495 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:07.495 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:07.497 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:07.496+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:07.507 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:07.598 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:07.596+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:07.668 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:07.669 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:07.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:07.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:07.716+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:07.799 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:07.798+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:07.824 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:07.824 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:07.833 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:07.901 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:07.899+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:07.980 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:07.980 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:07.989 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:08.031 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:08.029+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:08.104 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:08.102+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:08.155 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:08.155 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:08.166 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:08.204 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:08.203+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:08.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:20:08.297 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:08.297 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:08.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:08.319 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:08.318+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:08.405 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:08.403+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:08.500 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:08.501 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:08.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:08.504+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:08.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:08.607 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:08.606+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:08.693 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:08.693 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:08.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:08.708 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:08.707+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:08.809 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:08.808+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:08.880 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:08.880 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:08.893 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:08.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:08.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:08.908+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:09.011 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:09.010+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:09.079 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:09.079 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:09.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:09.112 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:09.110+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:09.165 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:09.165 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:09.213 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:09.211+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:09.220 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:09.259 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:09.259 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:09.271 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7] out_osds: [3] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:09.271 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:09.272 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-11T06:20:09.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-11T06:20:09.273 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:20:09.299 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:09.299 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:09.306 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:09.306 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:09.314 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:09.313+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:09.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:09.331 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:09.361 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:09.362 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:09.387 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:09.412 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:09.412 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:09.416 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:09.415+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:09.476 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.353645627000006, 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:20:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.357400765000001, 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:20:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:20:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:20:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.357349853999999, 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:20:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:20:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.357162550000002, 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:20:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:20:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.357125589999999, 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:20:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:20:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.357100732999999, 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:20:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:20:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.357060769, 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:20:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.357030392999999, 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.357009627, 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:20:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:20:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:20:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356976756000002, 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:20:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356956898, 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:20:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:20:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356936721, 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:20:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356925356000001, 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:20:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:20:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356897919000001, 2024-09-11T06:20:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:20:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356863662999999, 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:20:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:20:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.3568502, 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:20:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:20:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356818471, 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:20:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:20:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:20:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356806313, 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:20:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356781464000001, 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:20:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.356768235000001, 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:20:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:09.596 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:09.598 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:09.596+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:09.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:09.699 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:09.698+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:09.699 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T06:20:09.698+0000 7fea5acac640 -1 mon.a@0(leader).osd e200 definitely_dead 0 2024-09-11T06:20:09.757 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:09.758 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:09.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:09.808 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:09.807+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:09.901 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:09.900+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:09.910 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:09.910 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:09.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:10.001 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:10.000+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 170.218819615, 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:20:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.848386317999999, 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:20:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:20:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.845982936999999, 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:20:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:20:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153432 3.f 3:f42e81df:::rbd_data.116ddf3f5156.000000000000000f:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.691462795, 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79802703600000002, 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153432 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330773+0000", 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.278e-06 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330953+0000", 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017961999999999999 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330983+0000", 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0188e-05 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330994+0000", 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331072+0000", 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8141999999999998e-05 2024-09-11T06:20:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331081+0000", 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2890000000000003e-06 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125207+0000", 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79412554300000004 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125321+0000", 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011482299999999999 2024-09-11T06:20:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125455+0000", 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013386800000000001 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128673+0000", 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032178269999999999 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128700+0000", 2024-09-11T06:20:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128754+0000", 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4716999999999998e-05 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128798+0000", 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3448000000000001e-05 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161945 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 931840~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.133210983, 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053842806999999999, 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161945 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889025+0000", 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9570000000000001e-06 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889030+0000", 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5820000000000001e-06 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889035+0000", 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5889999999999996e-06 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942690+0000", 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053655228999999999 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942767+0000", 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-05 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942865+0000", 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8157000000000002e-05 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161946 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 948224~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.133191403, 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054041921999999999, 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161946 2024-09-11T06:20:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890912+0000", 2024-09-11T06:20:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018701760000000001 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890917+0000", 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890928+0000", 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896999999999999e-05 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890935+0000", 2024-09-11T06:20:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7149999999999998e-06 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942905+0000", 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051969594000000001 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942980+0000", 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4464999999999999e-05 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943084+0000", 2024-09-11T06:20:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104558 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161955 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1095680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.131090509, 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053898585999999998, 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161955 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891145+0000", 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891151+0000", 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891156+0000", 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944860+0000", 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053704094000000001 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944943+0000", 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3394999999999997e-05 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945042+0000", 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000005e-05 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161956 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1112064~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.131071276, 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054087369000000003, 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161956 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892929+0000", 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001766349 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892933+0000", 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892944+0000", 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0479000000000001e-05 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892950+0000", 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.708e-06 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945075+0000", 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052124987999999997 2024-09-11T06:20:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945154+0000", 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8792e-05 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945250+0000", 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5638999999999997e-05 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161965 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1259520~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.129180056999999, 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053970817999999997, 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161965 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894904+0000", 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018509830000000001 2024-09-11T06:20:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894909+0000", 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.087e-06 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894916+0000", 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894922+0000", 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.767e-06 2024-09-11T06:20:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946853+0000", 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931484999999999 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946931+0000", 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7737000000000005e-05 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947024+0000", 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3546000000000002e-05 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161974 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1406976~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.127123548, 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053855649999999998, 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161974 2024-09-11T06:20:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:20:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895113+0000", 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895119+0000", 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895124+0000", 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:20:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948788+0000", 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053664195999999997 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948866+0000", 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7417999999999996e-05 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948966+0000", 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9907000000000004e-05 2024-09-11T06:20:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161975 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1423360~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.127102492000001, 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054030427999999998, 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161975 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896902+0000", 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017710829999999999 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896910+0000", 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896919+0000", 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7310000000000005e-06 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896926+0000", 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948997+0000", 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052071477999999997 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949068+0000", 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-05 2024-09-11T06:20:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949162+0000", 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3071000000000004e-05 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161984 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1570816~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.125206586999999, 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053945050000000001, 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161984 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898905+0000", 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001878036 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898910+0000", 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898922+0000", 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-05 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898928+0000", 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950784+0000", 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051855483000000001 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950853+0000", 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9239000000000006e-05 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950972+0000", 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118876 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161994 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1734656~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.123072641, 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053886363999999999, 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161994 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899163+0000", 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899170+0000", 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.866e-06 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899175+0000", 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952814+0000", 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053638689000000003 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952892+0000", 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7890000000000001e-05 2024-09-11T06:20:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953047+0000", 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015576300000000001 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161995 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1751040~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.123052819, 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054070368000000001, 2024-09-11T06:20:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161995 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900905+0000", 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017245850000000001 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900910+0000", 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:20:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900923+0000", 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2619999999999999e-05 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900930+0000", 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4059999999999999e-06 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953077+0000", 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052147129 2024-09-11T06:20:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953152+0000", 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5265999999999994e-05 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953251+0000", 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8666999999999996e-05 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162003 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1882112~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.121033775000001, 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054417001, 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162003 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901202+0000", 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901209+0000", 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901214+0000", 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955009+0000", 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053795526000000003 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955110+0000", 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010130500000000001 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955617+0000", 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050644199999999996 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162004 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.121013788000001, 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054432803000000002, 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162004 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901222+0000", 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901227+0000", 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7099999999999998e-06 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901231+0000", 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.357e-06 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955645+0000", 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054413571000000001 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955653+0000", 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162005 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.120997077, 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054450025999999999, 2024-09-11T06:20:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162005 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901291+0000", 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4326000000000001e-05 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901294+0000", 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3459999999999998e-06 2024-09-11T06:20:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901302+0000", 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0239999999999997e-06 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901308+0000", 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955677+0000", 2024-09-11T06:20:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054368593999999999 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955687+0000", 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8500000000000006e-06 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162006 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.120916265, 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054418451, 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162006 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902903+0000", 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015855590000000001 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902908+0000", 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:20:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902922+0000", 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3949e-05 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902929+0000", 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3150000000000003e-06 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955725+0000", 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052795684000000002 2024-09-11T06:20:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955736+0000", 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183479 3.15 3:ac303efb:::rbd_data.116d42e0aa2c.0000000000000010:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.7285764439999998, 2024-09-11T06:20:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83363719300000005, 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183479 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293658+0000", 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293663+0000", 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293676+0000", 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2734999999999999e-05 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293683+0000", 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6559999999999992e-06 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293746+0000", 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2748000000000003e-05 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293759+0000", 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2767e-05 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.126963+0000", 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83320435800000003 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127119+0000", 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015564999999999999 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127294+0000", 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017540899999999999 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183484 3.15 3:a84be19c:::rbd_data.116d42e0aa2c.0000000000000015:head [sparse-read 0~4259840] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.7281220180000005, 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83354649000000003, 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183484 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8700000000000005e-07 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294116+0000", 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294126+0000", 2024-09-11T06:20:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6339999999999996e-06 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294131+0000", 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3990000000000003e-06 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294186+0000", 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5438e-05 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294196+0000", 2024-09-11T06:20:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9769999999999995e-06 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127600+0000", 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83340399499999995 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127658+0000", 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7710000000000001e-05 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.115 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:10.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:10.116 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:10.115+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:10.122 INFO:teuthology.orchestra.run.smithi070.stderr:marked in osd.3. 2024-09-11T06:20:10.140 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-11T06:20:10.216 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:10.215+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230165 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.11013350099999999, 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.110154998, 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230165 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118908+0000", 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118915+0000", 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0509999999999999e-06 2024-09-11T06:20:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118929+0000", 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.383e-05 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118940+0000", 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1368e-05 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129437+0000", 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010497272 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129446+0000", 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4980000000000006e-06 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230166 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.106886417, 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.10694920500000001, 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230166 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122155+0000", 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122166+0000", 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0689e-05 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122180+0000", 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3879e-05 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122190+0000", 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0671e-05 2024-09-11T06:20:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129472+0000", 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072814869999999997 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129477+0000", 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 2 2024-09-11T06:20:10.238 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:10.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:10.318 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:10.317+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:10.381 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:10.382 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:10.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:10.418 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:10.418+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:10.495 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 190.87408350800001, 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:20:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:20:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 190.57964792999999, 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:20:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:20:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:20:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 105.31308473599999, 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:20:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:20:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:20:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90645 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 256000~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 100.349402145, 2024-09-11T06:20:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055273625, 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90645 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:20:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144311+0000", 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144313+0000", 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.702e-06 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144318+0000", 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4879999999999998e-06 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144323+0000", 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5549999999999996e-06 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199411+0000", 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055088492000000003 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199473+0000", 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1841999999999995e-05 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199584+0000", 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111221 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90646 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 268288~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 100.349384719, 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.05553114, 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90646 2024-09-11T06:20:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144328+0000", 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144329+0000", 2024-09-11T06:20:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1199999999999999e-07 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144330+0000", 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6470000000000001e-06 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144336+0000", 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4820000000000002e-06 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144340+0000", 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4970000000000003e-06 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199613+0000", 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055272876999999998 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199682+0000", 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9072000000000005e-05 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199859+0000", 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017725299999999999 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 100.34936746299999, 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:20:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:20:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.375157266000002, 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:20:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.375064563999999, 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.374858754000002, 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:20:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:20:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.374773187000002, 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:20:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:20:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:20:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.374559929, 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:20:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:20:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.374476610000002, 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:20:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.374219726999996, 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.374158288000004, 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:20:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:20:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.373912462999996, 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:20:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:20:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.373844336000005, 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:20:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.373576674000006, 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:20:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.373504634, 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:20:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.373333875, 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:20:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.373228654000002, 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:20:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:20:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:10.597 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:10.599 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:10.599 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:10.597+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:10.700 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:10.699+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:10.713 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:10.713 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:10.713 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:10.713 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:10.722 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:10.800 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:10.800+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:10.825 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:10.825 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:10.826 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:10.826 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:10.834 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:10.901 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:10.901+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 33.450008263999997, 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:20:10.938 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:20:10.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:20:10.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:10.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:20:10.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.945 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.538482323, 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72623960399999998, 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397783+0000", 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.147e-06 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398274+0000", 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049154799999999996 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398283+0000", 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1179999999999998e-06 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398288+0000", 2024-09-11T06:20:10.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398330+0000", 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1692e-05 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398336+0000", 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4689999999999996e-06 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124013+0000", 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72567764599999995 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124021+0000", 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:10.950 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.395406917000001, 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58344928699999998, 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540858+0000", 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541443+0000", 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058485600000000003 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541451+0000", 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0639999999999994e-06 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541456+0000", 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:20:10.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541523+0000", 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7529999999999999e-05 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541534+0000", 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124290+0000", 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58275560900000001 2024-09-11T06:20:10.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124306+0000", 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6065e-05 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3:dd3750b5:::rbd_data.116ddf3f5156.0000000000000013:head [write 0~409600 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 15.389145571, 2024-09-11T06:20:10.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58172919000000001, 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547119+0000", 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547621+0000", 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000501645 2024-09-11T06:20:10.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547629+0000", 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6589999999999996e-06 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547634+0000", 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.848e-06 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547686+0000", 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.147e-05 2024-09-11T06:20:10.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547695+0000", 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124336+0000", 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.57664082699999997 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124428+0000", 2024-09-11T06:20:10.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2153999999999999e-05 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124519+0000", 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0313000000000001e-05 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.125614+0000", 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001095794 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128786+0000", 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031712770000000001 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128821+0000", 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5602000000000002e-05 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128847+0000", 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6109999999999999e-05 2024-09-11T06:20:10.961 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227124 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 397312~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.462688802, 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046188726999999999, 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.962 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227124 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5899999999999998e-07 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473576+0000", 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0109999999999999e-06 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473579+0000", 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9390000000000002e-06 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473584+0000", 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.921e-06 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519653+0000", 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046069327 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519698+0000", 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4518000000000003e-05 2024-09-11T06:20:10.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519764+0000", 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5752000000000003e-05 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227125 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 399360~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.462676657, 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046294848, 2024-09-11T06:20:10.966 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227125 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473591+0000", 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.54e-06 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473594+0000", 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999999e-06 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473597+0000", 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7530000000000002e-06 2024-09-11T06:20:10.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519790+0000", 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046192892999999999 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519828+0000", 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8266000000000003e-05 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519882+0000", 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3816000000000001e-05 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227126 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 401408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.462663737, 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046400064999999997, 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.971 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227126 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473602+0000", 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3549999999999999e-06 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473607+0000", 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2050000000000001e-06 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473610+0000", 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0479999999999999e-06 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519904+0000", 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046293809999999998 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519944+0000", 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0621999999999998e-05 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520000+0000", 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5656999999999999e-05 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.975 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227127 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 403456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.462649911, 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046519645999999998, 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.976 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227127 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473616+0000", 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473626+0000", 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5899999999999997e-06 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473631+0000", 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8640000000000001e-06 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520035+0000", 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046403941999999997 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520077+0000", 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1282999999999998e-05 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520133+0000", 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6747999999999999e-05 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227128 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 405504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.462626108, 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046616360000000003, 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.980 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227128 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473640+0000", 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9120000000000001e-06 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473649+0000", 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473655+0000", 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520159+0000", 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046503925000000002 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520202+0000", 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-05 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520254+0000", 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2194999999999997e-05 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227129 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 407552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.984 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.462602511, 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046708761000000001, 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227129 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473662+0000", 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-11T06:20:10.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473664+0000", 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473671+0000", 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0759999999999997e-06 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473676+0000", 2024-09-11T06:20:10.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520281+0000", 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046605466999999998 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520320+0000", 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8875999999999998e-05 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520370+0000", 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9972000000000002e-05 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227130 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 409600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4625787210000001, 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046828026000000002, 2024-09-11T06:20:10.989 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227130 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474753+0000", 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001068334 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474757+0000", 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.737e-06 2024-09-11T06:20:10.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474763+0000", 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474768+0000", 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520401+0000", 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045632645999999999 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520454+0000", 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3227999999999999e-05 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520513+0000", 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9144999999999997e-05 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227134 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 417792~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.461455774, 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046187445000000001, 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227134 2024-09-11T06:20:10.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474809+0000", 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474812+0000", 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.039e-06 2024-09-11T06:20:10.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474815+0000", 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520893+0000", 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046078467999999997 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:10.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520936+0000", 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2809999999999998e-05 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520995+0000", 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9224000000000001e-05 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227135 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 419840~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:10.998 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4614460249999999, 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046298338000000001, 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227135 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:10.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476753+0000", 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001935057 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.000 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476757+0000", 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2610000000000004e-06 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476768+0000", 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476775+0000", 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:20:11.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521030+0000", 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044254449000000001 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521067+0000", 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7261000000000001e-05 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521116+0000", 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8934999999999998e-05 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227146 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 442368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.45926208, 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046216054999999999, 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.003 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227146 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7399999999999999e-07 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477003+0000", 2024-09-11T06:20:11.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1769999999999999e-06 2024-09-11T06:20:11.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477006+0000", 2024-09-11T06:20:11.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:20:11.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477009+0000", 2024-09-11T06:20:11.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6410000000000002e-06 2024-09-11T06:20:11.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523047+0000", 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046037814000000003 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523137+0000", 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0424e-05 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523218+0000", 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0654000000000004e-05 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227147 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 444416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.459252182, 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046410320999999997, 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.010 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227147 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478755+0000", 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001743426 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478759+0000", 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2200000000000003e-06 2024-09-11T06:20:11.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478768+0000", 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478775+0000", 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6699999999999997e-06 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523251+0000", 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044475796999999997 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523328+0000", 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6787999999999997e-05 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523422+0000", 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4241999999999997e-05 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.014 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227192 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 273408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4505077790000001, 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046102219999999999, 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227192 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:11.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485809+0000", 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3118000000000002e-05 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485812+0000", 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485831+0000", 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485837+0000", 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9789999999999998e-06 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531732+0000", 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045895683999999999 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531781+0000", 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8853999999999997e-05 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531858+0000", 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6889000000000002e-05 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227193 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 275456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:11.019 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.450416701, 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046243092999999999, 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227193 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486066+0000", 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021887 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486070+0000", 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6490000000000001e-06 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486076+0000", 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6789999999999999e-06 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486081+0000", 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531897+0000", 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045816669999999997 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531981+0000", 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3554999999999995e-05 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532090+0000", 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109084 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.023 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227194 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 277504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.450168744, 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046160642000000002, 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.024 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227194 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486297+0000", 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000202337 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486300+0000", 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9670000000000001e-06 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486308+0000", 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5089999999999996e-06 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486313+0000", 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532129+0000", 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045815225000000001 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532199+0000", 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0402999999999997e-05 2024-09-11T06:20:11.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532256+0000", 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6641000000000002e-05 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227195 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 279552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4499411119999999, 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046088184999999997, 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.028 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227195 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486470+0000", 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147754 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486474+0000", 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2770000000000001e-06 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486484+0000", 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8819999999999996e-06 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486488+0000", 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532287+0000", 2024-09-11T06:20:11.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045798959 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532345+0000", 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7584999999999998e-05 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532411+0000", 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5782000000000001e-05 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227196 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 281600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 1.4497618000000001, 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046093975000000002, 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227196 2024-09-11T06:20:11.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487755+0000", 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012529959999999999 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487759+0000", 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9570000000000004e-06 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487765+0000", 2024-09-11T06:20:11.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5910000000000001e-06 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487770+0000", 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2409999999999997e-06 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532448+0000", 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044678540000000003 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532527+0000", 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8465000000000002e-05 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532596+0000", 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9184999999999996e-05 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.037 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:11.039 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:11.040 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:11.038+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:11.139 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:11.138+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:11.146 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:11.147 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:11.147 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:11.147 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:11.155 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:11.241 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:11.240+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:11.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:20:11.300 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:11.300 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:11.300 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:11.308 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:11.341 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:11.340+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.068022011, 2024-09-11T06:20:11.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.414 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:20:11.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.420 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.964097824999996, 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:11.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:20:11.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.964071474999997, 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:11.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:20:11.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.429 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.964050994999994, 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:20:11.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.964032281000001, 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955301446999997, 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.439 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:20:11.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:20:11.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955267863000003, 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.444 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955255034000004, 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:20:11.448 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:20:11.452 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955244897, 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:20:11.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955234078999993, 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.458 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:20:11.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.462 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955224199, 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:11.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955214467999994, 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:20:11.467 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:11.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:20:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955204850000001, 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.472 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:20:11.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.476 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955195036000006, 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:20:11.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955179669000003, 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.481 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:20:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:20:11.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.955169366999996, 2024-09-11T06:20:11.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:11.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:20:11.489 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.953469084000005, 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.490 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:20:11.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.947324085000005, 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:11.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.947314589000001, 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.499 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:20:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:20:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 66.947305029999995, 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:11.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:20:11.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:11.508 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:11.509 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:11.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:11.510 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:11.509+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:11.511 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:11.611 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:11.610+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:11.614 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:11.614 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:11.614 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:11.615 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:11.623 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:11.629 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:11.629 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:11.646 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:11.661 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:11.662 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:11.677 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:11.694 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:11.710 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:11.711 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:11.711+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:11.727 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:11.727 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:11.743 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:11.743 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:11.767 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:11.768 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:11.776 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:11.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:11.817+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:11.913 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:11.913+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:11.919 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:11.919 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:11.928 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:12.014 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:12.013+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:12.030 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:12.030 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:12.039 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:12.115 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:12.115+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:20:12.187 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:12.187 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:12.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:12.240 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:12.239+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:12.298 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:12.298 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:12.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:12.350 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:12.349+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:12.413 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:12.413 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:12.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:12.417+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:12.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:12.519 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:12.518+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:12.588 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:12.588 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:12.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:12.632 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-11T06:20:12.632 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:12.631+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:12.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:12.720+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:12.781 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:12.781 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:12.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:12.837 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:12.836+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:12.909 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:12.910 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:12.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:12.922 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:12.921+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:12.956 INFO:teuthology.orchestra.run.smithi070.stdout:5967 punch from 0xe0a797 to 0xe15905, (0xb16e bytes) 2024-09-11T06:20:12.959 INFO:teuthology.orchestra.run.smithi070.stdout:5968 punch from 0x382fb1c to 0x3833979, (0x3e5d bytes) 2024-09-11T06:20:12.959 INFO:teuthology.orchestra.run.smithi070.stdout:5969 writesame 0x45e67ce thru 0x45f03b3 data_size 0x41(0x9be6 bytes) 2024-09-11T06:20:12.963 INFO:teuthology.orchestra.run.smithi070.stdout:5971 punch from 0xaf3d0f to 0xb034b6, (0xf7a7 bytes) 2024-09-11T06:20:12.963 INFO:teuthology.orchestra.run.smithi070.stdout:5972 read 0x9f5c377 thru 0x9f5ca26 (0x6b0 bytes) 2024-09-11T06:20:12.963 INFO:teuthology.orchestra.run.smithi070.stdout:5973 writesame 0x23004ab thru 0x230e477 data_size 0x2f(0xdfcd bytes) 2024-09-11T06:20:12.968 INFO:teuthology.orchestra.run.smithi070.stdout:5974 read 0xafc1337 thru 0xafc8323 (0x6fed bytes) 2024-09-11T06:20:12.968 INFO:teuthology.orchestra.run.smithi070.stdout:5975 write 0x973787f thru 0x9738a63 (0x11e5 bytes) 2024-09-11T06:20:12.972 INFO:teuthology.orchestra.run.smithi070.stdout:5976 writesame 0x7021359 thru 0x7022b42 data_size 0x1(0x17ea bytes) 2024-09-11T06:20:12.976 INFO:teuthology.orchestra.run.smithi070.stdout:5977 punch from 0x5c6f69 to 0x5ca51c, (0x35b3 bytes) 2024-09-11T06:20:12.977 INFO:teuthology.orchestra.run.smithi070.stdout:5979 read 0x8605790 thru 0x861313b (0xd9ac bytes) 2024-09-11T06:20:12.977 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:12.978 INFO:teuthology.orchestra.run.smithi070.stdout:5982 trunc from 0xc800ff3 to 0xb4a81ce 2024-09-11T06:20:12.986 INFO:teuthology.orchestra.run.smithi070.stdout:compare and write disabled 2024-09-11T06:20:12.986 INFO:teuthology.orchestra.run.smithi070.stdout:5985 read 0x4c96210 thru 0x4c9e6b0 (0x84a1 bytes) 2024-09-11T06:20:12.994 INFO:teuthology.orchestra.run.smithi070.stdout:5987 writesame 0xcaa6036 thru 0xcaacac7 data_size 0x3(0x6a92 bytes) 2024-09-11T06:20:12.994 INFO:teuthology.orchestra.run.smithi070.stdout:5988 writesame 0x561aad2 thru 0x5621326 data_size 0x1d(0x6855 bytes) 2024-09-11T06:20:12.999 INFO:teuthology.orchestra.run.smithi070.stdout:5990 write 0xba80ccb thru 0xba8fd78 (0xf0ae bytes) 2024-09-11T06:20:13.003 INFO:teuthology.orchestra.run.smithi070.stdout:5991 punch from 0x4ede960 to 0x4ee5954, (0x6ff4 bytes) 2024-09-11T06:20:13.003 INFO:teuthology.orchestra.run.smithi070.stdout:5992 punch from 0x10c6408 to 0x10c7fa4, (0x1b9c bytes) 2024-09-11T06:20:13.004 INFO:teuthology.orchestra.run.smithi070.stdout:5993 punch from 0xb3acacf to 0xb3b09c6, (0x3ef7 bytes) 2024-09-11T06:20:13.004 INFO:teuthology.orchestra.run.smithi070.stdout:5994 writesame 0x50bca60 thru 0x50c81cb data_size 0xac(0xb76c bytes) 2024-09-11T06:20:13.007 INFO:teuthology.orchestra.run.smithi070.stdout:5995 punch from 0x770bae9 to 0x770ee56, (0x336d bytes) 2024-09-11T06:20:13.007 INFO:teuthology.orchestra.run.smithi070.stdout:5997 punch from 0xc0884c5 to 0xc08e8c9, (0x6404 bytes) 2024-09-11T06:20:13.008 INFO:teuthology.orchestra.run.smithi070.stdout:5999 trunc from 0xcaacac8 to 0xbe354f4 2024-09-11T06:20:13.022 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:13.022+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:13.030 INFO:teuthology.orchestra.run.smithi070.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-11T06:20:13.095 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:13.095 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:13.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:13.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:13.122+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:13.224 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:13.223+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:13.257 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:13.257 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:13.266 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:13.325 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:13.324+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:13.370 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:13.370 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:13.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:13.463 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:13.462+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:13.526 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:13.525+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:13.541 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:13.541 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:13.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:13.636 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:13.635+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:13.706 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:13.706 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:13.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:13.727 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:13.726+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:13.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:13.829 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:13.827+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:13.877 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:13.877 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:13.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:13.896 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:13.897 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:13.918 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:13.918 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:13.929 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:13.928+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:13.939 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:13.939 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:13.957 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:13.957 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:13.974 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:13.992 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:13.992 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:14.010 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:14.016 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:14.016 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:14.016 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:14.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:14.030 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:14.030 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:14.030 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:14.029+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:14.131 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:14.130+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:14.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:20:14.157 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:14.157 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:14.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:20:14.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:14.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 194.53515579, 2024-09-11T06:20:14.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29181591299999998, 2024-09-11T06:20:14.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:14.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:20:14.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:20:14.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1 2024-09-11T06:20:14.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.160 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:14.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619629+0000", 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619634+0000", 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8930000000000004e-06 2024-09-11T06:20:14.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619642+0000", 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3320000000000003e-06 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619655+0000", 2024-09-11T06:20:14.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3325e-05 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619671+0000", 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5752000000000001e-05 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619740+0000", 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9395999999999998e-05 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.619748+0000", 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6290000000000001e-06 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910024+0000", 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.29027636000000001 2024-09-11T06:20:14.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910207+0000", 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018296499999999999 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.910376+0000", 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016892400000000001 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911051+0000", 2024-09-11T06:20:14.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067451900000000005 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911338+0000", 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028781299999999999 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911393+0000", 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4911999999999999e-05 2024-09-11T06:20:14.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.911445+0000", 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2092999999999997e-05 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4263.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-11T06:20:14.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 194.24072021200001, 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073447736, 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4263", 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/561741568", 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914065+0000", 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914067+0000", 2024-09-11T06:20:14.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6130000000000001e-06 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914081+0000", 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4294000000000001e-05 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914092+0000", 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0784999999999999e-05 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914100+0000", 2024-09-11T06:20:14.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-11T06:20:14.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914169+0000", 2024-09-11T06:20:14.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8637e-05 2024-09-11T06:20:14.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.914177+0000", 2024-09-11T06:20:14.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6940000000000001e-06 2024-09-11T06:20:14.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987354+0000", 2024-09-11T06:20:14.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.073176119999999997 2024-09-11T06:20:14.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:16:59.987513+0000", 2024-09-11T06:20:14.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015920600000000001 2024-09-11T06:20:14.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.174 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:63517 3.11 3:8d980176:::rbd_header.116dccfba5d9:head [watch reconnect cookie 139721795810384 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 108.974157018, 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055787310999999999, 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 63517 2024-09-11T06:20:14.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180628+0000", 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180629+0000", 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-07 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180630+0000", 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.745e-06 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180645+0000", 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4620000000000001e-05 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.180650+0000", 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229753+0000", 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.049103281999999998 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.229843+0000", 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9659000000000003e-05 2024-09-11T06:20:14.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:25.236416+0000", 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065724709999999999 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:90647 3.a 3:5280b0d9:::rbd_data.116d94c57ffc.0000000000000006:2b [read 280576~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 104.010439745, 2024-09-11T06:20:14.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055821593000000003, 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 90647 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.180 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144346+0000", 2024-09-11T06:20:14.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144350+0000", 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144356+0000", 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8309999999999997e-06 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.144361+0000", 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6990000000000002e-06 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199904+0000", 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.055543268999999999 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.199977+0000", 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2541999999999998e-05 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:18:30.200167+0000", 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019042199999999999 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.036229547999994, 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:20:14.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.036136846000005, 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:20:14.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:20:14.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:14.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.035931035999994, 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:20:14.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:20:14.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.035845468999995, 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:20:14.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.035632211000006, 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:14.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:20:14.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.035548891999994, 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:20:14.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:20:14.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.217 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.217 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:14.217 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.035292009000003, 2024-09-11T06:20:14.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:20:14.217 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:14.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:14.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:20:14.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:20:14.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:20:14.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.035230569999996, 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:20:14.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:20:14.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:14.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:20:14.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:14.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:20:14.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:20:14.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:20:14.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.034984745000003, 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.034916617999997, 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:20:14.235 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:20:14.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.240 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.034648955999998, 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:20:14.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:20:14.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.034576916000006, 2024-09-11T06:20:14.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:20:14.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:20:14.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:20:14.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:20:14.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:20:14.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:20:14.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:20:14.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:20:14.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:20:14.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.253 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.253 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.253 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.034406157000006, 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:20:14.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:20:14.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.034300935999994, 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:20:14.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230165 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:14.264 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0358793210000004, 2024-09-11T06:20:14.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0055556050000001, 2024-09-11T06:20:14.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.265 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230165 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118908+0000", 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118915+0000", 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0509999999999999e-06 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118929+0000", 2024-09-11T06:20:14.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.383e-05 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118940+0000", 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1368e-05 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129437+0000", 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010497272 2024-09-11T06:20:14.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129446+0000", 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4980000000000006e-06 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124450+0000", 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99500413499999996 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124462+0000", 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1751e-05 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230166 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0326322369999996, 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0023415419999999, 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:14.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:14.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:14.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:14.271 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230166 2024-09-11T06:20:14.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.271 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:14.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122155+0000", 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122166+0000", 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0689e-05 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:14.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122180+0000", 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3879e-05 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122190+0000", 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0671e-05 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129472+0000", 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072814869999999997 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129477+0000", 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124488+0000", 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99501055000000005 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124495+0000", 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:14.276 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:14.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:14.278 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:14.276+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:14.378 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:14.377+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:14.381 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:14.381 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:14.381 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:14.381 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:14.390 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:14.480 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:14.479+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:14.493 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:14.493 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:14.493 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:14.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:14.580 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:14.579+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:14.607 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:14.607 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:14.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:14.607 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:14.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.607 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:20:14.607 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.118736278999997, 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:20:14.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:20:14.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:20:14.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:14.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.207210337999999, 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72623960399999998, 2024-09-11T06:20:14.614 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397783+0000", 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.147e-06 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398274+0000", 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049154799999999996 2024-09-11T06:20:14.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398283+0000", 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1179999999999998e-06 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398288+0000", 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398330+0000", 2024-09-11T06:20:14.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1692e-05 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398336+0000", 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4689999999999996e-06 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124013+0000", 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72567764599999995 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124021+0000", 2024-09-11T06:20:14.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.064134932000002, 2024-09-11T06:20:14.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58344928699999998, 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540858+0000", 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541443+0000", 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058485600000000003 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541451+0000", 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0639999999999994e-06 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541456+0000", 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:20:14.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541523+0000", 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7529999999999999e-05 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541534+0000", 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124290+0000", 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58275560900000001 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124306+0000", 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6065e-05 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3:dd3750b5:::rbd_data.116ddf3f5156.0000000000000013:head [write 0~409600 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:14.624 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 19.057873585999999, 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58172919000000001, 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547119+0000", 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547621+0000", 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000501645 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547629+0000", 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6589999999999996e-06 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547634+0000", 2024-09-11T06:20:14.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.848e-06 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547686+0000", 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.147e-05 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547695+0000", 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124336+0000", 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.57664082699999997 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124428+0000", 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2153999999999999e-05 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124519+0000", 2024-09-11T06:20:14.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0313000000000001e-05 2024-09-11T06:20:14.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:14.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.125614+0000", 2024-09-11T06:20:14.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001095794 2024-09-11T06:20:14.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:14.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128786+0000", 2024-09-11T06:20:14.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031712770000000001 2024-09-11T06:20:14.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:14.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128821+0000", 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5602000000000002e-05 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128847+0000", 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6109999999999999e-05 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227124 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 397312~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.632 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:14.633 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1314168169999999, 2024-09-11T06:20:14.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046188726999999999, 2024-09-11T06:20:14.633 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.633 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.633 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.633 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227124 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5899999999999998e-07 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473576+0000", 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0109999999999999e-06 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473579+0000", 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9390000000000002e-06 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473584+0000", 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.921e-06 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519653+0000", 2024-09-11T06:20:14.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046069327 2024-09-11T06:20:14.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519698+0000", 2024-09-11T06:20:14.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4518000000000003e-05 2024-09-11T06:20:14.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519764+0000", 2024-09-11T06:20:14.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5752000000000003e-05 2024-09-11T06:20:14.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.638 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.639 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227125 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 399360~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.639 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:14.640 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1314046720000004, 2024-09-11T06:20:14.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046294848, 2024-09-11T06:20:14.640 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.640 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.640 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.641 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227125 2024-09-11T06:20:14.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.641 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:14.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:14.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:14.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:20:14.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473591+0000", 2024-09-11T06:20:14.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.54e-06 2024-09-11T06:20:14.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473594+0000", 2024-09-11T06:20:14.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999999e-06 2024-09-11T06:20:14.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473597+0000", 2024-09-11T06:20:14.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7530000000000002e-06 2024-09-11T06:20:14.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519790+0000", 2024-09-11T06:20:14.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046192892999999999 2024-09-11T06:20:14.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519828+0000", 2024-09-11T06:20:14.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8266000000000003e-05 2024-09-11T06:20:14.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519882+0000", 2024-09-11T06:20:14.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3816000000000001e-05 2024-09-11T06:20:14.650 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.650 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.650 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.651 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227126 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 401408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.651 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:14.651 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1313917519999999, 2024-09-11T06:20:14.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046400064999999997, 2024-09-11T06:20:14.652 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.653 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227126 2024-09-11T06:20:14.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.653 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:14.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:14.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:14.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:20:14.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473602+0000", 2024-09-11T06:20:14.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3549999999999999e-06 2024-09-11T06:20:14.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473607+0000", 2024-09-11T06:20:14.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2050000000000001e-06 2024-09-11T06:20:14.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473610+0000", 2024-09-11T06:20:14.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0479999999999999e-06 2024-09-11T06:20:14.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519904+0000", 2024-09-11T06:20:14.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046293809999999998 2024-09-11T06:20:14.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519944+0000", 2024-09-11T06:20:14.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0621999999999998e-05 2024-09-11T06:20:14.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520000+0000", 2024-09-11T06:20:14.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5656999999999999e-05 2024-09-11T06:20:14.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.662 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.662 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227127 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 403456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.663 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:14.663 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1313779259999999, 2024-09-11T06:20:14.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046519645999999998, 2024-09-11T06:20:14.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.663 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.664 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.664 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227127 2024-09-11T06:20:14.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.665 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:14.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:14.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:14.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:20:14.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473616+0000", 2024-09-11T06:20:14.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-11T06:20:14.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473626+0000", 2024-09-11T06:20:14.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5899999999999997e-06 2024-09-11T06:20:14.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473631+0000", 2024-09-11T06:20:14.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8640000000000001e-06 2024-09-11T06:20:14.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520035+0000", 2024-09-11T06:20:14.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046403941999999997 2024-09-11T06:20:14.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520077+0000", 2024-09-11T06:20:14.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1282999999999998e-05 2024-09-11T06:20:14.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520133+0000", 2024-09-11T06:20:14.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6747999999999999e-05 2024-09-11T06:20:14.673 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.674 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227128 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 405504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.674 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:14.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1313541230000004, 2024-09-11T06:20:14.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046616360000000003, 2024-09-11T06:20:14.675 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.675 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.675 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.676 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227128 2024-09-11T06:20:14.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.677 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:14.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:14.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:14.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:20:14.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473640+0000", 2024-09-11T06:20:14.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9120000000000001e-06 2024-09-11T06:20:14.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473649+0000", 2024-09-11T06:20:14.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:20:14.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473655+0000", 2024-09-11T06:20:14.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:20:14.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520159+0000", 2024-09-11T06:20:14.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046503925000000002 2024-09-11T06:20:14.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520202+0000", 2024-09-11T06:20:14.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-05 2024-09-11T06:20:14.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520254+0000", 2024-09-11T06:20:14.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2194999999999997e-05 2024-09-11T06:20:14.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.685 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.686 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227129 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 407552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.686 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:14.686 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1313305260000002, 2024-09-11T06:20:14.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046708761000000001, 2024-09-11T06:20:14.686 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.687 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227129 2024-09-11T06:20:14.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:14.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:14.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473662+0000", 2024-09-11T06:20:14.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-11T06:20:14.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473664+0000", 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473671+0000", 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0759999999999997e-06 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473676+0000", 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520281+0000", 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046605466999999998 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520320+0000", 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8875999999999998e-05 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520370+0000", 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9972000000000002e-05 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227130 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 409600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.131306736, 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046828026000000002, 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227130 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:14.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474753+0000", 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001068334 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474757+0000", 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.737e-06 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474763+0000", 2024-09-11T06:20:14.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474768+0000", 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520401+0000", 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045632645999999999 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520454+0000", 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3227999999999999e-05 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520513+0000", 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9144999999999997e-05 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227134 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 417792~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.697 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1301837890000002, 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046187445000000001, 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227134 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474809+0000", 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474812+0000", 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.039e-06 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474815+0000", 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:20:14.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520893+0000", 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046078467999999997 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520936+0000", 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2809999999999998e-05 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520995+0000", 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9224000000000001e-05 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227135 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 419840~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.13017404, 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046298338000000001, 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.702 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227135 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:14.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476753+0000", 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001935057 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476757+0000", 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2610000000000004e-06 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476768+0000", 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476775+0000", 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521030+0000", 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044254449000000001 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521067+0000", 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7261000000000001e-05 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521116+0000", 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8934999999999998e-05 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227146 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 442368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1279900950000004, 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046216054999999999, 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227146 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7399999999999999e-07 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477003+0000", 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1769999999999999e-06 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477006+0000", 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477009+0000", 2024-09-11T06:20:14.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6410000000000002e-06 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523047+0000", 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046037814000000003 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523137+0000", 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0424e-05 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523218+0000", 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0654000000000004e-05 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227147 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 444416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1279801970000003, 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046410320999999997, 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227147 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:14.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478755+0000", 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001743426 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478759+0000", 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2200000000000003e-06 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478768+0000", 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478775+0000", 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6699999999999997e-06 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523251+0000", 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044475796999999997 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523328+0000", 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6787999999999997e-05 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523422+0000", 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4241999999999997e-05 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227192 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 273408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.715 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1192357939999997, 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046102219999999999, 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227192 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485809+0000", 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3118000000000002e-05 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485812+0000", 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485831+0000", 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485837+0000", 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9789999999999998e-06 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531732+0000", 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045895683999999999 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531781+0000", 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8853999999999997e-05 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531858+0000", 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6889000000000002e-05 2024-09-11T06:20:14.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227193 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 275456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1191447160000001, 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046243092999999999, 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227193 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486066+0000", 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021887 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486070+0000", 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6490000000000001e-06 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486076+0000", 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6789999999999999e-06 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486081+0000", 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531897+0000", 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045816669999999997 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531981+0000", 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3554999999999995e-05 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532090+0000", 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109084 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.724 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227194 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 277504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1188967590000001, 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046160642000000002, 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227194 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486297+0000", 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000202337 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486300+0000", 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9670000000000001e-06 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486308+0000", 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5089999999999996e-06 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486313+0000", 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:20:14.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532129+0000", 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045815225000000001 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532199+0000", 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0402999999999997e-05 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532256+0000", 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6641000000000002e-05 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227195 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 279552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1186691270000004, 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046088184999999997, 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.729 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227195 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:14.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486470+0000", 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147754 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486474+0000", 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2770000000000001e-06 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486484+0000", 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8819999999999996e-06 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486488+0000", 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532287+0000", 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045798959 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532345+0000", 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7584999999999998e-05 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532411+0000", 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5782000000000001e-05 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227196 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 281600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.1184898150000002, 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046093975000000002, 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227196 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:14.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487755+0000", 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012529959999999999 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487759+0000", 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9570000000000004e-06 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487765+0000", 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5910000000000001e-06 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487770+0000", 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2409999999999997e-06 2024-09-11T06:20:14.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532448+0000", 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044678540000000003 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532527+0000", 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8465000000000002e-05 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:14.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532596+0000", 2024-09-11T06:20:14.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9184999999999996e-05 2024-09-11T06:20:14.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.738 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.738 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:14.738 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:14.738 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:14.739 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:14.740 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:14.738+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:14.840 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:14.839+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:14.883 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:14.883 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:14.883 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:14.883 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:14.891 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:14.941 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:14.940+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:14.994 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:14.994 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:14.994 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:14.994 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:14.994 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:15.002 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:15.044 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:15.043+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:15.122 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:20:15.140 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7, 3] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:15.141 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:15.141 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T06:20:15.141 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 1.000000 2024-09-11T06:20:15.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-11T06:20:15.142 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:15.141+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:15.158 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:15.158 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.81350163899999, 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.159 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:15.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.163 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.709577452999994, 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:15.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:20:15.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:20:15.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.709551102999995, 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.709530623000006, 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.172 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.709511909, 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:20:15.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700781074999995, 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:20:15.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700747491000001, 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:20:15.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700734662000002, 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.190 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:20:15.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700724524999998, 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700713707000006, 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.199 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:15.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.201 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.203 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700703826999998, 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:15.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.208 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700694096000007, 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.212 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700684477999999, 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:20:15.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:20:15.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700674664000005, 2024-09-11T06:20:15.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.221 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700659297000001, 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:20:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:20:15.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.700648994999995, 2024-09-11T06:20:15.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:20:15.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.698948712000004, 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.231 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:20:15.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.692803713000004, 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.236 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:15.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.692794216999999, 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:20:15.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:20:15.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.244 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.692784657999994, 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:20:15.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:20:15.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:20:15.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:20:15.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.249 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.249 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.249 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:15.251 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:15.252 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:15.250+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:15.352 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:15.351+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:15.395 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:230959 3.3 3.9cdd4f43 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:15.395 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:15.149491+0000", 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.24546412500000001, 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.24548378500000001, 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 230959 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.149491+0000", 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.149491+0000", 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.149492+0000", 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.034e-06 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.149497+0000", 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6450000000000004e-06 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.149509+0000", 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1593999999999999e-05 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.149514+0000", 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5110000000000003e-06 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.149566+0000", 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1829000000000001e-05 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.149572+0000", 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4119999999999998e-06 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.399 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:230929 3.3 3.ba98c343 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.259581067, 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.25964087600000002, 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 230929 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135376+0000", 2024-09-11T06:20:15.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1990000000000001e-06 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135380+0000", 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3250000000000001e-06 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135390+0000", 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7429999999999997e-06 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135397+0000", 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9970000000000001e-06 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135455+0000", 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8159999999999999e-05 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135463+0000", 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6030000000000005e-06 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.403 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:230937 3.3 3.3fa0e23 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:15.138341+0000", 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 0.25661467100000002, 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.25670645199999997, 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "waiting for peered", 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.404 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 230937 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.138341+0000", 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.138341+0000", 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.138342+0000", 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.37e-06 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.138348+0000", 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7740000000000001e-06 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.138363+0000", 2024-09-11T06:20:15.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5534000000000001e-05 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.138372+0000", 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5739999999999996e-06 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.138429+0000", 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6546999999999999e-05 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.138437+0000", 2024-09-11T06:20:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0590000000000003e-06 2024-09-11T06:20:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: ], 2024-09-11T06:20:15.408 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 3 2024-09-11T06:20:15.408 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:15.409 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:15.453 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:15.452+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:15.512 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:15.512 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:15.512 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:15.520 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:15.553 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:15.552+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:15.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:15.653+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:15.664 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.544462366999994, 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.665 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:20:15.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:20:15.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.544404821000001, 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:20:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.676 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.544379312000004, 2024-09-11T06:20:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:20:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.677 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:15.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:20:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:20:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:20:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:20:15.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:20:15.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.544156143999999, 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:20:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:20:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:20:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:20:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:20:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:20:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:20:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:20:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:20:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:20:15.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:20:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:20:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:15.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:20:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:20:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:20:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:20:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:20:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:20:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.544121477999994, 2024-09-11T06:20:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:20:15.697 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:20:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.698 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:20:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:20:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:20:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:20:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:20:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:20:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.544097316000006, 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.705 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:20:15.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:20:15.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:20:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:20:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:20:15.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543846764999998, 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.719 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543819384000003, 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:20:15.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.724 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543796244999996, 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:20:15.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543567660999997, 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:15.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:20:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:20:15.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543530527000001, 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:20:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543503337999994, 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:20:15.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:20:15.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543234733000006, 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:20:15.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543193431999995, 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.751 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:20:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:20:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:20:15.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:20:15.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.543168324999996, 2024-09-11T06:20:15.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:20:15.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:20:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:20:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:20:15.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.542927560999999, 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.762 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:20:15.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:20:15.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.542893254999996, 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:20:15.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.771 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.542872488, 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:20:15.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:20:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:20:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.777 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.542641965000001, 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:20:15.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:15.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118795 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 75.542600797000006, 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99200256799999997, 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118795 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.783 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120453+0000", 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120454+0000", 2024-09-11T06:20:15.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.06e-07 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120457+0000", 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9459999999999998e-06 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120464+0000", 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1350000000000003e-06 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120470+0000", 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7760000000000003e-06 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120511+0000", 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1316000000000002e-05 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120517+0000", 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6790000000000002e-06 2024-09-11T06:20:15.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112451+0000", 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.991934078 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112456+0000", 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0320000000000003e-06 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:15.787 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:15.788 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:15.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:15.790 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:15.788+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:15.890 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:15.889+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:15.933 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:15.934 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:15.934 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:15.934 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:15.942 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:15.991 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:15.990+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:16.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:16.045 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:16.045 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:16.045 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:16.045 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:16.045 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:16.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:16.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:16.094+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:16.120 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-11T06:20:16.182 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:16.193 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:16.192+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:16.199 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:16.199 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:16.204 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.963171558, 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.205 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:16.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.209 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.96315881999999, 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.210 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:16.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.214 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.963147687, 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.215 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:16.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.96313709899999, 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.220 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:16.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:16.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:16.224 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.963126604, 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:16.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.96311629100001, 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.229 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:16.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.233 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.96310574899999, 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.234 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:16.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:16.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.96309544299999, 2024-09-11T06:20:16.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:16.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:16.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.963079865, 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.243 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:16.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.96306086000001, 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:16.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:16.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.90353148700001, 2024-09-11T06:20:16.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:16.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:16.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.90351301600001, 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:16.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.903494526, 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:16.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.903477458, 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:16.266 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:16.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.270 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.903459427, 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.271 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:16.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.275 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.90343724300001, 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:16.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.903419251, 2024-09-11T06:20:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:16.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:16.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.903401597, 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.285 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:16.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:16.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:16.289 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.90337868099999, 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.290 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:16.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 147.90336029299999, 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:16.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:16.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:16.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:16.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:16.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:16.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:16.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.299 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.299 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:16.299 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:16.299 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:16.300 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:16.300 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:16.301 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:16.301 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:16.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:16.302 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:16.300+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:16.302 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:16.303 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:16.304 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:16.304 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:16.401 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:16.400+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:16.407 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:16.407 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:16.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:16.502 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:16.501+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:16.558 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:16.558 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:16.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:16.603 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:16.602+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:16.671 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:16.671 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:16.680 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:16.703 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:16.703+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:16.782 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:16.783 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:16.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:16.834 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:16.833+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:16.893 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:16.893 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:16.902 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:16.906 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:16.905+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:17.006 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:17.005+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:17.044 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:17.044 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:17.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:17.106 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:17.105+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:17.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:20:17.166 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:17.166 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:17.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:17.217 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:17.216+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:17.309 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:17.308+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:17.323 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:17.323 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:17.333 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:17.410 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:17.409+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:17.437 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:17.437 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:17.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:17.530 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:17.529+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:17.590 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:17.590 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:17.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:17.640 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:17.639+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:17.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:17.712+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:17.742 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:17.742 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:17.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:17.814 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:17.813+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:17.854 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:17.854 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:17.863 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:17.915 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:17.914+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:17.978 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:17.978 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:17.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:18.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:18.029+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:18.090 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:18.090 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:18.099 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:18.141 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:18.140+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:18.159 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:20:18.217 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:18.216+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:18.266 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:18.266 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:18.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:18.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:18.319 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:18.318+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:18.418 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:18.418+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:18.422 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:18.422 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:18.428 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:18.431 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:18.445 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:18.460 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:18.476 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:18.476 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:18.492 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:18.493 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:18.509 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:18.509 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:18.519 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:18.517+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:18.525 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:18.525 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:18.542 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:18.542 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:18.576 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:18.576 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:18.576 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:18.576 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:18.576 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:18.585 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:18.620 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:18.618+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:18.688 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:18.688 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 119.343590494, 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.689 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:20:18.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.239666307999997, 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.694 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:18.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:20:18.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.698 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.239639957999998, 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:20:18.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:20:18.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.239619477999995, 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.703 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:18.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.707 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.239600764000002, 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:20:18.711 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230869929999997, 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.712 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:20:18.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.716 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230836346000004, 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.717 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:20:18.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230823517000005, 2024-09-11T06:20:18.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:20:18.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.725 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230813380000001, 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.726 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:18.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.730 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230802561999994, 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:20:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230792682000001, 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.739 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230782950999995, 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.740 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230773333000002, 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:20:18.744 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:20:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:20:18.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230763519000007, 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.749 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:20:18.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230748152000004, 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.753 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:18.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.757 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.230737849999997, 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:20:18.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:18.762 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.229037567000006, 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:20:18.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.766 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.222892568000006, 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.767 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:18.768 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.769 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.770 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.771 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.222883072000002, 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.772 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:20:18.774 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.775 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 74.222873512999996, 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:18.776 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:18.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:18.780 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:18.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:18.782 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:18.780+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:18.883 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:18.882+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:18.884 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:18.885 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:18.885 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:18.885 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:18.893 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:18.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:18.983+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:18.995 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:18.995 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:18.995 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:19.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:19.085 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:19.083+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:19.148 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:19.148 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.028027554999994, 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.149 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:20:19.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027970009000001, 2024-09-11T06:20:19.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:19.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:20:19.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027944500000004, 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:20:19.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:20:19.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:20:19.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:19.165 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027721331999999, 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:19.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:20:19.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027686665999994, 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:19.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:20:19.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027662504000006, 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:20:19.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:20:19.180 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027411952999998, 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.181 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:20:19.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:20:19.185 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027384572000003, 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.186 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.190 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027361432999996, 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.191 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:20:19.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:20:19.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027132848999997, 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:19.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:20:19.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027095715000002, 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:20:19.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:20:19.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.027068525999994, 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:20:19.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.026799921000006, 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.211 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:20:19.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.026758619999995, 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.216 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:19.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.026733512999996, 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:20:19.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:19.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.026492748999999, 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:19.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:20:19.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.026458442999996, 2024-09-11T06:20:19.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.026437676, 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:20:19.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:20:19.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 79.026207153000001, 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:19.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:19.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:20:19.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:20:19.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:230929 3.3 3:c2c3195d:::rbd_data.116dc6ff1838.0000000000000047:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 4.0112449400000001, 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99430693299999995, 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 230929 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135376+0000", 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1990000000000001e-06 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135380+0000", 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3250000000000001e-06 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135390+0000", 2024-09-11T06:20:19.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7429999999999997e-06 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135397+0000", 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9970000000000001e-06 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135455+0000", 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8159999999999999e-05 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:19.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135463+0000", 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6030000000000005e-06 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127459+0000", 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99199554099999998 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127561+0000", 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102329 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127635+0000", 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3538e-05 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129214+0000", 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001578695 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129575+0000", 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036180099999999997 2024-09-11T06:20:19.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129633+0000", 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8009e-05 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129681+0000", 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7992999999999999e-05 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.252 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.253 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:19.254 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:19.255 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:19.252+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:19.355 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:19.353+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:19.358 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:19.359 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:19.359 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:19.359 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:19.367 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:19.456 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:19.454+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:19.469 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:19.469 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:19.470 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:19.470 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:19.470 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:19.479 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:19.557 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:19.556+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:19.583 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:19.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.341972215, 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:19.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.589 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.34195947699999, 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.590 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:19.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:19.594 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.341948344, 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:19.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.34193775599999, 2024-09-11T06:20:19.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.600 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:19.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:19.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.604 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.341927261, 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.605 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.34191694800001, 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:19.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:19.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.34190640599999, 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.34189610000001, 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:19.620 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:19.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.341880522, 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.625 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:19.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:19.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.34186151700001, 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.630 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:19.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.28233214400001, 2024-09-11T06:20:19.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:19.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:19.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.282313673, 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:19.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.643 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.282295183, 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:19.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.282278115, 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:19.648 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:19.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.282260084, 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:19.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.657 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.28223790000001, 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:19.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.282219908, 2024-09-11T06:20:19.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:19.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.667 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.282202254, 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:19.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.28217933799999, 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.672 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:19.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 151.28216094999999, 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:19.677 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:19.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:19.681 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:19.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:19.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:19.682+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:19.783 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:19.781+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:19.793 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:19.793 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:19.793 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:19.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:19.886 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:19.884+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:19.945 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:19.945 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:19.945 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:19.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:19.995 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:19.994+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:20.086 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:20.084+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:20.099 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:20.099 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:20.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.765023923000001, 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:20:20.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:20:20.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:20.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:20:20.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.719152063999999, 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:20:20.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:191036 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.496037098, 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659934617, 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 191036 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601548+0000", 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6700000000000003e-07 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601552+0000", 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0659999999999997e-06 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601558+0000", 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-06 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601561+0000", 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.253e-06 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601612+0000", 2024-09-11T06:20:20.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1629000000000003e-05 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601623+0000", 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0397000000000001e-05 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261189+0000", 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659566337 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261380+0000", 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019126000000000001 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261482+0000", 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101248 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.118 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224551 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3374080~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859453767, 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.06128741, 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224551 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238131+0000", 2024-09-11T06:20:20.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238133+0000", 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9719999999999999e-06 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238138+0000", 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238143+0000", 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299252+0000", 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061109588999999999 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299337+0000", 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4788000000000002e-05 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299418+0000", 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0584e-05 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224552 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3376128~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859435953, 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061927471999999997, 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224552 2024-09-11T06:20:20.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238149+0000", 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-07 2024-09-11T06:20:20.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238151+0000", 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8810000000000001e-06 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238156+0000", 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238161+0000", 2024-09-11T06:20:20.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4870000000000004e-06 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299444+0000", 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061282879999999998 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299839+0000", 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039492900000000003 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300076+0000", 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000237013 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224553 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3378176~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859418178, 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108599, 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224553 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238168+0000", 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238174+0000", 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6849999999999998e-06 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238178+0000", 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300107+0000", 2024-09-11T06:20:20.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061928578999999997 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300183+0000", 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6075999999999995e-05 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300275+0000", 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1576000000000005e-05 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224554 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3380224~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859400686000001, 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274642999999998, 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224554 2024-09-11T06:20:20.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238184+0000", 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3500000000000002e-07 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238186+0000", 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.756e-06 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238191+0000", 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6180000000000003e-06 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238196+0000", 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999999e-06 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300304+0000", 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108236999999997 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300376+0000", 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1594000000000006e-05 2024-09-11T06:20:20.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300458+0000", 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224555 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3382272~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859383469000001, 2024-09-11T06:20:20.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062436684999999999, 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224555 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:20.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238203+0000", 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238208+0000", 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238213+0000", 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-06 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300487+0000", 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274312999999998 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300557+0000", 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0238000000000001e-05 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300637+0000", 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0272000000000007e-05 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224556 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3384320~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859233651, 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062473433000000002, 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224556 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238354+0000", 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6690000000000002e-06 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238362+0000", 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370000000000004e-06 2024-09-11T06:20:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238367+0000", 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300664+0000", 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062297407999999999 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300736+0000", 2024-09-11T06:20:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2103999999999999e-05 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300824+0000", 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7484999999999993e-05 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224557 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3386368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859209864, 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062640965000000007, 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224557 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:20.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238375+0000", 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238377+0000", 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.872e-06 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238382+0000", 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.93e-06 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238387+0000", 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300852+0000", 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062465510000000002 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300929+0000", 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6565999999999998e-05 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301015+0000", 2024-09-11T06:20:20.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6508999999999995e-05 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224558 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3388416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859192050000001, 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062861117999999994, 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.151 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224558 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238395+0000", 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0619999999999999e-06 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238400+0000", 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1259999999999997e-06 2024-09-11T06:20:20.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238403+0000", 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7929999999999999e-06 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301051+0000", 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062647184999999994 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301151+0000", 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9999000000000003e-05 2024-09-11T06:20:20.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301253+0000", 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102618 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224559 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3390464~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859175838000001, 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063237010999999996, 2024-09-11T06:20:20.155 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224559 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238409+0000", 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4400000000000001e-07 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238410+0000", 2024-09-11T06:20:20.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.782e-06 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238416+0000", 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.356e-06 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238420+0000", 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0210000000000001e-06 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301280+0000", 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062859905999999993 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301460+0000", 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018026699999999999 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301645+0000", 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018543499999999999 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224560 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3392512~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859157798, 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063424783999999998, 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224560 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238427+0000", 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.03e-07 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238429+0000", 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8330000000000001e-06 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238434+0000", 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3360000000000002e-06 2024-09-11T06:20:20.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238438+0000", 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301670+0000", 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063231417999999998 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301763+0000", 2024-09-11T06:20:20.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3914999999999998e-05 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301851+0000", 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7705000000000001e-05 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224561 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3394560~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:20.164 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859141064999999, 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063589239000000006, 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224561 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:20.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238445+0000", 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6160000000000001e-06 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238451+0000", 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238456+0000", 2024-09-11T06:20:20.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9649999999999999e-06 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301876+0000", 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063419918000000006 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301950+0000", 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4187e-05 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302032+0000", 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2168000000000003e-05 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224562 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3396608~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859116435000001, 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063734823999999995, 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224562 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238470+0000", 2024-09-11T06:20:20.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0080000000000001e-06 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238476+0000", 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8209999999999998e-06 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238480+0000", 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2250000000000002e-06 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302056+0000", 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063575452000000005 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302120+0000", 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4689000000000004e-05 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302203+0000", 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2231000000000006e-05 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224563 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3398656~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859098446000001, 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063882994999999998, 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224563 2024-09-11T06:20:20.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238488+0000", 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238493+0000", 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2279999999999998e-06 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238497+0000", 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9539999999999998e-06 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302225+0000", 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063728578999999994 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302291+0000", 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5953999999999999e-05 2024-09-11T06:20:20.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302369+0000", 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7340000000000002e-05 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224564 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3400704~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859082557000001, 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064035277000000002, 2024-09-11T06:20:20.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224564 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238504+0000", 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.578e-06 2024-09-11T06:20:20.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238509+0000", 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238513+0000", 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302390+0000", 2024-09-11T06:20:20.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063877220999999998 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302454+0000", 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3812999999999994e-05 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302537+0000", 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812000000000006e-05 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224565 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3402752~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859066237, 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064466108999999994, 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224565 2024-09-11T06:20:20.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238520+0000", 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238526+0000", 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.429e-06 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238530+0000", 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302559+0000", 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064029364000000005 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302843+0000", 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028354600000000003 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302984+0000", 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014120100000000001 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224566 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3404800~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859048790999999, 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064698612000000003, 2024-09-11T06:20:20.187 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224566 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238536+0000", 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0600000000000001e-07 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238537+0000", 2024-09-11T06:20:20.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.68e-06 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238543+0000", 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4659999999999998e-06 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238547+0000", 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1679999999999997e-06 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303014+0000", 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064467177000000001 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303085+0000", 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0916999999999999e-05 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303234+0000", 2024-09-11T06:20:20.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014889800000000001 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224567 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3406848~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.859032209, 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064927740999999997, 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224567 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4700000000000002e-07 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238554+0000", 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238561+0000", 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238565+0000", 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303258+0000", 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064692538999999993 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303353+0000", 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5149000000000007e-05 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303480+0000", 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012678 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.197 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:20.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:20:20.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:20.199 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:20.196+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:20.299 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:20.298+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:20.346 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:20.347 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:20.347 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:20.347 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:20.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:20.400 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:20.399+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:20.501 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:20.499+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:20.502 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:20.502 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:20.502 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:20.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:20.553 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:20.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:20.601+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:20.661 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:20.661 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:20.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:20.661 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:20.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 80.538749385000003, 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:20:20.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:20:20.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542504522999998, 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:20:20.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:20:20.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542453612000003, 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:20:20.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:20:20.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542266308000002, 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:20:20.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:20:20.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542229347999999, 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:20:20.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:20:20.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:20.692 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542204491, 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:20:20.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542164526999997, 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.699 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:20:20.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:20:20.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542134150999999, 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:20:20.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:20:20.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:20:20.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542113385, 2024-09-11T06:20:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:20:20.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542080513999998, 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:20:20.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:20:20.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:20:20.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.722 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:20.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542060655999997, 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542040479000001, 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:20:20.729 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:20:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:20:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:20.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542029114000002, 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:20:20.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:20:20.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:20:20.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.542001677000002, 2024-09-11T06:20:20.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:20.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:20.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:20:20.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.541967421000003, 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:20:20.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:20:20.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.541953958000001, 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.541922229000001, 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:20:20.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:20:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.541910070999997, 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:20:20.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:20:20.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:20:20.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:20:20.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.541885221999998, 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.541871993000001, 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:20.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:20.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:20.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:20.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:20.780 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:20.780 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:20.781 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:20.781 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:20.782 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:20.783 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:20.783 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:20.783 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:20.783 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:20.784 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:20.784 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:20.784 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:20.785 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:20.786 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:20.780+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:20.790 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:20.881 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:20.879+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:20.888 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:20.888 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:20.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:20.983 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:20.981+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:21.041 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:21.041 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:21.050 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:21.091 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:21.090+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:21.144 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7, 3] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:21.144 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:21.144 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T06:20:21.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:20:21.171 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:20:21.185 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:21.184+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:21.206 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:21.206 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:21.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:21.302 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:21.301+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:21.368 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:21.368 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:21.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:21.386 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:21.385+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:20:21.452 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 212, 2024-09-11T06:20:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:20:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:20:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:20:21.162364+0000", 2024-09-11T06:20:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:18:57.153745+0000", 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:20:10.116940+0000", 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5801984, 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 7, 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:20:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:20:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:20:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:20:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:20:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:20:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:20:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:20:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:20:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:20:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:20:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:20:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:20:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:20:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:20:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:20:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:20:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:20:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:20:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:20:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:20:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:20:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:20:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:20:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:20:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "212", 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:20:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 84, 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 212, 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:20:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:20:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:20:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:20:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:20:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:20:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:20:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:20:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:20:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:20:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:20:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 205, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:21.479 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.481 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:20:21.483 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 54, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 92, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 204, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 56, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.484 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.485 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:21.486 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.487 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:21.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/747530186", 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/747530186", 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/747530186", 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/747530186", 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 109, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 130, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 205, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 110, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:21.490 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.491 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:21.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:20:21.494 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/4176263936", 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/4176263936", 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/4176263936", 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/4176263936", 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 206, 2024-09-11T06:20:21.496 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:20:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:21.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.499 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:20:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 187, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:20:21.507 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:21.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.507 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.507 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:21.507 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:20:21.508 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:21.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.508 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:21.509 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:21.510 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 204, 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:20:21.514 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:20:21.515 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:21.516 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 206, 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.520 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:20:21.521 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:21.522 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 207, 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.524 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:20:21.527 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:21.528 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:21.529 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 56 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:21.530 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 110 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:20:21.531 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:21.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.533 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:21.535 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.3", 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: 6, 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: 3 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.b", 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:20:21.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 7, 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 4 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 6, 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.19", 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.537 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 4, 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:20:21.538 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:20:21.539 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:20:21.539 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:20:21.539 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:20:21.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.539 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:20:21.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.539 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 75, 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 77, 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 79, 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 81, 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 83, 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.541 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [ 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 75, 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:20:21.542 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:20:21.543 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:20:21.543 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:20:21.543 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:20:21.543 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:20:21.543 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:20:21.543 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:20:21.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:21.543 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:21.546 INFO:tasks.thrashosds.thrasher:j is {'epoch': 212, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:20:21.162364+0000', 'last_up_change': '2024-09-11T06:18:57.153745+0000', 'last_in_change': '2024-09-11T06:20:10.116940+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '212', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 84, 'snap_epoch': 212, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 205, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 54, 'up_from': 92, 'up_thru': 204, 'down_at': 56, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 747530186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 747530186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 747530186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 747530186}]}, 'public_addr': '172.21.15.70:6817/747530186', 'cluster_addr': '172.21.15.70:6819/747530186', 'heartbeat_back_addr': '172.21.15.70:6823/747530186', 'heartbeat_front_addr': '172.21.15.70:6821/747530186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 109, 'up_from': 130, 'up_thru': 205, 'down_at': 110, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 4176263936}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4176263936}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4176263936}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4176263936}]}, 'public_addr': '172.21.15.70:6809/4176263936', 'cluster_addr': '172.21.15.70:6811/4176263936', 'heartbeat_back_addr': '172.21.15.70:6815/4176263936', 'heartbeat_front_addr': '172.21.15.70:6813/4176263936', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 206, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 187, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 204, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 206, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 207, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 56}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 110}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.3', 'osds': [6, 3]}], 'pg_upmap_items': [{'pgid': '3.b', 'mappings': [{'from': 7, 'to': 4}, {'from': 6, 'to': 2}]}, {'pgid': '3.19', 'mappings': [{'from': 4, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 75, 'length': 1}, {'begin': 77, 'length': 1}, {'begin': 79, 'length': 1}, {'begin': 81, 'length': 1}, {'begin': 83, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 75, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:20:21.546 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.19 2024-09-11T06:20:21.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.19 2024-09-11T06:20:21.547 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:21.547 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:21.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:21.548 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:21.544+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:21.646 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:21.645+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:21.693 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:21.693 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:21.703 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:21.747 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:21.746+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:21.817 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:21.817 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:21.826 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:21.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:21.866+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:21.949 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:21.948+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:21.971 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:21.971 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:21.980 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:22.065 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:22.063+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:22.122 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:22.122 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:22.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:22.172 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:22.171+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:clear 3.19 pg_upmap_items mapping 2024-09-11T06:20:22.251 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:22.250+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:22.288 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:22.288 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:22.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:22.351 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:22.350+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:22.440 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:22.441 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:22.449 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:22.451 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:22.451+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:22.552 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:22.552 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:22.552 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:22.552+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:22.560 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:22.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:22.653+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:22.704 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:22.704 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:22.713 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:22.754 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:22.753+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:22.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:22.855 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:22.854+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:22.855 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:22.855 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:22.864 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:22.923 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:22.923 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:22.940 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:22.940 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:22.956 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:22.956 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:22.956 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:22.955+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:23.010 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:23.010 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:23.019 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:23.057 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:23.056+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:23.158 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:23.158+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:23.162 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:23.162 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:23.171 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:23.173 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:23.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:20:23.194 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:23.194 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:23.210 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:23.211 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:23.229 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:23.229 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:23.247 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:23.247 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:23.259 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:23.258+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:23.285 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:23.285 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:23.285 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:23.285 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:23.286 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:23.294 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:23.360 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:23.359+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.19827393099999, 2024-09-11T06:20:23.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.441 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:23.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:23.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.19826119300001, 2024-09-11T06:20:23.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:23.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.449 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.19825005999999, 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.450 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.451 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.451 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.451 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:23.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.451 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:23.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:23.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.19823947200001, 2024-09-11T06:20:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:23.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.459 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.19822897700001, 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:23.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:23.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:23.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:23.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:23.464 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.465 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.465 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.465 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:23.465 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.198218664, 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:23.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:23.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.470 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.19820812200001, 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:23.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:23.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:23.475 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.198197816, 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:23.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:23.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.19818223799999, 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:23.481 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:23.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:23.486 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.198163233, 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.487 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:23.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:23.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:23.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:23.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.492 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13863386, 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.497 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13861538899999, 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:23.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:23.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:23.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.503 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.504 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:23.504 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13859689899999, 2024-09-11T06:20:23.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:23.504 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.504 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.504 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.504 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:23.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:23.509 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13857983099999, 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:23.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:23.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:23.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:23.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:23.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13856179999999, 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.515 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:23.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:23.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.138539616, 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.523 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.525 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13852162399999, 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:23.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:23.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:23.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13850396999999, 2024-09-11T06:20:23.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:23.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13848105400001, 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:23.536 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:23.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:23.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 155.13846266600001, 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:23.541 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:23.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:23.547 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:23.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:23.549 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:23.548+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:23.650 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:23.649+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:23.652 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:23.652 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:23.652 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:23.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:23.751 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:23.751+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:23.763 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:23.763 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:23.764 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:23.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:23.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:23.852+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.581415044, 2024-09-11T06:20:23.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:20:23.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:20:23.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.535543185000002, 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:23.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:20:23.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:191036 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:23.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.312428219000001, 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659934617, 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 191036 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601548+0000", 2024-09-11T06:20:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6700000000000003e-07 2024-09-11T06:20:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601552+0000", 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0659999999999997e-06 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601558+0000", 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-06 2024-09-11T06:20:23.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601561+0000", 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.253e-06 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601612+0000", 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1629000000000003e-05 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601623+0000", 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0397000000000001e-05 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261189+0000", 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659566337 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261380+0000", 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019126000000000001 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261482+0000", 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101248 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224551 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3374080~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675844888, 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.06128741, 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224551 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238131+0000", 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238133+0000", 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9719999999999999e-06 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238138+0000", 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238143+0000", 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299252+0000", 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061109588999999999 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299337+0000", 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4788000000000002e-05 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299418+0000", 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0584e-05 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224552 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3376128~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675827074000001, 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061927471999999997, 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224552 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238149+0000", 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-07 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238151+0000", 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8810000000000001e-06 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238156+0000", 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238161+0000", 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4870000000000004e-06 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299444+0000", 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061282879999999998 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299839+0000", 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039492900000000003 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300076+0000", 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000237013 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224553 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3378176~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675809299000001, 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108599, 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224553 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238168+0000", 2024-09-11T06:20:23.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238174+0000", 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6849999999999998e-06 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238178+0000", 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300107+0000", 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061928578999999997 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300183+0000", 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6075999999999995e-05 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300275+0000", 2024-09-11T06:20:23.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1576000000000005e-05 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224554 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3380224~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675791807, 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274642999999998, 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224554 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238184+0000", 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3500000000000002e-07 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238186+0000", 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.756e-06 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238191+0000", 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6180000000000003e-06 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238196+0000", 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999999e-06 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300304+0000", 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108236999999997 2024-09-11T06:20:23.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300376+0000", 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1594000000000006e-05 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300458+0000", 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224555 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3382272~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.67577459, 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062436684999999999, 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224555 2024-09-11T06:20:23.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238203+0000", 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238208+0000", 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:23.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238213+0000", 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-06 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300487+0000", 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274312999999998 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300557+0000", 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0238000000000001e-05 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300637+0000", 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0272000000000007e-05 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224556 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3384320~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:23.962 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675624772000001, 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062473433000000002, 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224556 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238354+0000", 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6690000000000002e-06 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238362+0000", 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370000000000004e-06 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238367+0000", 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:23.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300664+0000", 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062297407999999999 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300736+0000", 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2103999999999999e-05 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300824+0000", 2024-09-11T06:20:23.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7484999999999993e-05 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224557 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3386368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675600984999999, 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062640965000000007, 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224557 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:23.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238375+0000", 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238377+0000", 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.872e-06 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238382+0000", 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.93e-06 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238387+0000", 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300852+0000", 2024-09-11T06:20:23.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062465510000000002 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300929+0000", 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6565999999999998e-05 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301015+0000", 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6508999999999995e-05 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224558 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3388416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675583171, 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062861117999999994, 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224558 2024-09-11T06:20:23.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238395+0000", 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0619999999999999e-06 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238400+0000", 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1259999999999997e-06 2024-09-11T06:20:23.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238403+0000", 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7929999999999999e-06 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301051+0000", 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062647184999999994 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301151+0000", 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9999000000000003e-05 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301253+0000", 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102618 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224559 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3390464~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675566958999999, 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063237010999999996, 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224559 2024-09-11T06:20:23.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238409+0000", 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4400000000000001e-07 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238410+0000", 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.782e-06 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238416+0000", 2024-09-11T06:20:23.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.356e-06 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238420+0000", 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0210000000000001e-06 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301280+0000", 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062859905999999993 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301460+0000", 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018026699999999999 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301645+0000", 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018543499999999999 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224560 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3392512~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675548919000001, 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063424783999999998, 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224560 2024-09-11T06:20:23.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238427+0000", 2024-09-11T06:20:23.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.03e-07 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238429+0000", 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8330000000000001e-06 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238434+0000", 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3360000000000002e-06 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238438+0000", 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301670+0000", 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063231417999999998 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301763+0000", 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3914999999999998e-05 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301851+0000", 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7705000000000001e-05 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224561 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3394560~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675532186, 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063589239000000006, 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224561 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238445+0000", 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6160000000000001e-06 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238451+0000", 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238456+0000", 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9649999999999999e-06 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301876+0000", 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063419918000000006 2024-09-11T06:20:23.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301950+0000", 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4187e-05 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302032+0000", 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2168000000000003e-05 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224562 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3396608~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675507555999999, 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063734823999999995, 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224562 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238470+0000", 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0080000000000001e-06 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238476+0000", 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8209999999999998e-06 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238480+0000", 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2250000000000002e-06 2024-09-11T06:20:23.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302056+0000", 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063575452000000005 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302120+0000", 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4689000000000004e-05 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302203+0000", 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2231000000000006e-05 2024-09-11T06:20:23.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224563 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3398656~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675489567, 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063882994999999998, 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:23.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224563 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238488+0000", 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:23.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238493+0000", 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2279999999999998e-06 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238497+0000", 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9539999999999998e-06 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302225+0000", 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063728578999999994 2024-09-11T06:20:23.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302291+0000", 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5953999999999999e-05 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302369+0000", 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7340000000000002e-05 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:23.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224564 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3400704~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675473677999999, 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064035277000000002, 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224564 2024-09-11T06:20:24.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238504+0000", 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.578e-06 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238509+0000", 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:20:24.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238513+0000", 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302390+0000", 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063877220999999998 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302454+0000", 2024-09-11T06:20:24.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3812999999999994e-05 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302537+0000", 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812000000000006e-05 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224565 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3402752~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:24.004 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675457357999999, 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064466108999999994, 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224565 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:24.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238520+0000", 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238526+0000", 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.429e-06 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238530+0000", 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:24.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302559+0000", 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064029364000000005 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302843+0000", 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028354600000000003 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302984+0000", 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014120100000000001 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224566 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3404800~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675439912, 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064698612000000003, 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224566 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238536+0000", 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0600000000000001e-07 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238537+0000", 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.68e-06 2024-09-11T06:20:24.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238543+0000", 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4659999999999998e-06 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238547+0000", 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1679999999999997e-06 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303014+0000", 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064467177000000001 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303085+0000", 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0916999999999999e-05 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303234+0000", 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014889800000000001 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224567 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3406848~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.675423329999999, 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064927740999999997, 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224567 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4700000000000002e-07 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238554+0000", 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238561+0000", 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238565+0000", 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303258+0000", 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064692538999999993 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303353+0000", 2024-09-11T06:20:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5149000000000007e-05 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303480+0000", 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012678 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.018 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:24.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:24.020 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:24.018+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:24.121 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:24.120+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:24.164 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:24.165 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:24.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:24.177 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:20:24.221 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:24.220+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:24.294 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:24.295 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:24.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:24.349 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:24.348+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 84.298297149000007, 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:20:24.421 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:20:24.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:20:24.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.302052287000002, 2024-09-11T06:20:24.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:20:24.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:20:24.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:20:24.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.302001376, 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:20:24.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:20:24.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301814071999999, 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:20:24.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:20:24.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301777112000003, 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:20:24.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:20:24.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301752254999997, 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:24.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301712291000001, 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:20:24.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301681915000003, 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:20:24.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:20:24.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:20:24.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301661148999997, 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:20:24.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301628278000003, 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:20:24.474 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:20:24.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:20:24.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301608420000001, 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.485 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301588242999998, 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:20:24.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:20:24.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:20:24.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301576877999999, 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:20:24.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:20:24.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:20:24.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301549440999999, 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:20:24.496 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:20:24.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:20:24.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301515185, 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:24.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:20:24.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301501721999998, 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:20:24.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.514 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301469992999998, 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301457835000001, 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301432986000002, 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:20:24.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.301419756999998, 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:24.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:20:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:20:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.535 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:24.536 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:24.537 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:24.535+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:24.637 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:24.636+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:24.680 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:24.680 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:24.680 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:24.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:24.773 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:24.772+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:24.832 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:24.833 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:24.833 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:24.833 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:24.833 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:24.838 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:24.837+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:24.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:24.938 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:24.938+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:24.985 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:24.985 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:24.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:24.985 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:24.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 185.18029600400001, 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:20:24.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:24.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:20:24.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.809862707000001, 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:20:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:20:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.807459326, 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:20:24.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.001 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153432 3.f 3:f42e81df:::rbd_data.116ddf3f5156.000000000000000f:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.652939184000001, 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79802703600000002, 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153432 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330773+0000", 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.278e-06 2024-09-11T06:20:25.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330953+0000", 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017961999999999999 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330983+0000", 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0188e-05 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330994+0000", 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331072+0000", 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8141999999999998e-05 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331081+0000", 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2890000000000003e-06 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125207+0000", 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79412554300000004 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125321+0000", 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011482299999999999 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125455+0000", 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013386800000000001 2024-09-11T06:20:25.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128673+0000", 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032178269999999999 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128700+0000", 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:25.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128754+0000", 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4716999999999998e-05 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128798+0000", 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3448000000000001e-05 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161945 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 931840~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:25.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.094687371999999, 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053842806999999999, 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161945 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889025+0000", 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9570000000000001e-06 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889030+0000", 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5820000000000001e-06 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889035+0000", 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5889999999999996e-06 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942690+0000", 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053655228999999999 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942767+0000", 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-05 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942865+0000", 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8157000000000002e-05 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161946 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 948224~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.094667791999999, 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054041921999999999, 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161946 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890912+0000", 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018701760000000001 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890917+0000", 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890928+0000", 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896999999999999e-05 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890935+0000", 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7149999999999998e-06 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942905+0000", 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051969594000000001 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942980+0000", 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4464999999999999e-05 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943084+0000", 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104558 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161955 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1095680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.092566898000001, 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053898585999999998, 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161955 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891145+0000", 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891151+0000", 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891156+0000", 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944860+0000", 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053704094000000001 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944943+0000", 2024-09-11T06:20:25.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3394999999999997e-05 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945042+0000", 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000005e-05 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161956 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1112064~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.092547665000001, 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054087369000000003, 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161956 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:25.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892929+0000", 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001766349 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892933+0000", 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892944+0000", 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0479000000000001e-05 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892950+0000", 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.708e-06 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945075+0000", 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052124987999999997 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945154+0000", 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8792e-05 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945250+0000", 2024-09-11T06:20:25.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5638999999999997e-05 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161965 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1259520~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.090656446000001, 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053970817999999997, 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161965 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894904+0000", 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018509830000000001 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894909+0000", 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.087e-06 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894916+0000", 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894922+0000", 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.767e-06 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946853+0000", 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931484999999999 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946931+0000", 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7737000000000005e-05 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947024+0000", 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3546000000000002e-05 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161974 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1406976~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.088599937000001, 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053855649999999998, 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161974 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.032 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895113+0000", 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895119+0000", 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895124+0000", 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948788+0000", 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053664195999999997 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948866+0000", 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7417999999999996e-05 2024-09-11T06:20:25.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948966+0000", 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9907000000000004e-05 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161975 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1423360~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.088578881, 2024-09-11T06:20:25.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054030427999999998, 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161975 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:25.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896902+0000", 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017710829999999999 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896910+0000", 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896919+0000", 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7310000000000005e-06 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896926+0000", 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948997+0000", 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052071477999999997 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949068+0000", 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-05 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949162+0000", 2024-09-11T06:20:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3071000000000004e-05 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161984 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1570816~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.086682975999999, 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053945050000000001, 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.041 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161984 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:25.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898905+0000", 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001878036 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898910+0000", 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898922+0000", 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-05 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898928+0000", 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950784+0000", 2024-09-11T06:20:25.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051855483000000001 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950853+0000", 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9239000000000006e-05 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950972+0000", 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118876 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161994 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1734656~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.084549030000002, 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053886363999999999, 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161994 2024-09-11T06:20:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899163+0000", 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899170+0000", 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.866e-06 2024-09-11T06:20:25.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899175+0000", 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952814+0000", 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053638689000000003 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952892+0000", 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7890000000000001e-05 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953047+0000", 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015576300000000001 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161995 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1751040~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.084529207999999, 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054070368000000001, 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161995 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900905+0000", 2024-09-11T06:20:25.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017245850000000001 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900910+0000", 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900923+0000", 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2619999999999999e-05 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900930+0000", 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4059999999999999e-06 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953077+0000", 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052147129 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953152+0000", 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5265999999999994e-05 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953251+0000", 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8666999999999996e-05 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162003 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1882112~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.082510163999999, 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054417001, 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162003 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901202+0000", 2024-09-11T06:20:25.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901209+0000", 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901214+0000", 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955009+0000", 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053795526000000003 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955110+0000", 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010130500000000001 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955617+0000", 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050644199999999996 2024-09-11T06:20:25.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162004 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.082490177, 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054432803000000002, 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162004 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:25.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901222+0000", 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901227+0000", 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7099999999999998e-06 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901231+0000", 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.357e-06 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955645+0000", 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054413571000000001 2024-09-11T06:20:25.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955653+0000", 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162005 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.082473466, 2024-09-11T06:20:25.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054450025999999999, 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162005 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901291+0000", 2024-09-11T06:20:25.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4326000000000001e-05 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901294+0000", 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3459999999999998e-06 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901302+0000", 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0239999999999997e-06 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901308+0000", 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955677+0000", 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054368593999999999 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955687+0000", 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8500000000000006e-06 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162006 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.082392654, 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054418451, 2024-09-11T06:20:25.069 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162006 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902903+0000", 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015855590000000001 2024-09-11T06:20:25.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902908+0000", 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902922+0000", 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3949e-05 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902929+0000", 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3150000000000003e-06 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955725+0000", 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052795684000000002 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955736+0000", 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183479 3.15 3:ac303efb:::rbd_data.116d42e0aa2c.0000000000000010:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.690052832999999, 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83363719300000005, 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183479 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293658+0000", 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293663+0000", 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293676+0000", 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2734999999999999e-05 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293683+0000", 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6559999999999992e-06 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293746+0000", 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2748000000000003e-05 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293759+0000", 2024-09-11T06:20:25.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2767e-05 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.126963+0000", 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83320435800000003 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127119+0000", 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015564999999999999 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127294+0000", 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017540899999999999 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183484 3.15 3:a84be19c:::rbd_data.116d42e0aa2c.0000000000000015:head [sparse-read 0~4259840] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.689598406999998, 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83354649000000003, 2024-09-11T06:20:25.080 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183484 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8700000000000005e-07 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:25.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294116+0000", 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294126+0000", 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6339999999999996e-06 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294131+0000", 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3990000000000003e-06 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294186+0000", 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5438e-05 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294196+0000", 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9769999999999995e-06 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127600+0000", 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83340399499999995 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:25.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127658+0000", 2024-09-11T06:20:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7710000000000001e-05 2024-09-11T06:20:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:25.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:25.085 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:25.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:25.087 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:25.085+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:25.187 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:25.186+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:25.233 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:25.233 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:25.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:25.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:25.327 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:25.326+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:25.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:25.389+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:25.390 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:25.390 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:25.390 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:25.390 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:25.390 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:25.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:25.405 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:25.406 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:25.422 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:25.423 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:25.439 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:25.439 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:25.456 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:25.457 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:25.473 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:25.473 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:25.490 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:25.490 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:25.491 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:25.489+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:25.507 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:25.507 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:25.511 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:25.512 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:25.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:25.524 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:25.524 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:25.591 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:25.590+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:25.629 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:25.629 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:25.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:25.722 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:25.721+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:25.780 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:25.780 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:25.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:25.830 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:25.829+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:25.893 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:25.892+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:25.933 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:25.933 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:25.942 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:26.026 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:26.025+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:26.085 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:26.085 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:26.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:26.135 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:26.134+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:26.195 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:26.194+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:26.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:20:26.246 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:26.246 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:26.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:26.296 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:26.294+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:26.397 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:26.396+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:26.398 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:26.398 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:26.407 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:26.498 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:26.497+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:26.510 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:26.510 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:26.519 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:26.598 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:26.598+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:26.621 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:26.621 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:26.630 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:26.715 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:26.714+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:26.774 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:26.774 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:26.783 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:26.824 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:26.823+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:26.901 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:26.901+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:26.926 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:26.927 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:26.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:27.020 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:27.019+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:27.080 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:27.080 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:27.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:27.104 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:27.103+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:27.190 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7, 3] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:27.190 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:27.190 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T06:20:27.190 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.192533 2024-09-11T06:20:27.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0.19253293104181868 2024-09-11T06:20:27.196 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:20:27.205 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:27.204+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:27.240 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:27.240 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:27.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:27.305 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:27.304+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:27.364 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:27.364 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:27.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:27.414 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:27.413+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:27.507 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:27.506+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:27.517 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:27.517 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:27.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:27.536 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:27.610 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:27.609+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:27.674 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:27.674 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:27.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:27.689 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:27.689 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:27.706 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:27.709 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:27.708+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:27.723 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:27.723 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:27.740 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:27.740 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:27.757 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:27.774 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:27.774 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:27.791 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:27.795 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:27.795 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:27.795 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:27.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:27.808 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:27.809 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:27.810 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:27.809+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:27.911 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:27.910+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:27.911 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:27.911 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:27.911 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:27.911 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:27.911 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:27.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:28.012 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:28.011+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 87.942432616999994, 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:20:28.065 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:20:28.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.070 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.946187754999997, 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:20:28.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:20:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.946136844000002, 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:20:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:20:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945949540000001, 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:20:28.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:20:28.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945912579999998, 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:20:28.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945887722999998, 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:20:28.095 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:28.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:20:28.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945847759000003, 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:28.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945817382999998, 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.108 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:28.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:20:28.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945796616999999, 2024-09-11T06:20:28.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:20:28.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945763745999997, 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:20:28.119 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:20:28.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:20:28.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945743888000003, 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:20:28.125 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:20:28.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:20:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945723710999999, 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:20:28.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:20:28.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:20:28.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945712346000001, 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:28.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:20:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:20:28.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945684909000001, 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:20:28.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:20:28.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:28.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945650653000001, 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:20:28.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945637189999999, 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:28.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:20:28.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945605461, 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945593303000003, 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:28.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945568453999996, 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:20:28.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:20:28.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.945555225, 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:20:28.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:28.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:20:28.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.179 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.179 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:28.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:28.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:28.179+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:28.202 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.7 primary-affinity to 0.192533 (8126172) 2024-09-11T06:20:28.280 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:28.279+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:28.297 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:232943 3.c 3:362f1067:::rbd_object_map.116df114867d:head [call lock.unlock in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e219)", 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:28.296231+0000", 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0011302689999999999, 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011476660000000001, 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 232943 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296231+0000", 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296231+0000", 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296231+0000", 2024-09-11T06:20:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5099999999999999e-07 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296236+0000", 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296244+0000", 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2640000000000008e-06 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296249+0000", 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.707e-06 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296291+0000", 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1952000000000001e-05 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296381+0000", 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0006999999999994e-05 2024-09-11T06:20:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.296571+0000", 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018986299999999999 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.297054+0000", 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048361900000000002 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop_reply(client.4461.0:232943 3.c e219/24)", 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:28.297384+0000", 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4294967295.9999771, 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5328000000000003e-05, 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.297384+0000", 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.297384+0000", 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.297384+0000", 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.75e-07 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.297387+0000", 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.297398+0000", 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0589e-05 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.297403+0000", 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7419999999999997e-06 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:28.297438+0000", 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5006000000000003e-05 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 2 2024-09-11T06:20:28.306 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:28.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:28.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:28.380+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:28.450 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:28.451 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:28.451 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:28.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:28.503 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:28.502+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:28.563 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:28.563 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:28.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:28.563 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:28.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:20:28.563 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:28.563 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 188.75811662199999, 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:28.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:28.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.387683324999998, 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:20:28.569 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:20:28.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.385279943999997, 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:20:28.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153432 3.f 3:f42e81df:::rbd_data.116ddf3f5156.000000000000000f:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.230759802000001, 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79802703600000002, 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153432 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330773+0000", 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.278e-06 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330953+0000", 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017961999999999999 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330983+0000", 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0188e-05 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330994+0000", 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331072+0000", 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8141999999999998e-05 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331081+0000", 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2890000000000003e-06 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125207+0000", 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79412554300000004 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125321+0000", 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011482299999999999 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125455+0000", 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013386800000000001 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128673+0000", 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032178269999999999 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128700+0000", 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128754+0000", 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4716999999999998e-05 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128798+0000", 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3448000000000001e-05 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.585 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161945 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 931840~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.67250799, 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053842806999999999, 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161945 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889025+0000", 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9570000000000001e-06 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889030+0000", 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5820000000000001e-06 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889035+0000", 2024-09-11T06:20:28.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5889999999999996e-06 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942690+0000", 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053655228999999999 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942767+0000", 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-05 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942865+0000", 2024-09-11T06:20:28.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8157000000000002e-05 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161946 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 948224~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.67248841, 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054041921999999999, 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.590 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161946 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:28.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890912+0000", 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018701760000000001 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890917+0000", 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890928+0000", 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896999999999999e-05 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890935+0000", 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7149999999999998e-06 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942905+0000", 2024-09-11T06:20:28.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051969594000000001 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942980+0000", 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4464999999999999e-05 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943084+0000", 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104558 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161955 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1095680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.670387516000002, 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053898585999999998, 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161955 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891145+0000", 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891151+0000", 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891156+0000", 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944860+0000", 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053704094000000001 2024-09-11T06:20:28.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944943+0000", 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3394999999999997e-05 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945042+0000", 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000005e-05 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161956 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1112064~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.670368282999998, 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054087369000000003, 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161956 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892929+0000", 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001766349 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892933+0000", 2024-09-11T06:20:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T06:20:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892944+0000", 2024-09-11T06:20:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0479000000000001e-05 2024-09-11T06:20:28.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892950+0000", 2024-09-11T06:20:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.708e-06 2024-09-11T06:20:28.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945075+0000", 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052124987999999997 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945154+0000", 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8792e-05 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945250+0000", 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5638999999999997e-05 2024-09-11T06:20:28.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161965 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1259520~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.668477064000001, 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053970817999999997, 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161965 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894904+0000", 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018509830000000001 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894909+0000", 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.087e-06 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894916+0000", 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894922+0000", 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.767e-06 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946853+0000", 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931484999999999 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946931+0000", 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7737000000000005e-05 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947024+0000", 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3546000000000002e-05 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.609 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161974 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1406976~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.666420554999998, 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053855649999999998, 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161974 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895113+0000", 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895119+0000", 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895124+0000", 2024-09-11T06:20:28.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948788+0000", 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053664195999999997 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948866+0000", 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7417999999999996e-05 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948966+0000", 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9907000000000004e-05 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161975 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1423360~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.666399499000001, 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054030427999999998, 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161975 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896902+0000", 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017710829999999999 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896910+0000", 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896919+0000", 2024-09-11T06:20:28.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7310000000000005e-06 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896926+0000", 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948997+0000", 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052071477999999997 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949068+0000", 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-05 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949162+0000", 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3071000000000004e-05 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161984 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1570816~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.664503593999999, 2024-09-11T06:20:28.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053945050000000001, 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161984 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898905+0000", 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001878036 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898910+0000", 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898922+0000", 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-05 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898928+0000", 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950784+0000", 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051855483000000001 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950853+0000", 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9239000000000006e-05 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950972+0000", 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118876 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161994 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1734656~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.662369647999999, 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053886363999999999, 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161994 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899163+0000", 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899170+0000", 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.866e-06 2024-09-11T06:20:28.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899175+0000", 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952814+0000", 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053638689000000003 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952892+0000", 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7890000000000001e-05 2024-09-11T06:20:28.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953047+0000", 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015576300000000001 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161995 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1751040~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.662349826, 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054070368000000001, 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161995 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900905+0000", 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017245850000000001 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900910+0000", 2024-09-11T06:20:28.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900923+0000", 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2619999999999999e-05 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900930+0000", 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4059999999999999e-06 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953077+0000", 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052147129 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953152+0000", 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5265999999999994e-05 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953251+0000", 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8666999999999996e-05 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162003 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1882112~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.660330781999999, 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054417001, 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162003 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901202+0000", 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901209+0000", 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901214+0000", 2024-09-11T06:20:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955009+0000", 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053795526000000003 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955110+0000", 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010130500000000001 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955617+0000", 2024-09-11T06:20:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050644199999999996 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162004 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.660310795000001, 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054432803000000002, 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162004 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901222+0000", 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901227+0000", 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7099999999999998e-06 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901231+0000", 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.357e-06 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955645+0000", 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054413571000000001 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955653+0000", 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T06:20:28.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162005 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.660294084, 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054450025999999999, 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162005 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:28.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901291+0000", 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4326000000000001e-05 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901294+0000", 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3459999999999998e-06 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901302+0000", 2024-09-11T06:20:28.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0239999999999997e-06 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901308+0000", 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955677+0000", 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054368593999999999 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955687+0000", 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8500000000000006e-06 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162006 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.660213272, 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054418451, 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162006 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902903+0000", 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015855590000000001 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902908+0000", 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902922+0000", 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3949e-05 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902929+0000", 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3150000000000003e-06 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955725+0000", 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052795684000000002 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955736+0000", 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183479 3.15 3:ac303efb:::rbd_data.116d42e0aa2c.0000000000000010:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.267873451, 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83363719300000005, 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183479 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293658+0000", 2024-09-11T06:20:28.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293663+0000", 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293676+0000", 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2734999999999999e-05 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293683+0000", 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6559999999999992e-06 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293746+0000", 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2748000000000003e-05 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293759+0000", 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2767e-05 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.126963+0000", 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83320435800000003 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127119+0000", 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015564999999999999 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127294+0000", 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017540899999999999 2024-09-11T06:20:28.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183484 3.15 3:a84be19c:::rbd_data.116d42e0aa2c.0000000000000015:head [sparse-read 0~4259840] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.267419024999999, 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83354649000000003, 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:28.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183484 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8700000000000005e-07 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294116+0000", 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294126+0000", 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6339999999999996e-06 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294131+0000", 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3990000000000003e-06 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294186+0000", 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5438e-05 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294196+0000", 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9769999999999995e-06 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127600+0000", 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83340399499999995 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127658+0000", 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7710000000000001e-05 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:28.658 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:28.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:28.660 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:28.659+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:28.761 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:28.760+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:28.805 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:28.805 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:28.805 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:28.805 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:28.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:28.898 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:28.897+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:28.957 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:28.957 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:28.963 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:28.962+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:28.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:29.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:29.063+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:29.110 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.990264073999995, 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:29.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:20:29.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.990171372000006, 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:20:29.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.121 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.989965561999995, 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:20:29.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.989879994999995, 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:20:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.989666736999993, 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:20:29.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.989583417999995, 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:20:29.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.989326535000004, 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:20:29.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:20:29.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.989265095999997, 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:20:29.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.989019271000004, 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:29.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:29.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.988951143999998, 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:20:29.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.988683481999999, 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:20:29.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:20:29.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.988611442000007, 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.988440682999993, 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:20:29.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 88.988335461999995, 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:20:29.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:20:29.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:20:29.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:20:29.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230165 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.989913847, 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0055556050000001, 2024-09-11T06:20:29.181 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230165 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118908+0000", 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118915+0000", 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0509999999999999e-06 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118929+0000", 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.383e-05 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118940+0000", 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1368e-05 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129437+0000", 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010497272 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129446+0000", 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4980000000000006e-06 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124450+0000", 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99500413499999996 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124462+0000", 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1751e-05 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230166 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.986666762999999, 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0023415419999999, 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230166 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.186 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122155+0000", 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122166+0000", 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0689e-05 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122180+0000", 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3879e-05 2024-09-11T06:20:29.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122190+0000", 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0671e-05 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129472+0000", 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072814869999999997 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129477+0000", 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124488+0000", 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99501055000000005 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124495+0000", 2024-09-11T06:20:29.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230931 3.d 3:b6cf8884:::rbd_data.116dc6ff1838.0000000000000049:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.971457921000001, 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99172812200000005, 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:29.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230931 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:29.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137363+0000", 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4109999999999999e-06 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137369+0000", 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137381+0000", 2024-09-11T06:20:29.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1838000000000001e-05 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137389+0000", 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9009999999999994e-06 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137452+0000", 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3472999999999994e-05 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137463+0000", 2024-09-11T06:20:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0567000000000001e-05 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127016+0000", 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98955333400000001 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127186+0000", 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000169715 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127325+0000", 2024-09-11T06:20:29.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013924599999999999 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.128993+0000", 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016684689999999999 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129006+0000", 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:29.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129049+0000", 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2178000000000002e-05 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129090+0000", 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1375000000000003e-05 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230941 3.1d 3:bf50afcf:::rbd_data.116dc6ff1838.0000000000000053:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:29.197 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.967986243, 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99810618600000001, 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230941 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140835+0000", 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3960000000000001e-06 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140839+0000", 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.279e-06 2024-09-11T06:20:29.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140850+0000", 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0539e-05 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140857+0000", 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0060000000000003e-06 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140919+0000", 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2638999999999994e-05 2024-09-11T06:20:29.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140929+0000", 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.927e-06 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130401+0000", 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98947149300000004 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130508+0000", 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106908 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130605+0000", 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7103999999999997e-05 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134020+0000", 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003415052 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:29.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138839+0000", 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048191529999999996 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138891+0000", 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1780000000000002e-05 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138940+0000", 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8909999999999998e-05 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230966 3.1d 3:ba8846fd:::rbd_data.116dc6ff1838.000000000000006c:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.955031033000001, 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98529302399999996, 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230966 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153790+0000", 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4190000000000001e-06 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153796+0000", 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153808+0000", 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1892000000000001e-05 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153813+0000", 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9279999999999998e-06 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153865+0000", 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1841000000000001e-05 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153872+0000", 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131149+0000", 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97727708300000005 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131259+0000", 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010973500000000001 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131337+0000", 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8547999999999994e-05 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134185+0000", 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028480189999999998 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138986+0000", 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048007989999999997 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139037+0000", 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0321999999999997e-05 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139082+0000", 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5204000000000003e-05 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230995 3.1d 3:beb2267b:::rbd_data.116dc6ff1838.0000000000000143:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.943275855, 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97366138199999996, 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:29.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230995 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165545+0000", 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.64e-07 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165550+0000", 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165563+0000", 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2498e-05 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165570+0000", 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165628+0000", 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7707999999999997e-05 2024-09-11T06:20:29.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165639+0000", 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1015e-05 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131877+0000", 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.96623801099999995 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131984+0000", 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010730600000000001 2024-09-11T06:20:29.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.132078+0000", 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4215000000000005e-05 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.136247+0000", 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041684519999999996 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139124+0000", 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028775459999999999 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139170+0000", 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5763999999999998e-05 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139205+0000", 2024-09-11T06:20:29.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5281999999999999e-05 2024-09-11T06:20:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:29.217 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:29.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:20:29.219 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:29.219 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:29.217+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:29.319 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:29.318+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:29.339 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:29.340 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:29.340 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:29.349 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:29.421 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:29.420+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:29.493 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:29.493 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:29.493 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:29.493 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:29.493 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:29.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:29.546 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:29.545+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:29.607 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:29.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.118985123000002, 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.608 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.609 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:20:29.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:20:29.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.207459182000001, 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72623960399999998, 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.616 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:29.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397783+0000", 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.147e-06 2024-09-11T06:20:29.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398274+0000", 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049154799999999996 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398283+0000", 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1179999999999998e-06 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398288+0000", 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398330+0000", 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1692e-05 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398336+0000", 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4689999999999996e-06 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124013+0000", 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72567764599999995 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124021+0000", 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.064383776, 2024-09-11T06:20:29.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58344928699999998, 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:29.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:29.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540858+0000", 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541443+0000", 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058485600000000003 2024-09-11T06:20:29.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541451+0000", 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0639999999999994e-06 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541456+0000", 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541523+0000", 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7529999999999999e-05 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541534+0000", 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124290+0000", 2024-09-11T06:20:29.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58275560900000001 2024-09-11T06:20:29.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124306+0000", 2024-09-11T06:20:29.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6065e-05 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3:dd3750b5:::rbd_data.116ddf3f5156.0000000000000013:head [write 0~409600 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 34.058122429999997, 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58172919000000001, 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.629 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547119+0000", 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547621+0000", 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000501645 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547629+0000", 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6589999999999996e-06 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547634+0000", 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.848e-06 2024-09-11T06:20:29.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547686+0000", 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.147e-05 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547695+0000", 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124336+0000", 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.57664082699999997 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124428+0000", 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2153999999999999e-05 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124519+0000", 2024-09-11T06:20:29.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0313000000000001e-05 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.125614+0000", 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001095794 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128786+0000", 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031712770000000001 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128821+0000", 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5602000000000002e-05 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128847+0000", 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6109999999999999e-05 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227124 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 397312~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.131665661, 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046188726999999999, 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227124 2024-09-11T06:20:29.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5899999999999998e-07 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473576+0000", 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0109999999999999e-06 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473579+0000", 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9390000000000002e-06 2024-09-11T06:20:29.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473584+0000", 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.921e-06 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519653+0000", 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046069327 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519698+0000", 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4518000000000003e-05 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519764+0000", 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5752000000000003e-05 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227125 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 399360~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.131653516, 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046294848, 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227125 2024-09-11T06:20:29.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473591+0000", 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.54e-06 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473594+0000", 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999999e-06 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473597+0000", 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7530000000000002e-06 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519790+0000", 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046192892999999999 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519828+0000", 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8266000000000003e-05 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519882+0000", 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3816000000000001e-05 2024-09-11T06:20:29.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227126 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 401408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.131640596, 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046400064999999997, 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227126 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473602+0000", 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3549999999999999e-06 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473607+0000", 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2050000000000001e-06 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473610+0000", 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0479999999999999e-06 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519904+0000", 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046293809999999998 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519944+0000", 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0621999999999998e-05 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520000+0000", 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5656999999999999e-05 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.652 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227127 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 403456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.13162677, 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046519645999999998, 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227127 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473616+0000", 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473626+0000", 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5899999999999997e-06 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473631+0000", 2024-09-11T06:20:29.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8640000000000001e-06 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520035+0000", 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046403941999999997 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520077+0000", 2024-09-11T06:20:29.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1282999999999998e-05 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520133+0000", 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6747999999999999e-05 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227128 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 405504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.131602966999999, 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046616360000000003, 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.659 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227128 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473640+0000", 2024-09-11T06:20:29.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9120000000000001e-06 2024-09-11T06:20:29.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473649+0000", 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473655+0000", 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520159+0000", 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046503925000000002 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520202+0000", 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-05 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520254+0000", 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2194999999999997e-05 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227129 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 407552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.131579370000001, 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046708761000000001, 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227129 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:29.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473662+0000", 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-11T06:20:29.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473664+0000", 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473671+0000", 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0759999999999997e-06 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473676+0000", 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520281+0000", 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046605466999999998 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520320+0000", 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8875999999999998e-05 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520370+0000", 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9972000000000002e-05 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227130 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 409600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.131555580000001, 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046828026000000002, 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227130 2024-09-11T06:20:29.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474753+0000", 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001068334 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474757+0000", 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.737e-06 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474763+0000", 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474768+0000", 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520401+0000", 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045632645999999999 2024-09-11T06:20:29.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520454+0000", 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3227999999999999e-05 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520513+0000", 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9144999999999997e-05 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227134 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 417792~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.130432633000002, 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046187445000000001, 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.676 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227134 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474809+0000", 2024-09-11T06:20:29.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474812+0000", 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.039e-06 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474815+0000", 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:20:29.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520893+0000", 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046078467999999997 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520936+0000", 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2809999999999998e-05 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520995+0000", 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9224000000000001e-05 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227135 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 419840~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.130422884000001, 2024-09-11T06:20:29.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046298338000000001, 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227135 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476753+0000", 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001935057 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476757+0000", 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2610000000000004e-06 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476768+0000", 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476775+0000", 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521030+0000", 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044254449000000001 2024-09-11T06:20:29.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521067+0000", 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7261000000000001e-05 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521116+0000", 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8934999999999998e-05 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227146 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 442368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.128238938999999, 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046216054999999999, 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227146 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7399999999999999e-07 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477003+0000", 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1769999999999999e-06 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477006+0000", 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477009+0000", 2024-09-11T06:20:29.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6410000000000002e-06 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523047+0000", 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046037814000000003 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523137+0000", 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0424e-05 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523218+0000", 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0654000000000004e-05 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227147 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 444416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:29.692 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.128229041000001, 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046410320999999997, 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227147 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478755+0000", 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001743426 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478759+0000", 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2200000000000003e-06 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478768+0000", 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:20:29.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478775+0000", 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6699999999999997e-06 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523251+0000", 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044475796999999997 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523328+0000", 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6787999999999997e-05 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523422+0000", 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4241999999999997e-05 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227192 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 273408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.119484637999999, 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046102219999999999, 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.698 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227192 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485809+0000", 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3118000000000002e-05 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485812+0000", 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485831+0000", 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485837+0000", 2024-09-11T06:20:29.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9789999999999998e-06 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531732+0000", 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045895683999999999 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531781+0000", 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8853999999999997e-05 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531858+0000", 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6889000000000002e-05 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227193 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 275456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.119393559999999, 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046243092999999999, 2024-09-11T06:20:29.703 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227193 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:29.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486066+0000", 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021887 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486070+0000", 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6490000000000001e-06 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486076+0000", 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6789999999999999e-06 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486081+0000", 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531897+0000", 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045816669999999997 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531981+0000", 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3554999999999995e-05 2024-09-11T06:20:29.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532090+0000", 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109084 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227194 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 277504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:29.708 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.119145603, 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046160642000000002, 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227194 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.709 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486297+0000", 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000202337 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486300+0000", 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9670000000000001e-06 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486308+0000", 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5089999999999996e-06 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486313+0000", 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532129+0000", 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045815225000000001 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532199+0000", 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0402999999999997e-05 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532256+0000", 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6641000000000002e-05 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227195 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 279552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.118917970999998, 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046088184999999997, 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.714 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227195 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486470+0000", 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147754 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486474+0000", 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2770000000000001e-06 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486484+0000", 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8819999999999996e-06 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486488+0000", 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532287+0000", 2024-09-11T06:20:29.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045798959 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532345+0000", 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7584999999999998e-05 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532411+0000", 2024-09-11T06:20:29.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5782000000000001e-05 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227196 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 281600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.118738659000002, 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046093975000000002, 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:29.719 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227196 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:29.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487755+0000", 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012529959999999999 2024-09-11T06:20:29.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487759+0000", 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9570000000000004e-06 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487765+0000", 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5910000000000001e-06 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487770+0000", 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2409999999999997e-06 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532448+0000", 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044678540000000003 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:29.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532527+0000", 2024-09-11T06:20:29.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8465000000000002e-05 2024-09-11T06:20:29.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:29.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:29.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:29.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532596+0000", 2024-09-11T06:20:29.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9184999999999996e-05 2024-09-11T06:20:29.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.725 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.725 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:29.725 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:29.725 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:29.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:29.727 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:29.725+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:29.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:29.864 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:29.863+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:29.870 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:29.870 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:29.870 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:29.870 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:29.880 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:29.928 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:29.927+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:29.941 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:29.941 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:29.958 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:29.958 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:29.973 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:29.974 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:29.981 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:29.982 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:29.982 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:29.982 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:29.982 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:29.989 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:29.989 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:29.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:30.005 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:30.006 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:30.022 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:30.022 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:30.035 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:30.034+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:30.038 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:30.039 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:30.055 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:30.055 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:30.095 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:30.095 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:30.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:30.126 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:20:30.146 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:30.145+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:30.230 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:30.230+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:30.258 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:30.258 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:30.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:30.352 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:30.351+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:30.411 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:30.411 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:30.420 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:30.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:30.460+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:30.533 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:30.532+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:30.563 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:30.563 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:30.572 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:30.634 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:30.633+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:30.675 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:30.675 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:30.683 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:30.734 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:30.734+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:30.785 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:30.785 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:30.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:30.835 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:30.834+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:30.936 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:30.935+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:30.937 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:30.937 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:30.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:31.037 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:31.036+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:31.052 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:31.052 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:31.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:31.138 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:31.137+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:31.164 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:31.165 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:31.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:31.239 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:31.238+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:31.290 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:31.290 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:31.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:31.340 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:31.339+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:31.441 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:31.440+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:31.441 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:31.441 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:31.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:31.542 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:31.541+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:31.594 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:31.594 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:31.602 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:31.646 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:31.645+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:31.705 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:31.705 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:31.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:31.755 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:31.754+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:31.845 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:31.844+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:31.857 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:31.857 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:31.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:31.952 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:31.951+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:32.011 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:32.011 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:32.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:32.046 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:32.045+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:32.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:32.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:20:32.148 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:32.147+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:32.167 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:32.167 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:32.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:32.235 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:32.235 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:32.249 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:32.248+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:32.255 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:32.280 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:32.280 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:32.297 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:32.297 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:32.317 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:32.317 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:32.336 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:32.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4461.0:233564 3.16 e223/205)", 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:32.336002+0000", 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.2845999999999999e-05, 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5908000000000004e-05, 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:32.336002+0000", 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:32.336002+0000", 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:32.336002+0000", 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6700000000000003e-07 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:32.336008+0000", 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6339999999999998e-06 2024-09-11T06:20:32.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:32.336020+0000", 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1562e-05 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:32.336026+0000", 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8140000000000003e-06 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:32.336081+0000", 2024-09-11T06:20:32.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4960000000000002e-05 2024-09-11T06:20:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:32.340 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 1 2024-09-11T06:20:32.340 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:32.340 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:32.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:32.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:32.348+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:32.368 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:32.402 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:32.450 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:32.449+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:32.474 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:32.474 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:32.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:32.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:32.550+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:32.587 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:32.587 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.466714937999996, 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:32.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:20:32.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:20:32.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.466622236000006, 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:20:32.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.466416425999995, 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:32.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:20:32.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:20:32.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.603 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.466330858999996, 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:32.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.466117600999993, 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:20:32.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.466034281999995, 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.465777399000004, 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:20:32.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:20:32.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.465715959999997, 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:20:32.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:20:32.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.465470135000004, 2024-09-11T06:20:32.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:32.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:20:32.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:20:32.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.465402007999998, 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.635 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.465134345999999, 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:20:32.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:20:32.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.465062305999993, 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:20:32.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.464891546999993, 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:20:32.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:20:32.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:20:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 92.464786325999995, 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:20:32.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:20:32.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230165 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.466364711000001, 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0055556050000001, 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230165 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118908+0000", 2024-09-11T06:20:32.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118915+0000", 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0509999999999999e-06 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118929+0000", 2024-09-11T06:20:32.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.383e-05 2024-09-11T06:20:32.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118940+0000", 2024-09-11T06:20:32.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1368e-05 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129437+0000", 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010497272 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129446+0000", 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4980000000000006e-06 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124450+0000", 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99500413499999996 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124462+0000", 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1751e-05 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.665 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230166 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.463117626999999, 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0023415419999999, 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230166 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122155+0000", 2024-09-11T06:20:32.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122166+0000", 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0689e-05 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122180+0000", 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3879e-05 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122190+0000", 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0671e-05 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129472+0000", 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072814869999999997 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129477+0000", 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124488+0000", 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99501055000000005 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124495+0000", 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230931 3.d 3:b6cf8884:::rbd_data.116dc6ff1838.0000000000000049:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.447908784999999, 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99172812200000005, 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230931 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137363+0000", 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4109999999999999e-06 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137369+0000", 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137381+0000", 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1838000000000001e-05 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137389+0000", 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9009999999999994e-06 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137452+0000", 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3472999999999994e-05 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137463+0000", 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0567000000000001e-05 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127016+0000", 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98955333400000001 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127186+0000", 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000169715 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127325+0000", 2024-09-11T06:20:32.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013924599999999999 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.128993+0000", 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016684689999999999 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129006+0000", 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:32.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129049+0000", 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2178000000000002e-05 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129090+0000", 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1375000000000003e-05 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230941 3.1d 3:bf50afcf:::rbd_data.116dc6ff1838.0000000000000053:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:32.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.444437106999999, 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99810618600000001, 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230941 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:32.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140835+0000", 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3960000000000001e-06 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140839+0000", 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.279e-06 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140850+0000", 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0539e-05 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140857+0000", 2024-09-11T06:20:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0060000000000003e-06 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140919+0000", 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2638999999999994e-05 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140929+0000", 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.927e-06 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130401+0000", 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98947149300000004 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130508+0000", 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106908 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130605+0000", 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7103999999999997e-05 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134020+0000", 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003415052 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138839+0000", 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048191529999999996 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138891+0000", 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1780000000000002e-05 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138940+0000", 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8909999999999998e-05 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230966 3.1d 3:ba8846fd:::rbd_data.116dc6ff1838.000000000000006c:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.431481897000001, 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98529302399999996, 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230966 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153790+0000", 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4190000000000001e-06 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153796+0000", 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:20:32.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153808+0000", 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1892000000000001e-05 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153813+0000", 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9279999999999998e-06 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153865+0000", 2024-09-11T06:20:32.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1841000000000001e-05 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153872+0000", 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131149+0000", 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97727708300000005 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131259+0000", 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010973500000000001 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131337+0000", 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8547999999999994e-05 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134185+0000", 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028480189999999998 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138986+0000", 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048007989999999997 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139037+0000", 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0321999999999997e-05 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139082+0000", 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5204000000000003e-05 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230995 3.1d 3:beb2267b:::rbd_data.116dc6ff1838.0000000000000143:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.419726719, 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97366138199999996, 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230995 2024-09-11T06:20:32.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:32.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165545+0000", 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.64e-07 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165550+0000", 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165563+0000", 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2498e-05 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165570+0000", 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165628+0000", 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7707999999999997e-05 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165639+0000", 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1015e-05 2024-09-11T06:20:32.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131877+0000", 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.96623801099999995 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131984+0000", 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010730600000000001 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.132078+0000", 2024-09-11T06:20:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4215000000000005e-05 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.136247+0000", 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041684519999999996 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139124+0000", 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028775459999999999 2024-09-11T06:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139170+0000", 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5763999999999998e-05 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139205+0000", 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5281999999999999e-05 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:32.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:32.698 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:32.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:32.699 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:32.698+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:32.800 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:32.799+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:32.809 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:32.809 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:32.809 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:32.818 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:32.901 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:32.900+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:32.961 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:32.962 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:32.962 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:32.962 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:32.962 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:32.970 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:33.002 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:33.001+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:33.075 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:33.075 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:33.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:33.075 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:33.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.075 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:20:33.075 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:33.075 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.586719043999999, 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.076 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:20:33.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:20:33.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:20:33.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.675193102999998, 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72623960399999998, 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.082 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397783+0000", 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.147e-06 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398274+0000", 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049154799999999996 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398283+0000", 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1179999999999998e-06 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398288+0000", 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398330+0000", 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1692e-05 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398336+0000", 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4689999999999996e-06 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124013+0000", 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72567764599999995 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124021+0000", 2024-09-11T06:20:33.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.532117696999997, 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58344928699999998, 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.087 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:33.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540858+0000", 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541443+0000", 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058485600000000003 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541451+0000", 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0639999999999994e-06 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541456+0000", 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541523+0000", 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7529999999999999e-05 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541534+0000", 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124290+0000", 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58275560900000001 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124306+0000", 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6065e-05 2024-09-11T06:20:33.091 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3:dd3750b5:::rbd_data.116ddf3f5156.0000000000000013:head [write 0~409600 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.525856351000002, 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58172919000000001, 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.092 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:33.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547119+0000", 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547621+0000", 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000501645 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547629+0000", 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6589999999999996e-06 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547634+0000", 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.848e-06 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547686+0000", 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.147e-05 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547695+0000", 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124336+0000", 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.57664082699999997 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124428+0000", 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2153999999999999e-05 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124519+0000", 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0313000000000001e-05 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.125614+0000", 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001095794 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128786+0000", 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031712770000000001 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128821+0000", 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5602000000000002e-05 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128847+0000", 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6109999999999999e-05 2024-09-11T06:20:33.098 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227124 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 397312~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.599399582, 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046188726999999999, 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.099 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227124 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.100 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5899999999999998e-07 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473576+0000", 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0109999999999999e-06 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473579+0000", 2024-09-11T06:20:33.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9390000000000002e-06 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473584+0000", 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.921e-06 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519653+0000", 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046069327 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519698+0000", 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4518000000000003e-05 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519764+0000", 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5752000000000003e-05 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227125 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 399360~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.103 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.599387437000001, 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046294848, 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227125 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473591+0000", 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.54e-06 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473594+0000", 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999999e-06 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.106 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473597+0000", 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7530000000000002e-06 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519790+0000", 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046192892999999999 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519828+0000", 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8266000000000003e-05 2024-09-11T06:20:33.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519882+0000", 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3816000000000001e-05 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227126 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 401408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.599374517000001, 2024-09-11T06:20:33.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046400064999999997, 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227126 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:33.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473602+0000", 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3549999999999999e-06 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473607+0000", 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2050000000000001e-06 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473610+0000", 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0479999999999999e-06 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519904+0000", 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046293809999999998 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519944+0000", 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0621999999999998e-05 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520000+0000", 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5656999999999999e-05 2024-09-11T06:20:33.112 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227127 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 403456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.599360691000001, 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046519645999999998, 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.113 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227127 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473616+0000", 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473626+0000", 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5899999999999997e-06 2024-09-11T06:20:33.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473631+0000", 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8640000000000001e-06 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520035+0000", 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046403941999999997 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520077+0000", 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1282999999999998e-05 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520133+0000", 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6747999999999999e-05 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.117 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227128 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 405504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.118 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:33.118 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.599336888, 2024-09-11T06:20:33.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046616360000000003, 2024-09-11T06:20:33.118 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.118 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.118 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227128 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473640+0000", 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9120000000000001e-06 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473649+0000", 2024-09-11T06:20:33.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473655+0000", 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520159+0000", 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046503925000000002 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520202+0000", 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-05 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520254+0000", 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2194999999999997e-05 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.123 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227129 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 407552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.599313291000001, 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046708761000000001, 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227129 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473662+0000", 2024-09-11T06:20:33.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473664+0000", 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473671+0000", 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0759999999999997e-06 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473676+0000", 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520281+0000", 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046605466999999998 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520320+0000", 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8875999999999998e-05 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520370+0000", 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9972000000000002e-05 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227130 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 409600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.599289501000001, 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046828026000000002, 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.128 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227130 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474753+0000", 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001068334 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474757+0000", 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.737e-06 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474763+0000", 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474768+0000", 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520401+0000", 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045632645999999999 2024-09-11T06:20:33.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520454+0000", 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3227999999999999e-05 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520513+0000", 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9144999999999997e-05 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227134 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 417792~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.598166553999999, 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046187445000000001, 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227134 2024-09-11T06:20:33.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474809+0000", 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474812+0000", 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.039e-06 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474815+0000", 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520893+0000", 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046078467999999997 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520936+0000", 2024-09-11T06:20:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2809999999999998e-05 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520995+0000", 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9224000000000001e-05 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227135 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 419840~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.598156804999999, 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046298338000000001, 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227135 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476753+0000", 2024-09-11T06:20:33.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001935057 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476757+0000", 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2610000000000004e-06 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476768+0000", 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476775+0000", 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521030+0000", 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044254449000000001 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521067+0000", 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7261000000000001e-05 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.141 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521116+0000", 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8934999999999998e-05 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227146 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 442368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.59597286, 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046216054999999999, 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227146 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7399999999999999e-07 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477003+0000", 2024-09-11T06:20:33.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1769999999999999e-06 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477006+0000", 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477009+0000", 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6410000000000002e-06 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523047+0000", 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046037814000000003 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523137+0000", 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0424e-05 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523218+0000", 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0654000000000004e-05 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227147 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 444416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.595962962000002, 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046410320999999997, 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227147 2024-09-11T06:20:33.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478755+0000", 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001743426 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478759+0000", 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2200000000000003e-06 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478768+0000", 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478775+0000", 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6699999999999997e-06 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523251+0000", 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044475796999999997 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523328+0000", 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6787999999999997e-05 2024-09-11T06:20:33.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523422+0000", 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4241999999999997e-05 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227192 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 273408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.587218559, 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046102219999999999, 2024-09-11T06:20:33.151 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227192 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485809+0000", 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3118000000000002e-05 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485812+0000", 2024-09-11T06:20:33.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485831+0000", 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485837+0000", 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9789999999999998e-06 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531732+0000", 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045895683999999999 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531781+0000", 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8853999999999997e-05 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531858+0000", 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6889000000000002e-05 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.155 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227193 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 275456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.587127481, 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046243092999999999, 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227193 2024-09-11T06:20:33.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486066+0000", 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021887 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486070+0000", 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6490000000000001e-06 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486076+0000", 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6789999999999999e-06 2024-09-11T06:20:33.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486081+0000", 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531897+0000", 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045816669999999997 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531981+0000", 2024-09-11T06:20:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3554999999999995e-05 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532090+0000", 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109084 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227194 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 277504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:33.160 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.586879524, 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046160642000000002, 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227194 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:33.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486297+0000", 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000202337 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486300+0000", 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9670000000000001e-06 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486308+0000", 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5089999999999996e-06 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486313+0000", 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532129+0000", 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045815225000000001 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532199+0000", 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0402999999999997e-05 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532256+0000", 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6641000000000002e-05 2024-09-11T06:20:33.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227195 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 279552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.586651891999999, 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046088184999999997, 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227195 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:33.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486470+0000", 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147754 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486474+0000", 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2770000000000001e-06 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486484+0000", 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8819999999999996e-06 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486488+0000", 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532287+0000", 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045798959 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532345+0000", 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7584999999999998e-05 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532411+0000", 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5782000000000001e-05 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.169 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227196 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 281600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 23.586472579999999, 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046093975000000002, 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227196 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487755+0000", 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012529959999999999 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487759+0000", 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9570000000000004e-06 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487765+0000", 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5910000000000001e-06 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487770+0000", 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2409999999999997e-06 2024-09-11T06:20:33.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532448+0000", 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044678540000000003 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532527+0000", 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8465000000000002e-05 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532596+0000", 2024-09-11T06:20:33.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9184999999999996e-05 2024-09-11T06:20:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.174 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.174 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:33.175 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:33.176 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:33.174+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:33.217 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7, 3] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:33.217 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:33.217 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T06:20:33.217 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.589161 2024-09-11T06:20:33.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 0.589161169717895 2024-09-11T06:20:33.222 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:20:33.282 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:33.281+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:33.283 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:33.283 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:33.283 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:33.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:33.377 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:33.376+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:33.397 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:33.397 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:33.397 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:33.397 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:33.397 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:33.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:33.477 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:33.477+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:33.509 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:33.509 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:33.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:33.509 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 134.16448954000001, 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:20:33.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.512 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.514 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.060565354000005, 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.515 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:20:33.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:20:33.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.060539004000006, 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.519 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:33.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.522 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.524 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.060518524000003, 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.525 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.526 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:20:33.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:20:33.528 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.060499809999996, 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.530 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.531 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:20:33.532 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.533 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051768976000005, 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.534 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.535 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.536 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.537 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.538 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051735391999998, 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.539 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.540 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.541 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:20:33.542 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.543 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051722562999998, 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.544 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.545 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:20:33.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:20:33.547 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051712425999995, 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.548 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.549 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.550 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.551 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051701608000002, 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.552 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:33.553 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:20:33.554 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.555 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:33.556 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051691727999994, 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.557 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.558 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.559 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:20:33.560 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051681997000003, 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.561 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.562 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:20:33.563 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:20:33.564 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051672378999996, 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:20:33.565 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.566 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:20:33.567 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.568 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.569 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051662565000001, 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.570 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.571 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:20:33.572 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:20:33.573 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051647197999998, 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.574 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.575 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:20:33.576 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:20:33.577 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.051636896000005, 2024-09-11T06:20:33.578 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:20:33.579 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.579 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.579 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.579 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:33.580 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.581 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.582 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.049936613, 2024-09-11T06:20:33.583 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.584 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.585 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.586 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:33.587 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.043791614, 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.588 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:20:33.589 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:20:33.590 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.591 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.043782117999996, 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.592 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.593 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 89.043772559000004, 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.596 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:20:33.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:20:33.599 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:20:33.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.600 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.600 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:33.600 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:33.600 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:33.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:33.602 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:33.600+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:33.702 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:33.701+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:33.746 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:33.746 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:33.746 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:33.746 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:33.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:33.839 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:33.838+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:33.896 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:33.897 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:33.897 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:33.904 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:33.903+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:33.905 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:34.005 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:34.004+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:34.050 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:34.050 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.930099513000002, 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.051 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:20:34.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.052 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:34.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:34.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.057 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.930041966999994, 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.058 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:20:34.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.063 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.930016457999997, 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.064 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:34.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929793290000006, 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.070 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:20:34.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:20:34.073 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.073 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.073 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.073 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:20:34.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929758624000002, 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.076 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.077 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.078 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:34.078 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:20:34.078 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.078 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.078 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:20:34.079 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.080 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:20:34.081 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929734461999999, 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:20:34.082 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:34.083 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.084 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.085 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:20:34.086 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.087 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929483911000005, 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.088 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.089 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:20:34.090 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:20:34.091 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.092 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929456529999996, 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.093 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.094 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:20:34.095 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:20:34.096 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:20:34.096 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.096 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.096 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.096 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.097 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.098 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.099 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.100 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:34.100 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929433391000003, 2024-09-11T06:20:34.100 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:20:34.100 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.100 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.100 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.100 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.101 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.102 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.103 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:20:34.104 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.105 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929204807000005, 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.106 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.107 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:34.108 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.109 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:20:34.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:20:34.110 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.110 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.110 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.110 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:20:34.110 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.111 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929167672999995, 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.112 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.113 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.114 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:20:34.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:20:34.115 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.115 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.115 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.115 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:20:34.115 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.116 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.117 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.929140484000001, 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.118 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.119 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.119 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:20:34.119 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.119 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.119 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.119 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.119 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:34.119 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.120 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:34.120 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.120 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.120 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.120 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.121 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.122 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.123 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.928871878999999, 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:34.125 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.126 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:20:34.126 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:20:34.126 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.126 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.126 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.127 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.128 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.129 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.928830578000003, 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.130 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.131 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:34.132 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.133 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.134 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.928805471000004, 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.135 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:20:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.137 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.138 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:20:34.139 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.140 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.141 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.141 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:34.141 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.928564707000007, 2024-09-11T06:20:34.141 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:20:34.141 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.141 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.141 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.141 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.143 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.144 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.145 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:20:34.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:20:34.147 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.147 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.147 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.147 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.147 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:34.147 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.928530401000003, 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:20:34.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:20:34.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.928509633999994, 2024-09-11T06:20:34.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:34.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:20:34.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 93.928279110999995, 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:20:34.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.164 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:230929 3.3 3:c2c3195d:::rbd_data.116dc6ff1838.0000000000000047:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 18.913316898000001, 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99430693299999995, 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 230929 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135376+0000", 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1990000000000001e-06 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135380+0000", 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3250000000000001e-06 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135390+0000", 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7429999999999997e-06 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135397+0000", 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9970000000000001e-06 2024-09-11T06:20:34.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135455+0000", 2024-09-11T06:20:34.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8159999999999999e-05 2024-09-11T06:20:34.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:34.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135463+0000", 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6030000000000005e-06 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127459+0000", 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99199554099999998 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127561+0000", 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102329 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127635+0000", 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3538e-05 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129214+0000", 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001578695 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129575+0000", 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036180099999999997 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129633+0000", 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8009e-05 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129681+0000", 2024-09-11T06:20:34.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7992999999999999e-05 2024-09-11T06:20:34.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.172 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.172 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.172 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.172 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:34.174 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:34.174 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:34.173+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:34.218 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.6 primary-affinity to 0.589161 (8386112) 2024-09-11T06:20:34.279 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:34.278+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:34.327 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:34.327 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:34.327 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:34.328 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:34.336 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:34.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:34.380+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:34.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:34.439 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:34.439 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:34.440 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:34.440 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:34.448 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:34.475 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:34.474+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:34.535 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:34.535 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:34.551 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:34.552 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:34.567 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:34.567 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:34.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:34.576+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:34.583 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:34.583 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:34.593 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:34.593 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.35165689300001, 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:34.594 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.595 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.596 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:34.597 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.351644155, 2024-09-11T06:20:34.598 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.599 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.600 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.601 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.602 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.603 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.35163302199999, 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:34.604 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.605 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.607 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:34.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:34.608 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.608 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.608 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.608 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:34.608 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:34.608 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.609 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.609 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.609 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.35162243400001, 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.610 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:34.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:34.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.615 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.35161193900001, 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:34.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.619 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.620 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.35160162599999, 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.621 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.624 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.35159108400001, 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:34.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.351580778, 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.631 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:34.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.634 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.635 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.35156520000001, 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:34.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:34.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:34.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:34.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.639 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:34.640 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.351546195, 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.641 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:34.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:34.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.29201682199999, 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.646 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:34.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.651 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.29199835099999, 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:34.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.29197986099999, 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:34.656 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.658 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.29196279300001, 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.661 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:34.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.665 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.29194476200001, 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.666 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:34.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.670 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.291922578, 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.671 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:34.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.29190458599999, 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:34.675 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:34.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:34.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.29188693200001, 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.680 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.684 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.29186401600001, 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:34.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:34.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 166.291845628, 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:34.689 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:34.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:34.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:34.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:34.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:34.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:34.694 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:34.695 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:34.695 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:34.696 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:34.696 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:34.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:34.697 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:34.697 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:34.698 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:34.698 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:34.699 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:34.694+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:34.796 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:34.795+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:34.842 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:34.842 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:34.851 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:34.897 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:34.897+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:34.995 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:34.995 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:34.997 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:34.997+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:35.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:35.099 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:35.097+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:35.106 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:35.107 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:35.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:35.200 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:35.199+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:35.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:20:35.270 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:35.271 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:35.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:35.301 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:35.300+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:35.402 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:35.401+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:35.428 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:35.428 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:35.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:35.522 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:35.521+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:35.581 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:35.581 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:35.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:35.603 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:35.603+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:35.704 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:35.703+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:35.733 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:35.733 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:35.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:35.805 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:35.804+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:35.846 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:35.846 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:35.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:35.906 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:35.905+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:36.000 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:36.000 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:36.007 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:36.006+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:36.009 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:36.108 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:36.107+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:36.153 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:36.153 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:36.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:36.208 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:36.207+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:36.230 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:20:36.270 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:36.270 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:36.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:36.321 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:36.320+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:36.411 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:36.410+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:36.425 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:36.426 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:36.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:36.512 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:36.512+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:36.539 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:36.539 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:36.547 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:36.613 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:36.612+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:36.650 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:36.650 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:36.659 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:36.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:36.714 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:36.713+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:36.762 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:36.771 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:36.823 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:36.824 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:36.840 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:36.840 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:36.855 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:36.854+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:36.856 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:36.856 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:36.872 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:36.873 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:36.889 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:36.889 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:36.906 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:36.906 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:36.915 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:36.915 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:36.915 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:36.915 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:36.914+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:36.922 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:36.922 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:36.924 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:36.938 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:36.939 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:37.016 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:37.015+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:37.067 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:37.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:37.116 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:37.115+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:37.181 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:37.181 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 137.83659712599999, 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:20:37.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:37.187 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.73267294, 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:20:37.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:20:37.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.732646590000002, 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.732626109999998, 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:20:37.199 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.732607396000006, 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.200 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.202 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.203 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:20:37.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.203 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.205 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723876562000001, 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:20:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:20:37.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723842977999993, 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:20:37.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:20:37.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:37.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723830148999994, 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:20:37.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:20:37.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.220 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723820012000004, 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:20:37.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:20:37.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723809193999998, 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.225 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:37.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:20:37.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.229 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723799314000004, 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.230 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:20:37.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:37.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723789582999999, 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:37.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:20:37.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:20:37.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723779965000006, 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:37.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:20:37.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723770150999997, 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.243 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:37.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:37.247 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723754783999993, 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:20:37.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:20:37.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.723744482000001, 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.253 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:20:37.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:37.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.722044198999996, 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.257 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:20:37.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124299 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2596864~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.715899199999996, 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050056488000000003, 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124299 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463937+0000", 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:37.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463939+0000", 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0759999999999999e-06 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463941+0000", 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8480000000000001e-06 2024-09-11T06:20:37.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463944+0000", 2024-09-11T06:20:37.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.61e-06 2024-09-11T06:20:37.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513858+0000", 2024-09-11T06:20:37.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.049913964999999998 2024-09-11T06:20:37.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513915+0000", 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6798000000000001e-05 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.513994+0000", 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8986999999999994e-05 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.715889704000006, 2024-09-11T06:20:37.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:20:37.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:20:37.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 92.715880145, 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.272 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:37.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:20:37.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:20:37.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:20:37.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.276 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.276 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.276 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:37.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:37.278 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:37.276+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:37.378 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:37.377+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:37.396 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:37.397 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:37.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:37.479 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:37.478+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:37.509 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:37.509 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:37.509 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:37.509 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:37.509 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:37.518 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:37.580 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:37.579+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:37.663 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:37.663 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.543339889999999, 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.664 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:20:37.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:37.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.543282344000005, 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.670 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.674 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.543256834999994, 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.675 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:37.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:20:37.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.680 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.543033667000003, 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:37.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542999000999998, 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:37.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:37.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:37.691 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542974838999996, 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:37.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.695 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542724288000002, 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.696 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:37.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.700 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542696907000007, 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:20:37.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:37.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542673768, 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:20:37.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:37.710 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542445184000002, 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:20:37.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:20:37.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:20:37.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542408050000006, 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.715 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:37.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:20:37.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.718 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:37.719 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542380860999998, 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.720 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:20:37.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:20:37.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542112255999996, 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:20:37.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:20:37.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:20:37.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542070955, 2024-09-11T06:20:37.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:37.734 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.542045848000001, 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:37.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.737 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.541805084000003, 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.739 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.743 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.541770778, 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.744 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:37.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:20:37.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.748 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.541750011000005, 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:20:37.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 97.541519488000006, 2024-09-11T06:20:37.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:20:37.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:20:37.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:230929 3.3 3:c2c3195d:::rbd_data.116dc6ff1838.0000000000000047:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 22.526557275000002, 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99430693299999995, 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 230929 2024-09-11T06:20:37.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:37.760 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135376+0000", 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1990000000000001e-06 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135380+0000", 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3250000000000001e-06 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135390+0000", 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7429999999999997e-06 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:37.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135397+0000", 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9970000000000001e-06 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135455+0000", 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8159999999999999e-05 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135463+0000", 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6030000000000005e-06 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127459+0000", 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99199554099999998 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127561+0000", 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102329 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127635+0000", 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3538e-05 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129214+0000", 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001578695 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129575+0000", 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036180099999999997 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129633+0000", 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8009e-05 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:37.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129681+0000", 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7992999999999999e-05 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:37.765 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:37.766 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:37.767 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:37.766+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:37.867 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:37.867+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:37.910 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:37.910 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:37.911 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:37.911 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:37.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:38.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:38.004+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:38.062 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:38.062 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:38.062 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:38.062 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:38.062 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:38.069 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:38.068+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:38.070 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:38.169 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:38.169+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.974342181, 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.216 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:38.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:38.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.97432944299999, 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.97431831, 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.227 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:38.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:38.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:38.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.97430772199999, 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.236 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.97429722699999, 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.237 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:38.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:38.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.974286914, 2024-09-11T06:20:38.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:38.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:38.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.97427637199999, 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.249 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.97426606600001, 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.250 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:38.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.974250488, 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.255 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:38.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.259 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.97423148300001, 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.260 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.91470211000001, 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.265 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:38.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.914683639, 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:38.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.914665149, 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.274 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:38.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.914648081, 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:38.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.281 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:38.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.283 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.91463005, 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:38.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:38.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:38.288 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.91460786600001, 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:38.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:38.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.914589874, 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.293 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:38.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.297 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.298 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:38.298 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.91457222, 2024-09-11T06:20:38.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:38.298 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.298 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.298 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.298 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.298 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.299 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.299 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:38.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.299 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:38.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:38.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.301 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.301 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:38.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:38.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:38.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:38.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:38.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:38.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:38.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:38.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:38.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:38.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:38.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:38.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:38.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:38.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.307 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.307 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.307 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.307 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.307 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:38.308 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.91454930399999, 2024-09-11T06:20:38.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:38.308 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.308 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.308 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.308 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.309 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.309 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:38.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.309 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:38.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:38.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:38.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:38.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:38.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:38.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:38.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:38.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:38.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:38.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:38.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:38.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:38.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:38.317 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.317 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.317 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.317 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:38.318 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:38.318 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 169.91453091599999, 2024-09-11T06:20:38.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:38.318 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:38.318 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:38.318 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:38.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:38.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:38.319 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.319 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:38.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.320 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:38.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:38.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:38.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:38.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:38.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:38.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:38.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:38.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:38.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:38.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:38.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:38.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:38.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:38.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:38.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.324 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.324 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.324 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:38.324 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:38.324 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.325 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.325 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:38.325 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:38.325 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:38.325 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.326 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:38.326 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:38.326 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:38.326 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:38.326 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:38.327 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:38.327 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:38.327 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:38.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.327 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.327 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.328 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:38.328 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:38.328 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:38.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:20:38.331 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:38.329+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:38.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:38.432 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:38.431+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:38.442 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:38.442 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:38.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:38.533 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:38.532+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:38.598 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:38.598 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:38.607 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:38.633 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:38.633+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.377418831999996, 2024-09-11T06:20:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:20:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:20:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:20:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:20:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:20:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:20:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.331546973000002, 2024-09-11T06:20:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:20:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:20:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:20:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:20:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:20:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:20:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:20:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:20:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:20:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:20:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:20:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:20:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:20:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:20:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:191036 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.108432006999998, 2024-09-11T06:20:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659934617, 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 191036 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601548+0000", 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6700000000000003e-07 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601552+0000", 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0659999999999997e-06 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601558+0000", 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-06 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601561+0000", 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.253e-06 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601612+0000", 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1629000000000003e-05 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601623+0000", 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0397000000000001e-05 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261189+0000", 2024-09-11T06:20:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659566337 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261380+0000", 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019126000000000001 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261482+0000", 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101248 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224551 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3374080~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471848676, 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.06128741, 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224551 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238131+0000", 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238133+0000", 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9719999999999999e-06 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238138+0000", 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238143+0000", 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299252+0000", 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061109588999999999 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299337+0000", 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4788000000000002e-05 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299418+0000", 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0584e-05 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224552 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3376128~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471830862000001, 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061927471999999997, 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224552 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238149+0000", 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-07 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238151+0000", 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8810000000000001e-06 2024-09-11T06:20:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238156+0000", 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238161+0000", 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4870000000000004e-06 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299444+0000", 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061282879999999998 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299839+0000", 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039492900000000003 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300076+0000", 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000237013 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224553 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3378176~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471813087000001, 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108599, 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224553 2024-09-11T06:20:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238168+0000", 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238174+0000", 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6849999999999998e-06 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238178+0000", 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300107+0000", 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061928578999999997 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300183+0000", 2024-09-11T06:20:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6075999999999995e-05 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300275+0000", 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1576000000000005e-05 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224554 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3380224~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471795595, 2024-09-11T06:20:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274642999999998, 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224554 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238184+0000", 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3500000000000002e-07 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238186+0000", 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.756e-06 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238191+0000", 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6180000000000003e-06 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238196+0000", 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999999e-06 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300304+0000", 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108236999999997 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300376+0000", 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1594000000000006e-05 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300458+0000", 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-11T06:20:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224555 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3382272~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471778378, 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062436684999999999, 2024-09-11T06:20:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224555 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238203+0000", 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238208+0000", 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238213+0000", 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-06 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300487+0000", 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274312999999998 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300557+0000", 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0238000000000001e-05 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300637+0000", 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0272000000000007e-05 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224556 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3384320~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471628559999999, 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062473433000000002, 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224556 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238354+0000", 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6690000000000002e-06 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238362+0000", 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370000000000004e-06 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238367+0000", 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300664+0000", 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062297407999999999 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300736+0000", 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2103999999999999e-05 2024-09-11T06:20:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300824+0000", 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7484999999999993e-05 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224557 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3386368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471604772999999, 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062640965000000007, 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224557 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238375+0000", 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238377+0000", 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.872e-06 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238382+0000", 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.93e-06 2024-09-11T06:20:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238387+0000", 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300852+0000", 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062465510000000002 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300929+0000", 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6565999999999998e-05 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301015+0000", 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6508999999999995e-05 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224558 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3388416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471586959, 2024-09-11T06:20:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062861117999999994, 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224558 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238395+0000", 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0619999999999999e-06 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238400+0000", 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1259999999999997e-06 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238403+0000", 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7929999999999999e-06 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301051+0000", 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062647184999999994 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301151+0000", 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9999000000000003e-05 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301253+0000", 2024-09-11T06:20:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102618 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224559 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3390464~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471570747000001, 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063237010999999996, 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224559 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238409+0000", 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4400000000000001e-07 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238410+0000", 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.782e-06 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238416+0000", 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.356e-06 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238420+0000", 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0210000000000001e-06 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301280+0000", 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062859905999999993 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301460+0000", 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018026699999999999 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301645+0000", 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018543499999999999 2024-09-11T06:20:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224560 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3392512~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471552707000001, 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063424783999999998, 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224560 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238427+0000", 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.03e-07 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238429+0000", 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8330000000000001e-06 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238434+0000", 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3360000000000002e-06 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238438+0000", 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301670+0000", 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063231417999999998 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301763+0000", 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3914999999999998e-05 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301851+0000", 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7705000000000001e-05 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224561 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3394560~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471535973999998, 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063589239000000006, 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224561 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238445+0000", 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6160000000000001e-06 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238451+0000", 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238456+0000", 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9649999999999999e-06 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301876+0000", 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063419918000000006 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301950+0000", 2024-09-11T06:20:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4187e-05 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302032+0000", 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2168000000000003e-05 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224562 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3396608~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471511344, 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063734823999999995, 2024-09-11T06:20:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224562 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238470+0000", 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0080000000000001e-06 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238476+0000", 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8209999999999998e-06 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238480+0000", 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2250000000000002e-06 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302056+0000", 2024-09-11T06:20:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063575452000000005 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302120+0000", 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4689000000000004e-05 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302203+0000", 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2231000000000006e-05 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224563 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3398656~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471493355, 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063882994999999998, 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224563 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238488+0000", 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238493+0000", 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2279999999999998e-06 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238497+0000", 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9539999999999998e-06 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302225+0000", 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063728578999999994 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302291+0000", 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5953999999999999e-05 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302369+0000", 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7340000000000002e-05 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224564 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3400704~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471477466, 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064035277000000002, 2024-09-11T06:20:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224564 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:38.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238504+0000", 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.578e-06 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238509+0000", 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238513+0000", 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302390+0000", 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063877220999999998 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302454+0000", 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3812999999999994e-05 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302537+0000", 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812000000000006e-05 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224565 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3402752~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471461145999999, 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064466108999999994, 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224565 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238520+0000", 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238526+0000", 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.429e-06 2024-09-11T06:20:38.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238530+0000", 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302559+0000", 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064029364000000005 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302843+0000", 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028354600000000003 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302984+0000", 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014120100000000001 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224566 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3404800~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471443700000002, 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064698612000000003, 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224566 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238536+0000", 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0600000000000001e-07 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238537+0000", 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.68e-06 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238543+0000", 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4659999999999998e-06 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238547+0000", 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1679999999999997e-06 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303014+0000", 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064467177000000001 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303085+0000", 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0916999999999999e-05 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303234+0000", 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014889800000000001 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224567 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3406848~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.471427118000001, 2024-09-11T06:20:38.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064927740999999997, 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224567 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4700000000000002e-07 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238554+0000", 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T06:20:38.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238561+0000", 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238565+0000", 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303258+0000", 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064692538999999993 2024-09-11T06:20:38.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303353+0000", 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5149000000000007e-05 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303480+0000", 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012678 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:38.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:38.818 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:38.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:38.819 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:38.818+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:38.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:38.919+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:38.922 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:38.922 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:38.922 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:38.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:38.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:39.021 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:39.020+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:39.035 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:39.036 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:39.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:39.096 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:39.096 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:39.113 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:39.114 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:39.122 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:39.121+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:39.130 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:39.130 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:39.146 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:39.151 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:39.151 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:39.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:39.163 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:39.163 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:39.180 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:39.180 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:39.197 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:39.198 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:39.214 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:39.214 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:39.223 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:39.222+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:39.238 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7, 3] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:39.238 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:39.238 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-11T06:20:39.238 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T06:20:39.239 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T06:20:39.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-11T06:20:39.251 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:20:39.277 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:39.277 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:39.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:39.331 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:39.330+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:39.387 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:39.387 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T06:20:39.387 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:39.425 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:39.424+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:39.465 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:39.465 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:39.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:39.526 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:39.525+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:39.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:39.627 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:39.626+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:39.688 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:39.688 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:39.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:39.740 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:39.739+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:39.800 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:39.800 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:39.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:39.850 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:39.849+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:39.930 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:39.929+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:39.952 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:39.952 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:39.961 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:40.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:40.030+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:40.071 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:40.071 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:40.079 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:40.164 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:40.163+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:40.231 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:40.231+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:40.234 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:40.234 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:40.244 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:40.332 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:40.331+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:40.387 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:40.388 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:40.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:40.439 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:40.439+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:40.499 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:40.500 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:40.508 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:40.533 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:40.532+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:40.634 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:40.634+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:40.651 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:40.651 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:40.660 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:40.736 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:40.735+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:40.762 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:40.762 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:40.771 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:40.836 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:40.836+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:40.874 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:40.874 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:40.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:40.937 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:40.936+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:41.027 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:41.037 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:41.039 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:41.038+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:41.140 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:41.139+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:41.143 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:41.152 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:41.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:41.240 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:41.240+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:41.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:41.301 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:41.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:41.342 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:41.341+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:41.353 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:41.353 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:41.369 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:41.370 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:41.387 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:41.387 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:41.403 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:41.404 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:41.420 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:41.420 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:41.436 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:41.437 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:41.443 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:41.442+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:41.453 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:41.454 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:41.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:41.469 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:41.543 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:41.543+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:41.609 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:41.609 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:41.609 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:41.609 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:41.609 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.609 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.609 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:41.609 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.367381526, 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.610 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.611 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:41.612 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.613 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:41.614 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.36736878799999, 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:41.615 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.616 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:41.617 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.618 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.36735765500001, 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:41.619 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.620 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.621 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.622 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:41.623 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:41.624 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.624 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.624 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.624 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.624 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.624 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.624 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:41.624 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.367347067, 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.625 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.626 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:41.628 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.367336572, 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.629 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:41.630 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:41.631 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.632 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:41.633 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.36732625900001, 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:41.634 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.635 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:41.636 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.637 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.638 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.367315717, 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.639 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:41.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.640 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.640 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.640 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:41.640 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.640 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.641 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.642 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.643 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.36730541099999, 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.644 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.645 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:41.646 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:41.647 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:41.648 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.367289833, 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.649 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:41.650 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:41.651 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.652 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.36727082799999, 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.653 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.654 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.655 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.656 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.657 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.30774145500001, 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.658 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:41.659 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.660 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.661 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.662 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.30772298400001, 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.663 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.664 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:41.665 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.666 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.667 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.668 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.30770449400001, 2024-09-11T06:20:41.669 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.670 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:41.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:41.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.307687426, 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.677 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:41.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:41.681 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.307669395, 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:41.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:41.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:41.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.30764721099999, 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:41.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.30762921900001, 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.690 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:41.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:41.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.307611565, 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.699 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.307588649, 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:41.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:41.704 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 173.307570261, 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:41.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:41.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:41.709 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:41.709 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:41.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:41.711 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:41.710+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:41.811 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:41.810+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:41.813 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:41.813 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:41.813 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:41.813 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:41.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:41.912 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:41.912+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:41.965 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:41.965 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:41.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:42.013 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:42.012+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:42.080 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:42.081 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:42.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:42.081 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:42.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.081 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:42.081 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:42.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.743495064999998, 2024-09-11T06:20:42.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:20:42.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:20:42.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.697623206000003, 2024-09-11T06:20:42.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:20:42.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:20:42.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:191036 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.474508239999999, 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659934617, 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 191036 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601548+0000", 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6700000000000003e-07 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601552+0000", 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0659999999999997e-06 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601558+0000", 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-06 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601561+0000", 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.253e-06 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601612+0000", 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1629000000000003e-05 2024-09-11T06:20:42.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601623+0000", 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0397000000000001e-05 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261189+0000", 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659566337 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261380+0000", 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019126000000000001 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261482+0000", 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101248 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224551 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3374080~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837924909000002, 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.06128741, 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224551 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238130+0000", 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238131+0000", 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2800000000000003e-07 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238133+0000", 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9719999999999999e-06 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238138+0000", 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238143+0000", 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299252+0000", 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061109588999999999 2024-09-11T06:20:42.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299337+0000", 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4788000000000002e-05 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299418+0000", 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0584e-05 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224552 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3376128~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837907094999998, 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061927471999999997, 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224552 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238149+0000", 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-07 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238151+0000", 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8810000000000001e-06 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238156+0000", 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238161+0000", 2024-09-11T06:20:42.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4870000000000004e-06 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299444+0000", 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061282879999999998 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299839+0000", 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039492900000000003 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300076+0000", 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000237013 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224553 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3378176~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837889320000002, 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108599, 2024-09-11T06:20:42.113 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224553 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238168+0000", 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238174+0000", 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6849999999999998e-06 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238178+0000", 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-09-11T06:20:42.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300107+0000", 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061928578999999997 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300183+0000", 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6075999999999995e-05 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300275+0000", 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1576000000000005e-05 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224554 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3380224~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837871827999997, 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274642999999998, 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224554 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238184+0000", 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3500000000000002e-07 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238186+0000", 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.756e-06 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238191+0000", 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6180000000000003e-06 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238196+0000", 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999999e-06 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300304+0000", 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108236999999997 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300376+0000", 2024-09-11T06:20:42.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1594000000000006e-05 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300458+0000", 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224555 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3382272~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837854610999997, 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062436684999999999, 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224555 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238203+0000", 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238208+0000", 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:42.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238213+0000", 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-06 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300487+0000", 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274312999999998 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300557+0000", 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0238000000000001e-05 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300637+0000", 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0272000000000007e-05 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224556 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3384320~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837704793, 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062473433000000002, 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224556 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238354+0000", 2024-09-11T06:20:42.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6690000000000002e-06 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238362+0000", 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370000000000004e-06 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238367+0000", 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300664+0000", 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062297407999999999 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300736+0000", 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2103999999999999e-05 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300824+0000", 2024-09-11T06:20:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7484999999999993e-05 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224557 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3386368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837681005999997, 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062640965000000007, 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.134 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224557 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238375+0000", 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238377+0000", 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.872e-06 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238382+0000", 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.93e-06 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238387+0000", 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300852+0000", 2024-09-11T06:20:42.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062465510000000002 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300929+0000", 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6565999999999998e-05 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301015+0000", 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6508999999999995e-05 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224558 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3388416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837663192000001, 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062861117999999994, 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224558 2024-09-11T06:20:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238395+0000", 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0619999999999999e-06 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238400+0000", 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1259999999999997e-06 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238403+0000", 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7929999999999999e-06 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301051+0000", 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062647184999999994 2024-09-11T06:20:42.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301151+0000", 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9999000000000003e-05 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301253+0000", 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102618 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224559 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3390464~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837646980000002, 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063237010999999996, 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224559 2024-09-11T06:20:42.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238409+0000", 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4400000000000001e-07 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238410+0000", 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.782e-06 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238416+0000", 2024-09-11T06:20:42.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.356e-06 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238420+0000", 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0210000000000001e-06 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301280+0000", 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062859905999999993 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301460+0000", 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018026699999999999 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301645+0000", 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018543499999999999 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.148 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224560 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3392512~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837628940000002, 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063424783999999998, 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224560 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.149 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238427+0000", 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.03e-07 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238429+0000", 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8330000000000001e-06 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238434+0000", 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3360000000000002e-06 2024-09-11T06:20:42.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238438+0000", 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301670+0000", 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063231417999999998 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301763+0000", 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3914999999999998e-05 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301851+0000", 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7705000000000001e-05 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224561 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3394560~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837612206999999, 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063589239000000006, 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224561 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238445+0000", 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6160000000000001e-06 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238451+0000", 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:20:42.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238456+0000", 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9649999999999999e-06 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301876+0000", 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063419918000000006 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301950+0000", 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4187e-05 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302032+0000", 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2168000000000003e-05 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224562 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3396608~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837587577000001, 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063734823999999995, 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224562 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238470+0000", 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0080000000000001e-06 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238476+0000", 2024-09-11T06:20:42.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8209999999999998e-06 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238480+0000", 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2250000000000002e-06 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302056+0000", 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063575452000000005 2024-09-11T06:20:42.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302120+0000", 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4689000000000004e-05 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302203+0000", 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2231000000000006e-05 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224563 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3398656~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837569588000001, 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063882994999999998, 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224563 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.164 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238488+0000", 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238493+0000", 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2279999999999998e-06 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238497+0000", 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9539999999999998e-06 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302225+0000", 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063728578999999994 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302291+0000", 2024-09-11T06:20:42.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5953999999999999e-05 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302369+0000", 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7340000000000002e-05 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224564 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3400704~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:42.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837553698999997, 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064035277000000002, 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224564 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:20:42.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238504+0000", 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.578e-06 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238509+0000", 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238513+0000", 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302390+0000", 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063877220999999998 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302454+0000", 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3812999999999994e-05 2024-09-11T06:20:42.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302537+0000", 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812000000000006e-05 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224565 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3402752~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:42.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837537378999997, 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064466108999999994, 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224565 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238520+0000", 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238526+0000", 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.429e-06 2024-09-11T06:20:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238530+0000", 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302559+0000", 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064029364000000005 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302843+0000", 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028354600000000003 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302984+0000", 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014120100000000001 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224566 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3404800~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837519933000003, 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064698612000000003, 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224566 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238536+0000", 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0600000000000001e-07 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238537+0000", 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.68e-06 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238543+0000", 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4659999999999998e-06 2024-09-11T06:20:42.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238547+0000", 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1679999999999997e-06 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303014+0000", 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064467177000000001 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303085+0000", 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0916999999999999e-05 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303234+0000", 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014889800000000001 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224567 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3406848~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:42.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.837503351000002, 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064927740999999997, 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224567 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4700000000000002e-07 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238554+0000", 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238561+0000", 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238565+0000", 2024-09-11T06:20:42.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303258+0000", 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064692538999999993 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303353+0000", 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5149000000000007e-05 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303480+0000", 2024-09-11T06:20:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012678 2024-09-11T06:20:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.188 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:42.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:42.190 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:20:42.191 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:42.188+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:42.290 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:42.289+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:42.335 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:42.336 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:42.336 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:42.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:42.428 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:42.427+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:42.488 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:42.488 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:42.491 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:42.490+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:42.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:42.592 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:42.591+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 102.520388626, 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:20:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.524143764000002, 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:20:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:20:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:20:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:20:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:20:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.524092852999999, 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:20:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523905548999998, 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:20:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523868589000003, 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:20:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:20:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:20:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523843732000003, 2024-09-11T06:20:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:20:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:20:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523803768000001, 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:20:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523773392000003, 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:20:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:20:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:20:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523752625999997, 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:20:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:20:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523719755000002, 2024-09-11T06:20:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:20:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523699897, 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:20:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523679719999997, 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:20:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:20:42.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523668354999998, 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.715 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:20:42.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:20:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:20:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:20:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:20:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523640917999998, 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:20:42.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.728 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523606661999999, 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:20:42.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523593198999997, 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:20:42.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:20:42.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523561469999997, 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:20:42.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:42.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523549312, 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:20:42.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:20:42.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:42.750 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523524463000001, 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:42.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:20:42.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.523511233999997, 2024-09-11T06:20:42.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:42.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:42.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:20:42.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:42.760 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:42.762 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:42.761+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:42.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:42.863 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:42.862+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:42.905 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:42.905 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:42.905 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:42.905 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:42.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:42.964 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:42.963+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:43.017 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:43.017 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:43.017 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:43.017 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:43.017 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:43.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:43.065 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:43.064+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:43.130 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 203.325009373, 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:20:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.954576076000002, 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:20:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:20:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.952172695000002, 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:20:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153432 3.f 3:f42e81df:::rbd_data.116ddf3f5156.000000000000000f:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.797652552999999, 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79802703600000002, 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153432 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330773+0000", 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.278e-06 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330953+0000", 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017961999999999999 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330983+0000", 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0188e-05 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330994+0000", 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331072+0000", 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8141999999999998e-05 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331081+0000", 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2890000000000003e-06 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125207+0000", 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79412554300000004 2024-09-11T06:20:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125321+0000", 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011482299999999999 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125455+0000", 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013386800000000001 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128673+0000", 2024-09-11T06:20:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032178269999999999 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128700+0000", 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128754+0000", 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4716999999999998e-05 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128798+0000", 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3448000000000001e-05 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161945 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 931840~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.239400740999997, 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053842806999999999, 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161945 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889025+0000", 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9570000000000001e-06 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889030+0000", 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5820000000000001e-06 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889035+0000", 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5889999999999996e-06 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942690+0000", 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053655228999999999 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942767+0000", 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-05 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942865+0000", 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8157000000000002e-05 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161946 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 948224~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.239381160999997, 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054041921999999999, 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161946 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890912+0000", 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018701760000000001 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890917+0000", 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890928+0000", 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896999999999999e-05 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890935+0000", 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7149999999999998e-06 2024-09-11T06:20:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942905+0000", 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051969594000000001 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942980+0000", 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4464999999999999e-05 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943084+0000", 2024-09-11T06:20:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104558 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161955 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1095680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.237280267000003, 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053898585999999998, 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161955 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891145+0000", 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891151+0000", 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891156+0000", 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944860+0000", 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053704094000000001 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944943+0000", 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3394999999999997e-05 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945042+0000", 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000005e-05 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161956 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1112064~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.237261033999999, 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054087369000000003, 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161956 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892929+0000", 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001766349 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892933+0000", 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892944+0000", 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0479000000000001e-05 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892950+0000", 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.708e-06 2024-09-11T06:20:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945075+0000", 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052124987999999997 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945154+0000", 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8792e-05 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945250+0000", 2024-09-11T06:20:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5638999999999997e-05 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161965 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1259520~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.235369814999999, 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053970817999999997, 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161965 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894904+0000", 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018509830000000001 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894909+0000", 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.087e-06 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894916+0000", 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894922+0000", 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.767e-06 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946853+0000", 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931484999999999 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946931+0000", 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7737000000000005e-05 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947024+0000", 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3546000000000002e-05 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161974 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1406976~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.233313305999999, 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053855649999999998, 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161974 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895113+0000", 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895119+0000", 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895124+0000", 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948788+0000", 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053664195999999997 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948866+0000", 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7417999999999996e-05 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948966+0000", 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9907000000000004e-05 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161975 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1423360~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.233292249999998, 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054030427999999998, 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161975 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896902+0000", 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017710829999999999 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896910+0000", 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896919+0000", 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7310000000000005e-06 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896926+0000", 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948997+0000", 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052071477999999997 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949068+0000", 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-05 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949162+0000", 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3071000000000004e-05 2024-09-11T06:20:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161984 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1570816~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.231396345, 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053945050000000001, 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161984 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898905+0000", 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001878036 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898910+0000", 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898922+0000", 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-05 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898928+0000", 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950784+0000", 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051855483000000001 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950853+0000", 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9239000000000006e-05 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950972+0000", 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118876 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161994 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1734656~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.229262399, 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053886363999999999, 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161994 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899163+0000", 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899170+0000", 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.866e-06 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899175+0000", 2024-09-11T06:20:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952814+0000", 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053638689000000003 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952892+0000", 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7890000000000001e-05 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953047+0000", 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015576300000000001 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161995 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1751040~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.229242577000001, 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054070368000000001, 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161995 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900905+0000", 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017245850000000001 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900910+0000", 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900923+0000", 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2619999999999999e-05 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900930+0000", 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4059999999999999e-06 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953077+0000", 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052147129 2024-09-11T06:20:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953152+0000", 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5265999999999994e-05 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953251+0000", 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8666999999999996e-05 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162003 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1882112~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.227223533, 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054417001, 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162003 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901202+0000", 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901209+0000", 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901214+0000", 2024-09-11T06:20:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955009+0000", 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053795526000000003 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955110+0000", 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010130500000000001 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955617+0000", 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050644199999999996 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162004 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.227203545999998, 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054432803000000002, 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162004 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901222+0000", 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901227+0000", 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7099999999999998e-06 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901231+0000", 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.357e-06 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955645+0000", 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054413571000000001 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955653+0000", 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162005 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.227186834999998, 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054450025999999999, 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162005 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901291+0000", 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4326000000000001e-05 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901294+0000", 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3459999999999998e-06 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901302+0000", 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0239999999999997e-06 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901308+0000", 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955677+0000", 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054368593999999999 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955687+0000", 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8500000000000006e-06 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162006 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.227106022999997, 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054418451, 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162006 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902903+0000", 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015855590000000001 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902908+0000", 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:20:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902922+0000", 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3949e-05 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902929+0000", 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3150000000000003e-06 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955725+0000", 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052795684000000002 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955736+0000", 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183479 3.15 3:ac303efb:::rbd_data.116d42e0aa2c.0000000000000010:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.834766201999997, 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83363719300000005, 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183479 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293658+0000", 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293663+0000", 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293676+0000", 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2734999999999999e-05 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293683+0000", 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6559999999999992e-06 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293746+0000", 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2748000000000003e-05 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293759+0000", 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2767e-05 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.126963+0000", 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83320435800000003 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127119+0000", 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015564999999999999 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127294+0000", 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017540899999999999 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183484 3.15 3:a84be19c:::rbd_data.116d42e0aa2c.0000000000000015:head [sparse-read 0~4259840] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.834311776, 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83354649000000003, 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183484 2024-09-11T06:20:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8700000000000005e-07 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294116+0000", 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294126+0000", 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6339999999999996e-06 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294131+0000", 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3990000000000003e-06 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294186+0000", 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5438e-05 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294196+0000", 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9769999999999995e-06 2024-09-11T06:20:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127600+0000", 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83340399499999995 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127658+0000", 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7710000000000001e-05 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.226 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:43.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:43.227 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:43.226+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:43.328 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:43.327+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:43.334 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:43.334 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:43.334 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:43.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:43.428 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:43.428+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:43.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:43.485 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:43.486 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:43.486 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:43.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:43.530 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:43.529+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:43.604 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:43.605 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:43.621 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:43.631 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:43.630+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:43.638 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:43.638 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:43.647 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:43.647 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:43.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:43.647 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.525967845, 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:20:43.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:20:43.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:20:43.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:20:43.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:20:43.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.653 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.52587514299999, 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:20:43.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.525669333, 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.659 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:43.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:20:43.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:20:43.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.525583766, 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.665 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:20:43.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:20:43.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:43.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:20:43.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:20:43.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:20:43.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:43.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:20:43.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:20:43.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:20:43.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:20:43.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:20:43.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.671 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.672 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.672 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:43.672 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.52537050799999, 2024-09-11T06:20:43.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:20:43.672 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:20:43.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.673 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:43.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:43.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:20:43.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:20:43.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:20:43.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:20:43.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:20:43.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:20:43.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:20:43.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:20:43.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:20:43.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:20:43.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:20:43.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:20:43.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:20:43.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:20:43.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:20:43.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.525287189, 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:20:43.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:20:43.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.525030306, 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:20:43.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.524968867, 2024-09-11T06:20:43.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:20:43.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:20:43.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.52472304200001, 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:20:43.697 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:20:43.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.524654915, 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:43.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.707 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.524387253, 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:43.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:20:43.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:20:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:20:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:20:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.52431521299999, 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:20:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.52414445399999, 2024-09-11T06:20:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:20:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:20:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:20:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 103.524039233, 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:20:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230165 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.525617617999998, 2024-09-11T06:20:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0055556050000001, 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230165 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118908+0000", 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118915+0000", 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0509999999999999e-06 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118929+0000", 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.383e-05 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118940+0000", 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1368e-05 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129437+0000", 2024-09-11T06:20:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010497272 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129446+0000", 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4980000000000006e-06 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124450+0000", 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99500413499999996 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124462+0000", 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1751e-05 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230166 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.522370533999997, 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0023415419999999, 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230166 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122155+0000", 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122166+0000", 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0689e-05 2024-09-11T06:20:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122180+0000", 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3879e-05 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122190+0000", 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0671e-05 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129472+0000", 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072814869999999997 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129477+0000", 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124488+0000", 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99501055000000005 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124495+0000", 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230931 3.d 3:b6cf8884:::rbd_data.116dc6ff1838.0000000000000049:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.507161692, 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99172812200000005, 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230931 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137363+0000", 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4109999999999999e-06 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137369+0000", 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137381+0000", 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1838000000000001e-05 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137389+0000", 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9009999999999994e-06 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137452+0000", 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3472999999999994e-05 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137463+0000", 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0567000000000001e-05 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127016+0000", 2024-09-11T06:20:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98955333400000001 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127186+0000", 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000169715 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127325+0000", 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013924599999999999 2024-09-11T06:20:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.128993+0000", 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016684689999999999 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129006+0000", 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129049+0000", 2024-09-11T06:20:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2178000000000002e-05 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129090+0000", 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1375000000000003e-05 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230941 3.1d 3:bf50afcf:::rbd_data.116dc6ff1838.0000000000000053:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.503690014, 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99810618600000001, 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230941 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140835+0000", 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3960000000000001e-06 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140839+0000", 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.279e-06 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140850+0000", 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0539e-05 2024-09-11T06:20:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140857+0000", 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0060000000000003e-06 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140919+0000", 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2638999999999994e-05 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140929+0000", 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.927e-06 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130401+0000", 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98947149300000004 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130508+0000", 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106908 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130605+0000", 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7103999999999997e-05 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134020+0000", 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003415052 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138839+0000", 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048191529999999996 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138891+0000", 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1780000000000002e-05 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138940+0000", 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8909999999999998e-05 2024-09-11T06:20:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230966 3.1d 3:ba8846fd:::rbd_data.116dc6ff1838.000000000000006c:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.490734803999999, 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98529302399999996, 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230966 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153790+0000", 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4190000000000001e-06 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153796+0000", 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:20:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153808+0000", 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1892000000000001e-05 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153813+0000", 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9279999999999998e-06 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153865+0000", 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1841000000000001e-05 2024-09-11T06:20:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153872+0000", 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131149+0000", 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97727708300000005 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131259+0000", 2024-09-11T06:20:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010973500000000001 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131337+0000", 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8547999999999994e-05 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134185+0000", 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028480189999999998 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138986+0000", 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048007989999999997 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139037+0000", 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0321999999999997e-05 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139082+0000", 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5204000000000003e-05 2024-09-11T06:20:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230995 3.1d 3:beb2267b:::rbd_data.116dc6ff1838.0000000000000143:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.478979626000001, 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97366138199999996, 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230995 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165545+0000", 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.64e-07 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165550+0000", 2024-09-11T06:20:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165563+0000", 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2498e-05 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165570+0000", 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165628+0000", 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7707999999999997e-05 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165639+0000", 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1015e-05 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131877+0000", 2024-09-11T06:20:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.96623801099999995 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131984+0000", 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010730600000000001 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.132078+0000", 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4215000000000005e-05 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.136247+0000", 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041684519999999996 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139124+0000", 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028775459999999999 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139170+0000", 2024-09-11T06:20:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5763999999999998e-05 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139205+0000", 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5281999999999999e-05 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:43.837 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:43.838 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:43.838 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:43.839 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:43.840 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:43.840 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:43.841 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:43.841 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:43.841 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:43.841 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:43.842 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:43.842 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:43.843 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:43.838+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:43.940 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:43.938+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:43.957 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:43.958 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:43.967 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:44.051 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:44.049+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:44.112 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:44.112 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:44.121 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:44.162 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:44.160+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:44.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:20:44.242 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:44.240+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:44.273 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:44.273 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:44.282 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:44.366 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:44.364+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:44.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7, 3] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:44.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:44.403 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-11T06:20:44.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-11T06:20:44.424 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:44.424 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:44.433 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:44.474 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:44.472+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:44.545 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:44.544+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:44.575 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:44.575 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:44.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:44.646 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:44.645+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:44.687 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:44.688 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:44.690 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T06:20:44.689+0000 7fea5acac640 -1 mon.a@0(leader).osd e235 definitely_dead 0 2024-09-11T06:20:44.696 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:44.748 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:44.746+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:44.800 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:44.800 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:44.809 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:44.848 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:44.847+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:44.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:44.947+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:44.953 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:44.953 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:44.961 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:45.050 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:45.049+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:45.105 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:45.105 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:45.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:45.129 INFO:teuthology.orchestra.run.smithi070.stderr:marked out osd.1. 2024-09-11T06:20:45.132 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:20:45.152 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:45.150+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:45.220 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:45.220 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:45.228 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:45.251 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:45.251+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:45.330 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:45.330 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:45.340 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:45.386 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:45.384+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:45.445 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:45.445 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:45.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:45.454 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:45.451+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:45.554 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:45.553+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:45.562 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:45.562 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:45.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:45.656 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:45.655+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:45.715 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:45.716 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:45.724 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:45.765 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:45.764+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:45.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:45.868 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:45.869 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:45.869 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:45.868+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:45.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:45.962 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:45.961+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:45.966 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:45.966 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:45.983 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:45.983 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:45.999 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:46.000 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:46.017 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:46.017 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:46.026 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:46.026 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:46.026 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:46.026 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:46.034 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:46.034 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:46.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:46.051 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:46.052 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:46.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:46.057+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:46.069 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:46.069 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:46.086 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:46.086 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:46.159 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:46.158+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:46.160 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:46.160 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:46.161 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:46.161 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:46.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:46.260 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:46.259+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:46.316 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:46.316 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:46.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:46.316 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:46.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 106.19388754400001, 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.317 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:20:46.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:20:46.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:20:46.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197642681999994, 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:20:46.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:20:46.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197591771000006, 2024-09-11T06:20:46.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:20:46.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:20:46.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:20:46.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197404466999998, 2024-09-11T06:20:46.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:46.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197367506999996, 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:20:46.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197342649999996, 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.346 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:46.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:20:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:20:46.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197302686, 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:20:46.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:20:46.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197272310000002, 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:20:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:20:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197251543999997, 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:20:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197218672999995, 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:20:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:20:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197198814999993, 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:20:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:20:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:20:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:20:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197178637999997, 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:20:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:20:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197167273000005, 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:20:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:20:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197139836000005, 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197105579999999, 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:20:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:20:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:20:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:20:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197092116999997, 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:20:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:20:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197060387999997, 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:20:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:20:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197048229999993, 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:20:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197023380999994, 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:20:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:20:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.197010152000004, 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:20:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:20:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:20:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:20:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.432 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:46.433 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:46.432+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:46.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:46.534 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:46.533+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:46.580 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:46.580 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:46.580 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:46.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:46.673 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:46.672+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:46.732 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:46.732 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:46.732 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:46.732 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:46.732 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:46.736 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:46.734+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:46.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:46.837 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:46.835+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 207.08083828100001, 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:20:46.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.710404984, 2024-09-11T06:20:46.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:46.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:20:46.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.708001603, 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:20:46.897 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153432 3.f 3:f42e81df:::rbd_data.116ddf3f5156.000000000000000f:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.553481460999997, 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79802703600000002, 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153432 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330773+0000", 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.278e-06 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330953+0000", 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017961999999999999 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330983+0000", 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0188e-05 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330994+0000", 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331072+0000", 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8141999999999998e-05 2024-09-11T06:20:46.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331081+0000", 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2890000000000003e-06 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125207+0000", 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79412554300000004 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125321+0000", 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011482299999999999 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125455+0000", 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013386800000000001 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128673+0000", 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032178269999999999 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128700+0000", 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128754+0000", 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4716999999999998e-05 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128798+0000", 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3448000000000001e-05 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161945 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 931840~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.995229649000002, 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053842806999999999, 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161945 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889023+0000", 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4299999999999999e-07 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889025+0000", 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9570000000000001e-06 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889030+0000", 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5820000000000001e-06 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889035+0000", 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5889999999999996e-06 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942690+0000", 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053655228999999999 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942767+0000", 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.695e-05 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942865+0000", 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8157000000000002e-05 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161946 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 948224~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.995210069000002, 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054041921999999999, 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.913 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161946 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890912+0000", 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018701760000000001 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890917+0000", 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:20:46.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890928+0000", 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896999999999999e-05 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890935+0000", 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7149999999999998e-06 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942905+0000", 2024-09-11T06:20:46.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051969594000000001 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942980+0000", 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4464999999999999e-05 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943084+0000", 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104558 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161955 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1095680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.993109175000001, 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053898585999999998, 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161955 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.918 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891145+0000", 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891151+0000", 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891156+0000", 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944860+0000", 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053704094000000001 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944943+0000", 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3394999999999997e-05 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945042+0000", 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000005e-05 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161956 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1112064~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.993089941999997, 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054087369000000003, 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161956 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892929+0000", 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001766349 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892933+0000", 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T06:20:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892944+0000", 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0479000000000001e-05 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892950+0000", 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.708e-06 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945075+0000", 2024-09-11T06:20:46.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052124987999999997 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945154+0000", 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8792e-05 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945250+0000", 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5638999999999997e-05 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161965 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1259520~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.991198722999997, 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053970817999999997, 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161965 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894904+0000", 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018509830000000001 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894909+0000", 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.087e-06 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894916+0000", 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894922+0000", 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.767e-06 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946853+0000", 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931484999999999 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946931+0000", 2024-09-11T06:20:46.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7737000000000005e-05 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947024+0000", 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3546000000000002e-05 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161974 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1406976~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.989142213999997, 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053855649999999998, 2024-09-11T06:20:46.931 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161974 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895113+0000", 2024-09-11T06:20:46.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895119+0000", 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895124+0000", 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948788+0000", 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053664195999999997 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948866+0000", 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7417999999999996e-05 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948966+0000", 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9907000000000004e-05 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161975 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1423360~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.989121158000003, 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054030427999999998, 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161975 2024-09-11T06:20:46.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896902+0000", 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017710829999999999 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896910+0000", 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896919+0000", 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7310000000000005e-06 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896926+0000", 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948997+0000", 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052071477999999997 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949068+0000", 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-05 2024-09-11T06:20:46.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949162+0000", 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3071000000000004e-05 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161984 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1570816~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.987225252999998, 2024-09-11T06:20:46.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053945050000000001, 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161984 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898905+0000", 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001878036 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898910+0000", 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:20:46.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898922+0000", 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-05 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898928+0000", 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950784+0000", 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051855483000000001 2024-09-11T06:20:46.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950853+0000", 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9239000000000006e-05 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950972+0000", 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118876 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161994 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1734656~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.985091306999998, 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053886363999999999, 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161994 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:46.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899163+0000", 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899170+0000", 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.866e-06 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899175+0000", 2024-09-11T06:20:46.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952814+0000", 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053638689000000003 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952892+0000", 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7890000000000001e-05 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953047+0000", 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015576300000000001 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161995 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1751040~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.985071484999999, 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054070368000000001, 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161995 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900905+0000", 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017245850000000001 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900910+0000", 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900923+0000", 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2619999999999999e-05 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900930+0000", 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4059999999999999e-06 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953077+0000", 2024-09-11T06:20:46.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052147129 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953152+0000", 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5265999999999994e-05 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953251+0000", 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8666999999999996e-05 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.953 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162003 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1882112~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.983052440999998, 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054417001, 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162003 2024-09-11T06:20:46.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901202+0000", 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901209+0000", 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:20:46.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901214+0000", 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955009+0000", 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053795526000000003 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955110+0000", 2024-09-11T06:20:46.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010130500000000001 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955617+0000", 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050644199999999996 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162004 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:46.958 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.983032454000003, 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054432803000000002, 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162004 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:46.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901222+0000", 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901227+0000", 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7099999999999998e-06 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901231+0000", 2024-09-11T06:20:46.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.357e-06 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955645+0000", 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054413571000000001 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955653+0000", 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.962 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162005 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.983015743000003, 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054450025999999999, 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162005 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901291+0000", 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4326000000000001e-05 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901294+0000", 2024-09-11T06:20:46.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3459999999999998e-06 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901302+0000", 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0239999999999997e-06 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901308+0000", 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955677+0000", 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054368593999999999 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955687+0000", 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8500000000000006e-06 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162006 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:46.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.982934931000003, 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054418451, 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162006 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902903+0000", 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015855590000000001 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902908+0000", 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902922+0000", 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3949e-05 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902929+0000", 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3150000000000003e-06 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955725+0000", 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052795684000000002 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955736+0000", 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183479 3.15 3:ac303efb:::rbd_data.116d42e0aa2c.0000000000000010:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.590595110000002, 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83363719300000005, 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183479 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293658+0000", 2024-09-11T06:20:46.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293663+0000", 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293676+0000", 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2734999999999999e-05 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293683+0000", 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6559999999999992e-06 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293746+0000", 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2748000000000003e-05 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293759+0000", 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2767e-05 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.126963+0000", 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83320435800000003 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127119+0000", 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015564999999999999 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127294+0000", 2024-09-11T06:20:46.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017540899999999999 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183484 3.15 3:a84be19c:::rbd_data.116d42e0aa2c.0000000000000015:head [sparse-read 0~4259840] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.590140683999998, 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83354649000000003, 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:46.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183484 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8700000000000005e-07 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294116+0000", 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294126+0000", 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6339999999999996e-06 2024-09-11T06:20:46.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294131+0000", 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3990000000000003e-06 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294186+0000", 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5438e-05 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:46.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294196+0000", 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9769999999999995e-06 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127600+0000", 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83340399499999995 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127658+0000", 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7710000000000001e-05 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:46.982 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:46.982 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:46.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:46.984 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:46.982+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:47.084 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:47.082+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:47.086 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:47.086 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:47.095 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:47.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:20:47.185 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:47.183+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:47.232 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:47.232 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:47.232 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:47.232 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:47.233 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:47.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:47.287 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:47.286+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.263062719, 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:20:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.262970017, 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:20:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.262764207, 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:20:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.26267864, 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:20:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.262465382, 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:20:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:20:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:20:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.262382063, 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:20:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:20:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.26212518, 2024-09-11T06:20:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.26206374100001, 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:20:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.261817916, 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:20:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:20:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:20:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.26174978900001, 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.26148212699999, 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:20:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.261410087, 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.261239328, 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:20:47.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.261134107, 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:20:47.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:20:47.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:20:47.454 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230165 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.262712491999999, 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0055556050000001, 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230165 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118908+0000", 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118915+0000", 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0509999999999999e-06 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118929+0000", 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.383e-05 2024-09-11T06:20:47.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118940+0000", 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1368e-05 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129437+0000", 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010497272 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129446+0000", 2024-09-11T06:20:47.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4980000000000006e-06 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124450+0000", 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99500413499999996 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124462+0000", 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1751e-05 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230166 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.259465407999997, 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0023415419999999, 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230166 2024-09-11T06:20:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122155+0000", 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122166+0000", 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0689e-05 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122180+0000", 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3879e-05 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122190+0000", 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0671e-05 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129472+0000", 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072814869999999997 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129477+0000", 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:20:47.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124488+0000", 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99501055000000005 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124495+0000", 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230931 3.d 3:b6cf8884:::rbd_data.116dc6ff1838.0000000000000049:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.244256565999997, 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99172812200000005, 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230931 2024-09-11T06:20:47.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:47.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137363+0000", 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4109999999999999e-06 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137369+0000", 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137381+0000", 2024-09-11T06:20:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1838000000000001e-05 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137389+0000", 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9009999999999994e-06 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137452+0000", 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3472999999999994e-05 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137463+0000", 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0567000000000001e-05 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127016+0000", 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98955333400000001 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127186+0000", 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000169715 2024-09-11T06:20:47.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127325+0000", 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013924599999999999 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.128993+0000", 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016684689999999999 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129006+0000", 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-09-11T06:20:47.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129049+0000", 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2178000000000002e-05 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129090+0000", 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1375000000000003e-05 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230941 3.1d 3:bf50afcf:::rbd_data.116dc6ff1838.0000000000000053:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.240784888, 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99810618600000001, 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230941 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.472 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140835+0000", 2024-09-11T06:20:47.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3960000000000001e-06 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140839+0000", 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.279e-06 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140850+0000", 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0539e-05 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140857+0000", 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0060000000000003e-06 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140919+0000", 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2638999999999994e-05 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140929+0000", 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.927e-06 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130401+0000", 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98947149300000004 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130508+0000", 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106908 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130605+0000", 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7103999999999997e-05 2024-09-11T06:20:47.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134020+0000", 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003415052 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138839+0000", 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048191529999999996 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138891+0000", 2024-09-11T06:20:47.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1780000000000002e-05 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138940+0000", 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8909999999999998e-05 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230966 3.1d 3:ba8846fd:::rbd_data.116dc6ff1838.000000000000006c:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.227829677999999, 2024-09-11T06:20:47.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98529302399999996, 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230966 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153790+0000", 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4190000000000001e-06 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153796+0000", 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153808+0000", 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1892000000000001e-05 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153813+0000", 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9279999999999998e-06 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153865+0000", 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1841000000000001e-05 2024-09-11T06:20:47.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153872+0000", 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131149+0000", 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97727708300000005 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131259+0000", 2024-09-11T06:20:47.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010973500000000001 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131337+0000", 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8547999999999994e-05 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134185+0000", 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028480189999999998 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:47.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138986+0000", 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048007989999999997 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139037+0000", 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0321999999999997e-05 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139082+0000", 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5204000000000003e-05 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230995 3.1d 3:beb2267b:::rbd_data.116dc6ff1838.0000000000000143:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.216074499999998, 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97366138199999996, 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230995 2024-09-11T06:20:47.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:47.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165545+0000", 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.64e-07 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165550+0000", 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165563+0000", 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2498e-05 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165570+0000", 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165628+0000", 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7707999999999997e-05 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165639+0000", 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1015e-05 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131877+0000", 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.96623801099999995 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131984+0000", 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010730600000000001 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.132078+0000", 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4215000000000005e-05 2024-09-11T06:20:47.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.136247+0000", 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041684519999999996 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139124+0000", 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028775459999999999 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:47.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139170+0000", 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5763999999999998e-05 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139205+0000", 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5281999999999999e-05 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:47.491 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:47.493 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:47.493 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:47.491+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:47.593 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:47.592+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:47.610 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:47.610 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:47.610 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:47.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:47.695 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:47.693+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:47.733 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:47.734 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:47.734 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:47.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:47.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:47.826+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:47.895 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:47.895 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:47.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:47.895 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:47.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.895 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:20:47.895 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:47.895 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.406758889000002, 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:20:47.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:20:47.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:20:47.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.902 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.495232948000002, 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72623960399999998, 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.903 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397783+0000", 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.147e-06 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398274+0000", 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049154799999999996 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398283+0000", 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1179999999999998e-06 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398288+0000", 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398330+0000", 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1692e-05 2024-09-11T06:20:47.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398336+0000", 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4689999999999996e-06 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124013+0000", 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72567764599999995 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124021+0000", 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.907 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.352157542, 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58344928699999998, 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.908 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540858+0000", 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541443+0000", 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058485600000000003 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541451+0000", 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0639999999999994e-06 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541456+0000", 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541523+0000", 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7529999999999999e-05 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541534+0000", 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124290+0000", 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58275560900000001 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124306+0000", 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6065e-05 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.912 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3:dd3750b5:::rbd_data.116ddf3f5156.0000000000000013:head [write 0~409600 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 52.345896195999998, 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58172919000000001, 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547119+0000", 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:20:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547621+0000", 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000501645 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547629+0000", 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6589999999999996e-06 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547634+0000", 2024-09-11T06:20:47.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.848e-06 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547686+0000", 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.147e-05 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547695+0000", 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124336+0000", 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.57664082699999997 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124428+0000", 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2153999999999999e-05 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124519+0000", 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0313000000000001e-05 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.125614+0000", 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001095794 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128786+0000", 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031712770000000001 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128821+0000", 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5602000000000002e-05 2024-09-11T06:20:47.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128847+0000", 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6109999999999999e-05 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227124 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 397312~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.419439427, 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046188726999999999, 2024-09-11T06:20:47.919 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227124 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5899999999999998e-07 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473576+0000", 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0109999999999999e-06 2024-09-11T06:20:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473579+0000", 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9390000000000002e-06 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473584+0000", 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.921e-06 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519653+0000", 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046069327 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519698+0000", 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4518000000000003e-05 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519764+0000", 2024-09-11T06:20:47.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5752000000000003e-05 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227125 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 399360~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.419427282000001, 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046294848, 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.924 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227125 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473591+0000", 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.54e-06 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473594+0000", 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999999e-06 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473597+0000", 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7530000000000002e-06 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519790+0000", 2024-09-11T06:20:47.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046192892999999999 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519828+0000", 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8266000000000003e-05 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519882+0000", 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3816000000000001e-05 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.928 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227126 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 401408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.419414361999998, 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046400064999999997, 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.929 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227126 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473602+0000", 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3549999999999999e-06 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473607+0000", 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2050000000000001e-06 2024-09-11T06:20:47.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473610+0000", 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0479999999999999e-06 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519904+0000", 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046293809999999998 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519944+0000", 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0621999999999998e-05 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520000+0000", 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5656999999999999e-05 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227127 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 403456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.419400535999998, 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046519645999999998, 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227127 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.934 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:47.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473616+0000", 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473626+0000", 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5899999999999997e-06 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473631+0000", 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8640000000000001e-06 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520035+0000", 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046403941999999997 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520077+0000", 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1282999999999998e-05 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520133+0000", 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6747999999999999e-05 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227128 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 405504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.419376733, 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046616360000000003, 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.938 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227128 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473640+0000", 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9120000000000001e-06 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473649+0000", 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473655+0000", 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:20:47.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520159+0000", 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046503925000000002 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520202+0000", 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-05 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520254+0000", 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2194999999999997e-05 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227129 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 407552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.419353135999998, 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046708761000000001, 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227129 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473662+0000", 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473664+0000", 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473671+0000", 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0759999999999997e-06 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473676+0000", 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520281+0000", 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046605466999999998 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520320+0000", 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8875999999999998e-05 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520370+0000", 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9972000000000002e-05 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227130 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 409600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.947 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.419329345999998, 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046828026000000002, 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227130 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.948 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474753+0000", 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001068334 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474757+0000", 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.737e-06 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474763+0000", 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474768+0000", 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520401+0000", 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045632645999999999 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520454+0000", 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3227999999999999e-05 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520513+0000", 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9144999999999997e-05 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227134 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 417792~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.418206398999999, 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046187445000000001, 2024-09-11T06:20:47.952 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227134 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474809+0000", 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-11T06:20:47.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474812+0000", 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.039e-06 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474815+0000", 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520893+0000", 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046078467999999997 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520936+0000", 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2809999999999998e-05 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520995+0000", 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9224000000000001e-05 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227135 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 419840~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.956 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.418196649999999, 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046298338000000001, 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227135 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476753+0000", 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001935057 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.958 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476757+0000", 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2610000000000004e-06 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476768+0000", 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476775+0000", 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521030+0000", 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044254449000000001 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521067+0000", 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7261000000000001e-05 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521116+0000", 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8934999999999998e-05 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227146 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 442368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.416012705, 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046216054999999999, 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227146 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.961 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7399999999999999e-07 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477003+0000", 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1769999999999999e-06 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477006+0000", 2024-09-11T06:20:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477009+0000", 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6410000000000002e-06 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523047+0000", 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046037814000000003 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523137+0000", 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0424e-05 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523218+0000", 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0654000000000004e-05 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227147 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 444416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.416002806999998, 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046410320999999997, 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227147 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.966 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478755+0000", 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001743426 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478759+0000", 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2200000000000003e-06 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478768+0000", 2024-09-11T06:20:47.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478775+0000", 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6699999999999997e-06 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523251+0000", 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044475796999999997 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523328+0000", 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6787999999999997e-05 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523422+0000", 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4241999999999997e-05 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227192 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 273408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.970 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.407258403999997, 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046102219999999999, 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227192 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:47.971 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485809+0000", 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3118000000000002e-05 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.972 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485812+0000", 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485831+0000", 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485837+0000", 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9789999999999998e-06 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.973 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531732+0000", 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045895683999999999 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531781+0000", 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8853999999999997e-05 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531858+0000", 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6889000000000002e-05 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.974 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227193 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 275456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.407167326, 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046243092999999999, 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.975 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227193 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.976 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486066+0000", 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021887 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486070+0000", 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6490000000000001e-06 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486076+0000", 2024-09-11T06:20:47.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6789999999999999e-06 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486081+0000", 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531897+0000", 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045816669999999997 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531981+0000", 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3554999999999995e-05 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532090+0000", 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109084 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227194 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 277504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.406919369000001, 2024-09-11T06:20:47.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046160642000000002, 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227194 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486297+0000", 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000202337 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486300+0000", 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9670000000000001e-06 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486308+0000", 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5089999999999996e-06 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486313+0000", 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532129+0000", 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045815225000000001 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532199+0000", 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0402999999999997e-05 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532256+0000", 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6641000000000002e-05 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227195 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 279552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.406691737000003, 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046088184999999997, 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.984 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227195 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486470+0000", 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147754 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486474+0000", 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2770000000000001e-06 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486484+0000", 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8819999999999996e-06 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486488+0000", 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532287+0000", 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045798959 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532345+0000", 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7584999999999998e-05 2024-09-11T06:20:47.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532411+0000", 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5782000000000001e-05 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227196 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 281600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 38.406512425000003, 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046093975000000002, 2024-09-11T06:20:47.988 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227196 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487755+0000", 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012529959999999999 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487759+0000", 2024-09-11T06:20:47.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9570000000000004e-06 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487765+0000", 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5910000000000001e-06 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487770+0000", 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2409999999999997e-06 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532448+0000", 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044678540000000003 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532527+0000", 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8465000000000002e-05 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532596+0000", 2024-09-11T06:20:47.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9184999999999996e-05 2024-09-11T06:20:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:47.993 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:47.993 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:47.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:47.995 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:47.993+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:48.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:48.093+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:48.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:48.139 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:48.139 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:48.139 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:48.148 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:48.149 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:20:48.196 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:48.195+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:48.226 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:48.227 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:48.243 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:48.243 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:48.259 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:48.259 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:48.274 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:48.275 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:48.291 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:48.291 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:48.291 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:48.291 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:48.291 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:48.296 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:48.295+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:48.300 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:48.301 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:48.301 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:48.318 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:48.335 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:48.335 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:48.352 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:48.352 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:48.404 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:48.403+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:48.405 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:48.405 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:48.414 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:48.499 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:48.497+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:48.516 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:48.516 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:48.525 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:48.599 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:48.599+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:48.627 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:48.627 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:48.635 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:48.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:48.698+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:48.739 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:48.739 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:48.747 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:48.801 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:48.801+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:48.891 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:48.891 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:48.899 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:48.902 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:48.900+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:49.002 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.002 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.003 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:49.002+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:49.011 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:49.103 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:49.103+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:49.113 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.113 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:49.204 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:49.202+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:49.243 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.243 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:49.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:49.304+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:49.357 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.357 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.366 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:49.407 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:49.405+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:49.468 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.468 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:49.507 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:49.506+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:49.581 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.581 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:49.608 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:49.606+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:49.691 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.692 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:49.744 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:49.742+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:49.804 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.804 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.810 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:49.809+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:49.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:49.911 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:49.909+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:49.955 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:49.955 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:49.964 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:50.048 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:50.046+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:50.107 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:50.108 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:50.113 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:50.112+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:50.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:50.152 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 6, 7, 3] out_osds: [1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:50.152 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:50.152 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-11T06:20:50.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-11T06:20:50.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:20:50.244 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:50.242+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:50.277 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:50.278 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:50.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:50.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:50.313+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:50.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:50.418 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:50.416+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:50.436 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:50.437 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:50.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:50.479 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-11T06:20:50.477+0000 7fea5acac640 -1 mon.a@0(leader).osd e241 definitely_dead 0 2024-09-11T06:20:50.495 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:50.496 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:50.513 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:50.513 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:50.516 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:50.515+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:50.529 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:50.547 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:50.547 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:50.564 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:50.564 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:50.581 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:50.581 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:50.585 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:50.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:50.585 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:50.585 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:50.586 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:50.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:50.597 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:50.597 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:50.614 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:50.615 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:50.618 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:50.616+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:50.705 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.705 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.58252789700001, 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:20:50.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.711 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.582435195, 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.58222938500001, 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:50.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:20:50.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.58214381800001, 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.721 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:20:50.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:20:50.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.58193056, 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.58184724100001, 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:20:50.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:20:50.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:20:50.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.581590358, 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:20:50.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.58152891899999, 2024-09-11T06:20:50.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:20:50.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:20:50.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.581283094, 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:20:50.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.58121496699999, 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:20:50.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.754 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.580947305, 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:20:50.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:20:50.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:20:50.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.580875265, 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.764 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.580704506, 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:20:50.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 110.58059928500001, 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:20:50.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.774 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230165 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.58217767, 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0055556050000001, 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230165 2024-09-11T06:20:50.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118908+0000", 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118915+0000", 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0509999999999999e-06 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118929+0000", 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.383e-05 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118940+0000", 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1368e-05 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129437+0000", 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010497272 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129446+0000", 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4980000000000006e-06 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124450+0000", 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99500413499999996 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124462+0000", 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1751e-05 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.779 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230166 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.578930585999998, 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0023415419999999, 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230166 2024-09-11T06:20:50.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122155+0000", 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122166+0000", 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0689e-05 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122180+0000", 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3879e-05 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122190+0000", 2024-09-11T06:20:50.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0671e-05 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129472+0000", 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072814869999999997 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129477+0000", 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124488+0000", 2024-09-11T06:20:50.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99501055000000005 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124495+0000", 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230931 3.d 3:b6cf8884:::rbd_data.116dc6ff1838.0000000000000049:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.563721743999999, 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99172812200000005, 2024-09-11T06:20:50.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230931 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137363+0000", 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4109999999999999e-06 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137369+0000", 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T06:20:50.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137381+0000", 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1838000000000001e-05 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137389+0000", 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9009999999999994e-06 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137452+0000", 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3472999999999994e-05 2024-09-11T06:20:50.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137463+0000", 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0567000000000001e-05 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127016+0000", 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98955333400000001 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127186+0000", 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000169715 2024-09-11T06:20:50.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127325+0000", 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013924599999999999 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.128993+0000", 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016684689999999999 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129006+0000", 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-09-11T06:20:50.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129049+0000", 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2178000000000002e-05 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129090+0000", 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1375000000000003e-05 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.790 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230941 3.1d 3:bf50afcf:::rbd_data.116dc6ff1838.0000000000000053:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.560250066000002, 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99810618600000001, 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230941 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140835+0000", 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3960000000000001e-06 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140839+0000", 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.279e-06 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140850+0000", 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0539e-05 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140857+0000", 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0060000000000003e-06 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140919+0000", 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2638999999999994e-05 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140929+0000", 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.927e-06 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130401+0000", 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98947149300000004 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130508+0000", 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106908 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130605+0000", 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7103999999999997e-05 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134020+0000", 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003415052 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138839+0000", 2024-09-11T06:20:50.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048191529999999996 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138891+0000", 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1780000000000002e-05 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138940+0000", 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8909999999999998e-05 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230966 3.1d 3:ba8846fd:::rbd_data.116dc6ff1838.000000000000006c:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.547294856000001, 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98529302399999996, 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230966 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153790+0000", 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4190000000000001e-06 2024-09-11T06:20:50.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153796+0000", 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153808+0000", 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1892000000000001e-05 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153813+0000", 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9279999999999998e-06 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153865+0000", 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1841000000000001e-05 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153872+0000", 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131149+0000", 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97727708300000005 2024-09-11T06:20:50.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131259+0000", 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010973500000000001 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131337+0000", 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8547999999999994e-05 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134185+0000", 2024-09-11T06:20:50.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028480189999999998 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138986+0000", 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048007989999999997 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139037+0000", 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0321999999999997e-05 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139082+0000", 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5204000000000003e-05 2024-09-11T06:20:50.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230995 3.1d 3:beb2267b:::rbd_data.116dc6ff1838.0000000000000143:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.535539677999999, 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97366138199999996, 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:50.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230995 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165545+0000", 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.64e-07 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165550+0000", 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165563+0000", 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2498e-05 2024-09-11T06:20:50.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165570+0000", 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165628+0000", 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7707999999999997e-05 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165639+0000", 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1015e-05 2024-09-11T06:20:50.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131877+0000", 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.96623801099999995 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131984+0000", 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010730600000000001 2024-09-11T06:20:50.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.132078+0000", 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4215000000000005e-05 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.136247+0000", 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041684519999999996 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139124+0000", 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028775459999999999 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139170+0000", 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5763999999999998e-05 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139205+0000", 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5281999999999999e-05 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:50.809 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:50.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:50.811 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:50.809+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:50.912 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:50.911+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:50.918 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:50.918 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:50.919 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:50.919 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:50.928 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:51.013 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:51.011+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:51.031 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:51.040 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:51.114 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:51.113+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 73.657632493999998, 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.146 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.147 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:51.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.149 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:20:51.150 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:20:51.151 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.746106552999997, 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72623960399999998, 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.153 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.154 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397783+0000", 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.147e-06 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398274+0000", 2024-09-11T06:20:51.155 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049154799999999996 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398283+0000", 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1179999999999998e-06 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398288+0000", 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.156 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398330+0000", 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1692e-05 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398336+0000", 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4689999999999996e-06 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124013+0000", 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72567764599999995 2024-09-11T06:20:51.157 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124021+0000", 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.603031147000003, 2024-09-11T06:20:51.158 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58344928699999998, 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:51.159 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540858+0000", 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541443+0000", 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058485600000000003 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541451+0000", 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0639999999999994e-06 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.161 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541456+0000", 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541523+0000", 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7529999999999999e-05 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541534+0000", 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.162 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124290+0000", 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58275560900000001 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124306+0000", 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6065e-05 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.163 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3:dd3750b5:::rbd_data.116ddf3f5156.0000000000000013:head [write 0~409600 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 55.596769801000001, 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58172919000000001, 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.164 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547119+0000", 2024-09-11T06:20:51.165 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547621+0000", 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000501645 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547629+0000", 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6589999999999996e-06 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.166 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547634+0000", 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.848e-06 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547686+0000", 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.147e-05 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547695+0000", 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:20:51.167 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124336+0000", 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.57664082699999997 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124428+0000", 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2153999999999999e-05 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124519+0000", 2024-09-11T06:20:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0313000000000001e-05 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.125614+0000", 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001095794 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128786+0000", 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031712770000000001 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.169 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128821+0000", 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5602000000000002e-05 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128847+0000", 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6109999999999999e-05 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227124 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 397312~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.170 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.670313032000003, 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046188726999999999, 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227124 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.171 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5899999999999998e-07 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.172 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473576+0000", 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0109999999999999e-06 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473579+0000", 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9390000000000002e-06 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473584+0000", 2024-09-11T06:20:51.173 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.921e-06 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519653+0000", 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046069327 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.174 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519698+0000", 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4518000000000003e-05 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519764+0000", 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5752000000000003e-05 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227125 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 399360~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.175 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.670300887000003, 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046294848, 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227125 2024-09-11T06:20:51.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473591+0000", 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.54e-06 2024-09-11T06:20:51.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473594+0000", 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999999e-06 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473597+0000", 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7530000000000002e-06 2024-09-11T06:20:51.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519790+0000", 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046192892999999999 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519828+0000", 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8266000000000003e-05 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.180 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519882+0000", 2024-09-11T06:20:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3816000000000001e-05 2024-09-11T06:20:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.181 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227126 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 401408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.670287967, 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046400064999999997, 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.182 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227126 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.183 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473602+0000", 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3549999999999999e-06 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.184 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473607+0000", 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2050000000000001e-06 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473610+0000", 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0479999999999999e-06 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519904+0000", 2024-09-11T06:20:51.185 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046293809999999998 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519944+0000", 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0621999999999998e-05 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520000+0000", 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5656999999999999e-05 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.186 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227127 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 403456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.670274141, 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046519645999999998, 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227127 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.187 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:20:51.188 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473616+0000", 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473626+0000", 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5899999999999997e-06 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.189 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473631+0000", 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8640000000000001e-06 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520035+0000", 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046403941999999997 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520077+0000", 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1282999999999998e-05 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.190 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520133+0000", 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6747999999999999e-05 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227128 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 405504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.670250338000002, 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046616360000000003, 2024-09-11T06:20:51.191 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227128 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.192 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473640+0000", 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9120000000000001e-06 2024-09-11T06:20:51.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473649+0000", 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473655+0000", 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.194 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520159+0000", 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046503925000000002 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520202+0000", 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-05 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520254+0000", 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2194999999999997e-05 2024-09-11T06:20:51.195 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227129 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 407552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.670226741, 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046708761000000001, 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.196 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227129 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.197 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473662+0000", 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473664+0000", 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473671+0000", 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0759999999999997e-06 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473676+0000", 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520281+0000", 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046605466999999998 2024-09-11T06:20:51.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520320+0000", 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8875999999999998e-05 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520370+0000", 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9972000000000002e-05 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227130 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 409600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.670202951, 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046828026000000002, 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227130 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.201 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474753+0000", 2024-09-11T06:20:51.202 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001068334 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474757+0000", 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.737e-06 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474763+0000", 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.203 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474768+0000", 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520401+0000", 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045632645999999999 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520454+0000", 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3227999999999999e-05 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.204 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520513+0000", 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9144999999999997e-05 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227134 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 417792~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.669080004000001, 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046187445000000001, 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.205 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227134 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.206 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.207 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474809+0000", 2024-09-11T06:20:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-11T06:20:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.208 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474812+0000", 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.039e-06 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474815+0000", 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.209 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520893+0000", 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046078467999999997 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520936+0000", 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2809999999999998e-05 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520995+0000", 2024-09-11T06:20:51.210 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9224000000000001e-05 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227135 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 419840~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.669070255000001, 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046298338000000001, 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.211 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227135 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.212 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.213 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476753+0000", 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001935057 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476757+0000", 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2610000000000004e-06 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.214 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476768+0000", 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476775+0000", 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.215 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521030+0000", 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044254449000000001 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521067+0000", 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7261000000000001e-05 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.216 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521116+0000", 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8934999999999998e-05 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227146 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 442368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.666886310000002, 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046216054999999999, 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.217 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227146 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7399999999999999e-07 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.219 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477003+0000", 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1769999999999999e-06 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477006+0000", 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477009+0000", 2024-09-11T06:20:51.220 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6410000000000002e-06 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523047+0000", 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046037814000000003 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523137+0000", 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0424e-05 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523218+0000", 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0654000000000004e-05 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227147 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 444416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.666876412000001, 2024-09-11T06:20:51.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046410320999999997, 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227147 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478755+0000", 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001743426 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478759+0000", 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2200000000000003e-06 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478768+0000", 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478775+0000", 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6699999999999997e-06 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523251+0000", 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044475796999999997 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523328+0000", 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6787999999999997e-05 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523422+0000", 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4241999999999997e-05 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.228 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227192 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 273408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.658132008999999, 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046102219999999999, 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227192 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.229 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485809+0000", 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3118000000000002e-05 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485812+0000", 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.231 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485831+0000", 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485837+0000", 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9789999999999998e-06 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531732+0000", 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045895683999999999 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531781+0000", 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8853999999999997e-05 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531858+0000", 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6889000000000002e-05 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227193 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 275456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.658040931000002, 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046243092999999999, 2024-09-11T06:20:51.234 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227193 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.236 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486066+0000", 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021887 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486070+0000", 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6490000000000001e-06 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486076+0000", 2024-09-11T06:20:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6789999999999999e-06 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486081+0000", 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531897+0000", 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045816669999999997 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531981+0000", 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3554999999999995e-05 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532090+0000", 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109084 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.240 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227194 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 277504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.240 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:51.240 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.657792974000003, 2024-09-11T06:20:51.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046160642000000002, 2024-09-11T06:20:51.240 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.240 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.240 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.240 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227194 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:51.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486297+0000", 2024-09-11T06:20:51.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000202337 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486300+0000", 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9670000000000001e-06 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486308+0000", 2024-09-11T06:20:51.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5089999999999996e-06 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486313+0000", 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532129+0000", 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045815225000000001 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532199+0000", 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0402999999999997e-05 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532256+0000", 2024-09-11T06:20:51.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6641000000000002e-05 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227195 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 279552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.657565341999998, 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046088184999999997, 2024-09-11T06:20:51.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227195 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486470+0000", 2024-09-11T06:20:51.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147754 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486474+0000", 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2770000000000001e-06 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486484+0000", 2024-09-11T06:20:51.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8819999999999996e-06 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486488+0000", 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532287+0000", 2024-09-11T06:20:51.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045798959 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532345+0000", 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7584999999999998e-05 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532411+0000", 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5782000000000001e-05 2024-09-11T06:20:51.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227196 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 281600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 41.657386029999998, 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046093975000000002, 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.252 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227196 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487755+0000", 2024-09-11T06:20:51.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012529959999999999 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487759+0000", 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9570000000000004e-06 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487765+0000", 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5910000000000001e-06 2024-09-11T06:20:51.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487770+0000", 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2409999999999997e-06 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532448+0000", 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044678540000000003 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532527+0000", 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8465000000000002e-05 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532596+0000", 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9184999999999996e-05 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.257 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.258 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:51.259 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:20:51.259 INFO:teuthology.orchestra.run.smithi070.stderr:marked in osd.1. 2024-09-11T06:20:51.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:51.262 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-11T06:20:51.262 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:51.258+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:51.360 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:51.358+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:51.406 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:51.406 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:51.406 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:51.406 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:51.415 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:51.460 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:51.458+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:51.517 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:51.517 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:51.517 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:51.517 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:51.518 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:51.526 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:51.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:51.565+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:51.662 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:51.660+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 152.325900494, 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.671 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.672 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.673 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:20:51.674 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.676 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.221976308, 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.677 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:51.678 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:20:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.680 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.221949958, 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:20:51.681 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.682 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:20:51.683 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:20:51.684 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.685 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.22192947800001, 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.686 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.687 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:20:51.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.689 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.221910764, 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.690 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.691 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.692 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:20:51.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.21317993, 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:20:51.698 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.213146346, 2024-09-11T06:20:51.699 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:51.700 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.701 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.702 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.703 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.213133517, 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.707 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.21312338, 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.708 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.709 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.710 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.711 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.712 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.21311256200001, 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:20:51.713 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.714 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:51.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:20:51.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.213102682, 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.718 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:51.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.720 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.721 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:20:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:20:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.722 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.723 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.21309295099999, 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.724 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.725 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.726 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.727 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.213083333, 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.728 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.729 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.730 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:20:51.731 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.21307351900001, 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.732 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.733 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:20:51.734 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:20:51.735 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.736 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.213058152, 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.737 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.738 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.739 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:20:51.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.21304785, 2024-09-11T06:20:51.741 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.742 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.743 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.744 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.745 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.211347567, 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.746 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.747 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.748 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:20:51.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.205193072, 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:20:51.750 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.751 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:20:51.752 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.753 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 107.20518351299999, 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.755 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.756 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:20:51.757 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:20:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:235794 3.1a 3:5becf0a6:::rbd_header.116db5c39c9d:head [watch reconnect cookie 139721594604592 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e237)", 2024-09-11T06:20:51.759 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 5.5353393779999998, 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0293680119999999, 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 235794 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.760 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133802+0000", 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4169999999999999e-06 2024-09-11T06:20:51.761 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133808+0000", 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7810000000000002e-06 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133820+0000", 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2480000000000001e-05 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:51.762 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133830+0000", 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6460000000000005e-06 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133891+0000", 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1577999999999999e-05 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133903+0000", 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1833e-05 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.763 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.157160+0000", 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023257206 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for rw locks", 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.157241+0000", 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0480000000000002e-05 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.160048+0000", 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002806804 2024-09-11T06:20:51.764 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.160119+0000", 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1117000000000004e-05 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.163168+0000", 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00304967 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.765 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:51.766 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:51.766 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:51.767 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:51.767 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:51.765+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:51.867 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:51.865+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:51.911 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:51.911 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:51.911 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:51.920 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:52.004 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:52.002+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:52.064 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:52.064 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:52.064 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:52.064 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:52.065 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:52.069 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:52.067+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:52.073 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:52.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:52.167+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:52.220 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.10047848000001, 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.221 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.223 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.225 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.100420934, 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.227 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.228 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.229 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.230 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.100395425, 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.231 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.232 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:20:52.233 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:20:52.234 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:20:52.235 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.100172257, 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:52.237 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.238 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.239 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.240 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.10013759100001, 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.241 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.242 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.243 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.244 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.245 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.100113429, 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.246 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.247 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:20:52.248 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.249 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.250 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.099862878, 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:20:52.251 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.252 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.253 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:20:52.254 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.255 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.256 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.099835497, 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:20:52.258 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:20:52.259 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.260 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.261 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.09981235799999, 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.262 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.263 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.264 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.099583774, 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.266 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.267 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:52.268 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.269 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.270 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.09954664, 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.271 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.272 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.273 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:20:52.274 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:20:52.275 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.09951945100001, 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.276 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:52.277 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.278 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:20:52.279 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.280 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.099250846, 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.281 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.282 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:20:52.283 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.284 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.285 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.09920954499999, 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:20:52.288 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.289 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.290 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.09918443799999, 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.291 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.293 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.294 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.295 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.098943674, 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.296 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.297 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.298 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.299 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.300 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.09890936799999, 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:20:52.301 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:52.302 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.303 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:20:52.304 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.305 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.306 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.098888601, 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.307 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.308 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:20:52.309 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.311 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 112.098658078, 2024-09-11T06:20:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:20:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.312 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.313 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.314 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:20:52.315 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:20:52.316 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:230929 3.3 3:c2c3195d:::rbd_data.116dc6ff1838.0000000000000047:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 37.083695865000003, 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99430693299999995, 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.317 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 230929 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.318 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135376+0000", 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1990000000000001e-06 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135380+0000", 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3250000000000001e-06 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135390+0000", 2024-09-11T06:20:52.319 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7429999999999997e-06 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135397+0000", 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9970000000000001e-06 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135455+0000", 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8159999999999999e-05 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.320 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135463+0000", 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6030000000000005e-06 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127459+0000", 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99199554099999998 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127561+0000", 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102329 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.321 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127635+0000", 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3538e-05 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129214+0000", 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001578695 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129575+0000", 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036180099999999997 2024-09-11T06:20:52.322 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129633+0000", 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8009e-05 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129681+0000", 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7992999999999999e-05 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.323 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:52.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:52.325 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:52.324+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:52.425 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:52.424+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:52.469 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:52.469 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:52.478 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:52.527 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:52.525+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:52.620 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:52.621 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:52.621 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:52.621 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:52.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:52.627 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:52.626+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:52.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:52.729 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:52.728+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:52.759 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:52.759 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:52.774 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:52.774 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:52.774 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.533154948, 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:52.775 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.776 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:52.777 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.778 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:52.779 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.53314220999999, 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.780 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.781 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.782 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.783 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.53313107700001, 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.784 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.785 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.786 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:52.787 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.788 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.533120489, 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.789 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.790 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:52.791 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:52.792 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.533109994, 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.793 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:52.794 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:52.795 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:52.796 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.53309968100001, 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:52.797 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.798 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:52.800 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.801 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.533089139, 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.802 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:52.803 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:52.804 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:52.805 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.53307883299999, 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.806 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.807 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:52.808 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.809 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.810 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.533063255, 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.811 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.812 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.813 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.814 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.815 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.53304424999999, 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.816 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:52.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:52.818 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:52.819 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.47351487700001, 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.821 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.822 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.823 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.824 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.47349640600001, 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.825 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.826 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.827 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:52.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.47347791600001, 2024-09-11T06:20:52.829 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:52.830 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.831 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:52.832 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:52.833 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.473460848, 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.834 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:52.835 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.836 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:52.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.838 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.47344281700001, 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.839 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:52.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:52.843 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.47342063299999, 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:52.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:52.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.47340264100001, 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.848 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:52.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.473384987, 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:52.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.473362071, 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:52.857 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:52.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:52.861 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 184.473343683, 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:52.862 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:52.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:52.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:52.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:52.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:52.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.866 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:52.866 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:52.866 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:52.867 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:52.867 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:52.868 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:52.869 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:52.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:52.869 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:52.866+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:52.870 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:52.870 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:52.870 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:52.871 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:52.871 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:52.871 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:52.871 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:52.872 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:52.876 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:52.876 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:52.969 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:52.968+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:52.974 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:52.975 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:52.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:53.069 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:53.068+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:53.127 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:53.127 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:53.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:53.170 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:53.169+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:53.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:20:53.266 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:53.266 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:53.271 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:53.269+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:53.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:53.372 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:53.371+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:53.442 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:53.442 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:53.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:53.473 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:53.472+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:53.575 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:53.573+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:53.608 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:53.608 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:53.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:53.676 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:53.674+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:53.725 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:53.725 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:53.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:53.778 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:53.777+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:53.856 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:53.856 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:53.866 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:53.907 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:53.906+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:53.978 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:53.977+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:54.015 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:54.015 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:54.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:54.079 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:54.078+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:54.167 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:54.167 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:54.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:54.180 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:20:54.181 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:54.179+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:54.281 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:54.280+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:54.286 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:54.286 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:54.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:54.382 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:54.381+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:54.437 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:54.438 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:54.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:54.482 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:54.482+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:54.549 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:54.549 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:54.558 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:54.602 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:54.601+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:54.673 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:54.673 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:54.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:54.683 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:54.682+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:54.784 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:54.783+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:54.827 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:54.827 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:54.835 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:54.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:54.920 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:54.919+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:54.978 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:54.978 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:54.985 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:54.985+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:54.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:55.008 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:55.008 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:55.025 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:55.025 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:55.041 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:55.041 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:55.057 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:55.057 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:55.073 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:55.074 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:55.087 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:55.086+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:55.090 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:55.090 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:55.106 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:55.107 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:55.122 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:55.131 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:55.131 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:55.131 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:55.132 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:55.140 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:55.189 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:55.188+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:55.252 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:55.252 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:55.252 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:55.252 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:55.252 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:55.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:55.305 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:55.304+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:55.369 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 156.02473505699999, 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.370 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.371 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:20:55.372 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.373 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.374 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.375 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.920810871, 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.376 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:20:55.377 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.378 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:20:55.379 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.920784521, 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.382 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:20:55.383 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.920764041, 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:20:55.385 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.386 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.387 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:20:55.388 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.389 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.92074532700001, 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.390 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:20:55.391 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.392 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:20:55.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.394 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.912014493, 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.395 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.396 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:20:55.397 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:55.399 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.91198090899999, 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:55.400 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.401 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.403 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.91196807999999, 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.404 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.405 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.406 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.408 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.911957943, 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.409 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.410 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.411 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:20:55.412 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.911947125, 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:20:55.413 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.414 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.415 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:20:55.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:20:55.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.911937245, 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.418 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:55.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.420 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.423 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.911927514, 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.424 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.91191789600001, 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.429 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:20:55.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.911908082, 2024-09-11T06:20:55.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:20:55.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:20:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.91189271499999, 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.438 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:20:55.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:20:55.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.911882413, 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.442 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:20:55.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:20:55.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.91018213, 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:20:55.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.451 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.90402763500001, 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.452 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:20:55.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 110.904018076, 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:20:55.456 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:20:55.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:20:55.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:235794 3.1a 3:5becf0a6:::rbd_header.116db5c39c9d:head [watch reconnect cookie 139721594604592 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e237)", 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 9.2341739409999999, 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0293680119999999, 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 235794 2024-09-11T06:20:55.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133802+0000", 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4169999999999999e-06 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133808+0000", 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7810000000000002e-06 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133820+0000", 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2480000000000001e-05 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133830+0000", 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6460000000000005e-06 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133891+0000", 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1577999999999999e-05 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133903+0000", 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1833e-05 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.157160+0000", 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023257206 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for rw locks", 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.157241+0000", 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0480000000000002e-05 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.160048+0000", 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002806804 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.160119+0000", 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1117000000000004e-05 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.163168+0000", 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00304967 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.466 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.467 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.467 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.467 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.467 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:55.468 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:55.469 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:55.467+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:55.569 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:55.568+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:55.611 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:55.612 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:55.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:55.670 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:55.669+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:55.721 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:55.722 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:55.722 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:55.722 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:55.722 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:55.731 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:55.776 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:55.775+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:55.837 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:55.837 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:55.837 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:55.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:55.837 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.838 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118746 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.838 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:55.838 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.715584624, 2024-09-11T06:20:55.838 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99260683999999999, 2024-09-11T06:20:55.838 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.838 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.839 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.839 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.839 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118746 2024-09-11T06:20:55.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.840 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.840 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.840 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.840 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:55.840 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.841 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.841 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.841 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118592+0000", 2024-09-11T06:20:55.841 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.842 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.842 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118593+0000", 2024-09-11T06:20:55.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.688e-06 2024-09-11T06:20:55.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.842 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.843 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.843 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118601+0000", 2024-09-11T06:20:55.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8059999999999995e-06 2024-09-11T06:20:55.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118617+0000", 2024-09-11T06:20:55.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.5770999999999999e-05 2024-09-11T06:20:55.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118624+0000", 2024-09-11T06:20:55.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2200000000000003e-06 2024-09-11T06:20:55.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118677+0000", 2024-09-11T06:20:55.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2394e-05 2024-09-11T06:20:55.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118686+0000", 2024-09-11T06:20:55.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4339999999999998e-06 2024-09-11T06:20:55.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.847 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111011+0000", 2024-09-11T06:20:55.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99232471600000005 2024-09-11T06:20:55.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111114+0000", 2024-09-11T06:20:55.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000103115 2024-09-11T06:20:55.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111199+0000", 2024-09-11T06:20:55.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.4696000000000004e-05 2024-09-11T06:20:55.849 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.849 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.850 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.850 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118747 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.850 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:55.850 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.71552707799999, 2024-09-11T06:20:55.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99298580400000003, 2024-09-11T06:20:55.851 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.851 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.851 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.851 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.852 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118747 2024-09-11T06:20:55.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.852 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.852 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:55.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:20:55.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118650+0000", 2024-09-11T06:20:55.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8000000000000001e-07 2024-09-11T06:20:55.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:20:55.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7099999999999999e-06 2024-09-11T06:20:55.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.856 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.856 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118660+0000", 2024-09-11T06:20:55.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8140000000000001e-06 2024-09-11T06:20:55.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118666+0000", 2024-09-11T06:20:55.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:55.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118717+0000", 2024-09-11T06:20:55.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.062e-05 2024-09-11T06:20:55.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118723+0000", 2024-09-11T06:20:55.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3589999999999996e-06 2024-09-11T06:20:55.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111495+0000", 2024-09-11T06:20:55.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99277234000000003 2024-09-11T06:20:55.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111582+0000", 2024-09-11T06:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6903000000000005e-05 2024-09-11T06:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111635+0000", 2024-09-11T06:20:55.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2958999999999999e-05 2024-09-11T06:20:55.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.862 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.862 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.862 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118748 3.1 3:83096ce5:::rbd_data.116d617edd04.0000000000000007:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.863 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:55.863 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.715501569, 2024-09-11T06:20:55.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99316663000000005, 2024-09-11T06:20:55.863 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.863 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.864 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.864 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.864 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118748 2024-09-11T06:20:55.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.865 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:55.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.866 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.866 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.866 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:55.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118675+0000", 2024-09-11T06:20:55.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.01e-07 2024-09-11T06:20:55.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118678+0000", 2024-09-11T06:20:55.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6790000000000001e-06 2024-09-11T06:20:55.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118684+0000", 2024-09-11T06:20:55.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.241e-06 2024-09-11T06:20:55.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118689+0000", 2024-09-11T06:20:55.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5109999999999997e-06 2024-09-11T06:20:55.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118744+0000", 2024-09-11T06:20:55.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5077999999999997e-05 2024-09-11T06:20:55.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.871 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.871 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118755+0000", 2024-09-11T06:20:55.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1268e-05 2024-09-11T06:20:55.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111710+0000", 2024-09-11T06:20:55.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99295533000000002 2024-09-11T06:20:55.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111791+0000", 2024-09-11T06:20:55.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1097e-05 2024-09-11T06:20:55.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111841+0000", 2024-09-11T06:20:55.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0025000000000003e-05 2024-09-11T06:20:55.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.875 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.875 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118754 3.1 3:809b2a38:::rbd_data.116d617edd04.0000000000000005:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.875 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:55.876 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.71527840100001, 2024-09-11T06:20:55.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99308436499999997, 2024-09-11T06:20:55.876 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.876 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.876 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.877 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.877 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118754 2024-09-11T06:20:55.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.877 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:55.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118898+0000", 2024-09-11T06:20:55.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118899+0000", 2024-09-11T06:20:55.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6199999999999997e-07 2024-09-11T06:20:55.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118902+0000", 2024-09-11T06:20:55.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.687e-06 2024-09-11T06:20:55.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.880 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118912+0000", 2024-09-11T06:20:55.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6220000000000004e-06 2024-09-11T06:20:55.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118918+0000", 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1360000000000002e-06 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118955+0000", 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6319000000000002e-05 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118959+0000", 2024-09-11T06:20:55.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:20:55.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111873+0000", 2024-09-11T06:20:55.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291451799999997 2024-09-11T06:20:55.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111933+0000", 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9994000000000002e-05 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.111982+0000", 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9345000000000003e-05 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118755 3.1 3:80aa34ba:::rbd_data.116d617edd04.0000000000000006:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.715243735, 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99317660399999996, 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.884 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118755 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118933+0000", 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5299999999999999e-07 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118936+0000", 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3700000000000002e-06 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9959999999999996e-06 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118948+0000", 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118991+0000", 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2752e-05 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119000+0000", 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112007+0000", 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99300679800000002 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112053+0000", 2024-09-11T06:20:55.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6331000000000001e-05 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112109+0000", 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6317000000000003e-05 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118756 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:55.889 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.715219573, 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99320175399999999, 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118756 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:55.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:20:55.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7800000000000002e-07 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118960+0000", 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.3199999999999998e-06 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118967+0000", 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9979999999999997e-06 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.118972+0000", 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4450000000000004e-06 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119016+0000", 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4503999999999999e-05 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119020+0000", 2024-09-11T06:20:55.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0319999999999999e-06 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112134+0000", 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99311406199999996 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112159+0000", 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5015e-05 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118762 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.71496902200001, 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.9929711, 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.895 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118762 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119207+0000", 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119208+0000", 2024-09-11T06:20:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9599999999999999e-07 2024-09-11T06:20:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119211+0000", 2024-09-11T06:20:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0699999999999998e-06 2024-09-11T06:20:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119221+0000", 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5929999999999995e-06 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119225+0000", 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2509999999999996e-06 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119256+0000", 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1331000000000002e-05 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9339999999999999e-06 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112173+0000", 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99291247500000002 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112179+0000", 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8499999999999999e-06 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118763 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.714941641, 2024-09-11T06:20:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99296158800000001, 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118763 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119235+0000", 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9500000000000003e-07 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119238+0000", 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2249999999999999e-06 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119244+0000", 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7510000000000002e-06 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119249+0000", 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9570000000000001e-06 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119287+0000", 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7506000000000003e-05 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119293+0000", 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.725e-06 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112191+0000", 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289758100000003 2024-09-11T06:20:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112196+0000", 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3480000000000003e-06 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118764 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.714918502, 2024-09-11T06:20:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992954636, 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118764 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119258+0000", 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119260+0000", 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9240000000000001e-06 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119267+0000", 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8349999999999998e-06 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119272+0000", 2024-09-11T06:20:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0730000000000004e-06 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119307+0000", 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4959999999999997e-05 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119310+0000", 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1580000000000001e-06 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112207+0000", 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99289709599999998 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112213+0000", 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2089999999999996e-06 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.910 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118770 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.714689918, 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99274755100000001, 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118770 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119487+0000", 2024-09-11T06:20:55.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5199999999999996e-07 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119491+0000", 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119500+0000", 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8510000000000005e-06 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.913 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0990000000000004e-06 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119539+0000", 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3225999999999997e-05 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119543+0000", 2024-09-11T06:20:55.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8139999999999998e-06 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112229+0000", 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99268640100000005 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112234+0000", 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.915 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118771 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.71465278399999, 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99273177800000001, 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.916 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118771 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119524+0000", 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1500000000000004e-07 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119527+0000", 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.836e-06 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119535+0000", 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7270000000000007e-06 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119541+0000", 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8379999999999998e-06 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9703e-05 2024-09-11T06:20:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119576+0000", 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3650000000000003e-06 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112251+0000", 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99267477400000004 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112255+0000", 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118772 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.714625595, 2024-09-11T06:20:55.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99272010899999996, 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118772 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.922 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:55.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:55.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119551+0000", 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2e-07 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119553+0000", 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2220000000000001e-06 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119560+0000", 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5130000000000002e-06 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0719999999999996e-06 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119610+0000", 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3837000000000001e-05 2024-09-11T06:20:55.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4819999999999997e-06 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112266+0000", 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99264865800000002 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112271+0000", 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9049999999999996e-06 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118778 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.71435699, 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99246678300000002, 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.927 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118778 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119819+0000", 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119820+0000", 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8000000000000005e-07 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119824+0000", 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7060000000000002e-06 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119834+0000", 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0463e-05 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119841+0000", 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7020000000000004e-06 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4795000000000001e-05 2024-09-11T06:20:55.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119893+0000", 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.8419999999999999e-06 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112281+0000", 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238858500000005 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112286+0000", 2024-09-11T06:20:55.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9099999999999996e-06 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118779 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.714315689, 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245908999999999, 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.932 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118779 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119861+0000", 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5599999999999995e-07 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119864+0000", 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:20:55.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.4780000000000002e-06 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119877+0000", 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8200000000000002e-06 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.935 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119915+0000", 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7789e-05 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119921+0000", 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.02e-06 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112311+0000", 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.992389682 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.936 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112320+0000", 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.9330000000000007e-06 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118780 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.714290582, 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99245204300000001, 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.937 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118780 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.938 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119886+0000", 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8200000000000001e-07 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119889+0000", 2024-09-11T06:20:55.939 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.306e-06 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119896+0000", 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0339999999999999e-06 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119902+0000", 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9680000000000003e-06 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.940 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119942+0000", 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0491999999999998e-05 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.119948+0000", 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.789e-06 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112333+0000", 2024-09-11T06:20:55.941 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99238478600000002 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112338+0000", 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2859999999999999e-06 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118786 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.71404981800001, 2024-09-11T06:20:55.942 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99223817199999997, 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118786 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.943 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120127+0000", 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1800000000000005e-07 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.944 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120131+0000", 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4290000000000001e-06 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120141+0000", 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0054000000000001e-05 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120146+0000", 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0560000000000004e-06 2024-09-11T06:20:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120188+0000", 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1702000000000002e-05 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120195+0000", 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0369999999999997e-06 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112359+0000", 2024-09-11T06:20:55.946 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99216449900000003 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112365+0000", 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5770000000000001e-06 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118787 3.1 3.5d2c5501 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:55.947 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.714015512, 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222022200000004, 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118787 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.948 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120161+0000", 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.949 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120163+0000", 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8309999999999999e-06 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120169+0000", 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1759999999999998e-06 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120174+0000", 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8489999999999997e-06 2024-09-11T06:20:55.950 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120226+0000", 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1885999999999998e-05 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120235+0000", 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4069999999999999e-06 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112376+0000", 2024-09-11T06:20:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99214073300000005 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112381+0000", 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9660000000000004e-06 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118788 3.1 3.a73690c1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:55.952 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.71399474499999, 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99222505999999999, 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118788 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.953 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120182+0000", 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1600000000000002e-07 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.954 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120185+0000", 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4980000000000001e-06 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120191+0000", 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.4609999999999996e-06 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120196+0000", 2024-09-11T06:20:55.955 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4179999999999996e-06 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120269+0000", 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2318999999999997e-05 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120277+0000", 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2039999999999997e-06 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.956 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112402+0000", 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99212465299999997 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112407+0000", 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.091e-06 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:118794 3.1 3.1c54d901 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:20:55.957 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 115.71376422199999, 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99201753699999995, 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 118794 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.958 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120412+0000", 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120413+0000", 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2600000000000002e-07 2024-09-11T06:20:55.959 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120417+0000", 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1150000000000004e-06 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120425+0000", 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1580000000000005e-06 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.960 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120432+0000", 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5570000000000001e-06 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120478+0000", 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6437999999999998e-05 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6810000000000001e-06 2024-09-11T06:20:55.961 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112425+0000", 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99193976100000003 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:01.112430+0000", 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.101e-06 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.962 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:230929 3.3 3:c2c3195d:::rbd_data.116dc6ff1838.0000000000000047:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 40.698802008999998, 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99430693299999995, 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 230929 2024-09-11T06:20:55.963 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135374+0000", 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.964 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135376+0000", 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1990000000000001e-06 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135380+0000", 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3250000000000001e-06 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135390+0000", 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.7429999999999997e-06 2024-09-11T06:20:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135397+0000", 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9970000000000001e-06 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135455+0000", 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8159999999999999e-05 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:15.135463+0000", 2024-09-11T06:20:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6030000000000005e-06 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127459+0000", 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99199554099999998 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127561+0000", 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000102329 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 3", 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.127635+0000", 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3538e-05 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129214+0000", 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001578695 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129575+0000", 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00036180099999999997 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129633+0000", 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8009e-05 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:16.129681+0000", 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7992999999999999e-05 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.970 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.970 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:55.970 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:55.970 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:55.971 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:55.972 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:55.970+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:56.072 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:56.071+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:56.116 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:56.116 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:20:56.116 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:56.124 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:56.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T06:20:56.209 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:56.208+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:56.263 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 6, 7, 3, 1] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:20:56.263 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:20:56.263 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T06:20:56.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T06:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:56.274 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:56.275 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:56.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:56.308 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:56.307+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:56.375 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:56.373+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:56.429 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:56.429 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.18762168399999, 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:56.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.434 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.18760894600001, 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:56.438 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.187597813, 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.439 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:56.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:56.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.18758722499999, 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:56.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.447 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.18757672999999, 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:56.448 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:56.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:56.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:56.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.187566417, 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.453 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:56.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:56.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.18755587499999, 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:56.457 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:56.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.18754556900001, 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:56.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:56.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.18752999099999, 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:56.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:56.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.18751098600001, 2024-09-11T06:20:56.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:56.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:56.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.127981613, 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:56.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:56.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.127963142, 2024-09-11T06:20:56.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:56.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.483 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.127944652, 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.488 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.12792758399999, 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:56.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.12790955299999, 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.493 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:56.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:56.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.12788736900001, 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:56.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:56.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.501 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.502 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.127869377, 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:56.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.12785172299999, 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.507 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.508 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:56.509 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:56.510 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:56.511 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.12782880699999, 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.512 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:56.513 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.514 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.515 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.516 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 188.12781041900001, 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.517 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:56.518 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.519 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:56.520 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:56.521 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:56.521 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:56.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.521 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:56.521 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:56.521 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:56.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:56.523 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:56.521+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:56.563 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 247, 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "7a868aca-1727-4b78-b18f-580564f1ab22", 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-11T06:16:40.301387+0000", 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-11T06:20:56.193242+0000", 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-11T06:18:57.153745+0000", 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-11T06:20:51.154318+0000", 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5799936, 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-11T06:20:56.564 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 7, 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 3, 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-11T06:20:56.565 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:52.447451+0000", 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:20:56.566 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:20:56.567 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:20:56.568 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:20:56.569 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:20:56.570 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:20:56.571 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.84770965576171875, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-11T06:20:56.572 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:16:58.078189+0000", 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:20:56.573 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:20:56.574 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "22", 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:20:56.575 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 22, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:20:56.576 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:20:56.577 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:20:56.578 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 4.9800000190734863, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 4.9800000190734863, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 4.380000114440918, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 4.380000114440918, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.84770965576171875, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "pool_client.0", 2024-09-11T06:20:56.579 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-11T06:17:07.729638+0000", 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-11T06:20:56.580 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-11T06:20:56.581 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "247", 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 84, 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 247, 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-11T06:20:56.582 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T06:20:56.583 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-11T06:20:56.584 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.585 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 0.84770965576171875, 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.586 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "dba31bd4-e78d-407b-b639-5bb5104f3693", 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:20:56.587 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 245, 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.588 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.589 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.591 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2621452558 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/2621452558", 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/2621452558", 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/2621452558", 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/2621452558", 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d", 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 54, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 92, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 245, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 56, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 747530186 2024-09-11T06:20:56.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/747530186", 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/747530186", 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/747530186", 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/747530186", 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:20:56.598 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1c946778-5c51-4d07-94a2-ada9d70d1bba", 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 15, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 109, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 130, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 244, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 110, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:56.600 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:56.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.603 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4176263936 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/4176263936", 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/4176263936", 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/4176263936", 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/4176263936", 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1833d4e7-d511-4086-bbde-e7822ec6c1f3", 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 245, 2024-09-11T06:20:56.605 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:56.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-11T06:20:56.608 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2301707714 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/2301707714", 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/2301707714", 2024-09-11T06:20:56.610 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/2301707714", 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/2301707714", 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "28e56042-c64d-4193-be5b-752137116220", 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:56.611 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 245, 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6808", 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:56.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6809", 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6810", 2024-09-11T06:20:56.613 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6811", 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.614 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6814", 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6815", 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6812", 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6813", 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2043476445 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6809/2043476445", 2024-09-11T06:20:56.616 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6811/2043476445", 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6815/2043476445", 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6813/2043476445", 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "80e06445-79b9-4069-851a-b5f63a882000", 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:56.617 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 245, 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6816", 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:56.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6817", 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6818", 2024-09-11T06:20:56.619 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6819", 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6822", 2024-09-11T06:20:56.620 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6823", 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6820", 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:56.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6821", 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 213940923 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6817/213940923", 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6819/213940923", 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6823/213940923", 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6821/213940923", 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:56.622 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "05e46d6f-c759-41f4-bfd4-9514c0bd73fb", 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.5891571044921875, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 206, 2024-09-11T06:20:56.623 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6824", 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6825", 2024-09-11T06:20:56.624 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:56.625 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6826", 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6827", 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:56.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6830", 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6831", 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:56.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6828", 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6829", 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3016223649 2024-09-11T06:20:56.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6825/3016223649", 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6827/3016223649", 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6831/3016223649", 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6829/3016223649", 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:20:56.631 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "26bcdc28-2387-4117-9005-399f68fc0439", 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 0.1925201416015625, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 13, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 207, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6800", 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6801", 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6802", 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6803", 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6806", 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6807", 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-11T06:20:56.635 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6804", 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.194:6805", 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2361511015 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.194:6801/2361511015", 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.194:6803/2361511015", 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2361511015", 2024-09-11T06:20:56.636 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2361511015", 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:56.637 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.852226+0000", 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.638877+0000", 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 56 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.638 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.930981+0000", 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 110 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:56.639 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.677178+0000", 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.636635+0000", 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:56.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.104700+0000", 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.641 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:49.150845+0000", 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-11T06:20:56.642 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-11T06:16:48.365417+0000", 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [ 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.3", 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: 6, 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: 3 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-11T06:20:56.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.b", 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 7, 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 4 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 6, 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:56.644 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.645 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [ 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 19, 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 21, 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 23, 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:56.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 25, 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 27, 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 29, 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [ 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "snaps": [ 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "begin": 19, 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: "length": 1 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.648 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.649 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:56.651 INFO:tasks.thrashosds.thrasher:j is {'epoch': 247, 'fsid': '7a868aca-1727-4b78-b18f-580564f1ab22', 'created': '2024-09-11T06:16:40.301387+0000', 'modified': '2024-09-11T06:20:56.193242+0000', 'last_up_change': '2024-09-11T06:18:57.153745+0000', 'last_in_change': '2024-09-11T06:20:51.154318+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T06:16:52.447451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8477096557617188, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T06:16:58.078189+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 0.8477096557617188, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T06:17:07.729638+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '247', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 84, 'snap_epoch': 247, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8477096557617188, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': 'dba31bd4-e78d-407b-b639-5bb5104f3693', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 245, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 2621452558}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 2621452558}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 2621452558}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 2621452558}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 2621452558}]}, 'public_addr': '172.21.15.70:6825/2621452558', 'cluster_addr': '172.21.15.70:6827/2621452558', 'heartbeat_back_addr': '172.21.15.70:6831/2621452558', 'heartbeat_front_addr': '172.21.15.70:6829/2621452558', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 54, 'up_from': 92, 'up_thru': 245, 'down_at': 56, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 747530186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 747530186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 747530186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 747530186}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 747530186}]}, 'public_addr': '172.21.15.70:6817/747530186', 'cluster_addr': '172.21.15.70:6819/747530186', 'heartbeat_back_addr': '172.21.15.70:6823/747530186', 'heartbeat_front_addr': '172.21.15.70:6821/747530186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '1c946778-5c51-4d07-94a2-ada9d70d1bba', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 109, 'up_from': 130, 'up_thru': 244, 'down_at': 110, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 4176263936}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 4176263936}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 4176263936}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 4176263936}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 4176263936}]}, 'public_addr': '172.21.15.70:6809/4176263936', 'cluster_addr': '172.21.15.70:6811/4176263936', 'heartbeat_back_addr': '172.21.15.70:6815/4176263936', 'heartbeat_front_addr': '172.21.15.70:6813/4176263936', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1833d4e7-d511-4086-bbde-e7822ec6c1f3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 245, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 2301707714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 2301707714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 2301707714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 2301707714}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 2301707714}]}, 'public_addr': '172.21.15.70:6801/2301707714', 'cluster_addr': '172.21.15.70:6803/2301707714', 'heartbeat_back_addr': '172.21.15.70:6807/2301707714', 'heartbeat_front_addr': '172.21.15.70:6805/2301707714', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '28e56042-c64d-4193-be5b-752137116220', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 245, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6808', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6809', 'nonce': 2043476445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6810', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6811', 'nonce': 2043476445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6814', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6815', 'nonce': 2043476445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6812', 'nonce': 2043476445}, {'type': 'v1', 'addr': '172.21.15.194:6813', 'nonce': 2043476445}]}, 'public_addr': '172.21.15.194:6809/2043476445', 'cluster_addr': '172.21.15.194:6811/2043476445', 'heartbeat_back_addr': '172.21.15.194:6815/2043476445', 'heartbeat_front_addr': '172.21.15.194:6813/2043476445', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '80e06445-79b9-4069-851a-b5f63a882000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 245, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6816', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6817', 'nonce': 213940923}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6818', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6819', 'nonce': 213940923}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6822', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6823', 'nonce': 213940923}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6820', 'nonce': 213940923}, {'type': 'v1', 'addr': '172.21.15.194:6821', 'nonce': 213940923}]}, 'public_addr': '172.21.15.194:6817/213940923', 'cluster_addr': '172.21.15.194:6819/213940923', 'heartbeat_back_addr': '172.21.15.194:6823/213940923', 'heartbeat_front_addr': '172.21.15.194:6821/213940923', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '05e46d6f-c759-41f4-bfd4-9514c0bd73fb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.5891571044921875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 206, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6824', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6825', 'nonce': 3016223649}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6826', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6827', 'nonce': 3016223649}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6830', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6831', 'nonce': 3016223649}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6828', 'nonce': 3016223649}, {'type': 'v1', 'addr': '172.21.15.194:6829', 'nonce': 3016223649}]}, 'public_addr': '172.21.15.194:6825/3016223649', 'cluster_addr': '172.21.15.194:6827/3016223649', 'heartbeat_back_addr': '172.21.15.194:6831/3016223649', 'heartbeat_front_addr': '172.21.15.194:6829/3016223649', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '26bcdc28-2387-4117-9005-399f68fc0439', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1925201416015625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 207, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6800', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6801', 'nonce': 2361511015}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6802', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6803', 'nonce': 2361511015}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6806', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6807', 'nonce': 2361511015}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6804', 'nonce': 2361511015}, {'type': 'v1', 'addr': '172.21.15.194:6805', 'nonce': 2361511015}]}, 'public_addr': '172.21.15.194:6801/2361511015', 'cluster_addr': '172.21.15.194:6803/2361511015', 'heartbeat_back_addr': '172.21.15.194:6807/2361511015', 'heartbeat_front_addr': '172.21.15.194:6805/2361511015', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.852226+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.638877+0000', 'dead_epoch': 56}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.930981+0000', 'dead_epoch': 110}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.677178+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.636635+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.104700+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:49.150845+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T06:16:48.365417+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.3', 'osds': [6, 3]}], 'pg_upmap_items': [{'pgid': '3.b', 'mappings': [{'from': 7, 'to': 4}, {'from': 6, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 19, 'length': 1}, {'begin': 21, 'length': 1}, {'begin': 23, 'length': 1}, {'begin': 25, 'length': 1}, {'begin': 27, 'length': 1}, {'begin': 29, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 19, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T06:20:56.651 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.3 2024-09-11T06:20:56.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.3 2024-09-11T06:20:56.652 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:56.653 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:56.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:20:56.653 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:56.650+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:56.751 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:56.750+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:56.797 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:20:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:20:56.797 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:56.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:20:56.852 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:56.851+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:56.915 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:56.915 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.580373535, 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:20:56.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:20:56.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:56.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:56.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.534501675999998, 2024-09-11T06:20:56.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:20:56.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.928 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:191036 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.311386710000001, 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659934617, 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 191036 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601548+0000", 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6700000000000003e-07 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601552+0000", 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0659999999999997e-06 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601558+0000", 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-06 2024-09-11T06:20:56.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601561+0000", 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.253e-06 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601612+0000", 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1629000000000003e-05 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:56.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601623+0000", 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0397000000000001e-05 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261189+0000", 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659566337 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261380+0000", 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019126000000000001 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261482+0000", 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101248 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224552 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3376128~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674785565000001, 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061927471999999997, 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.934 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224552 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:20:56.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238149+0000", 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-07 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238151+0000", 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8810000000000001e-06 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238156+0000", 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238161+0000", 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4870000000000004e-06 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299444+0000", 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061282879999999998 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299839+0000", 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039492900000000003 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300076+0000", 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000237013 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224553 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3378176~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674767789999997, 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108599, 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224553 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238168+0000", 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238174+0000", 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6849999999999998e-06 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238178+0000", 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300107+0000", 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061928578999999997 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300183+0000", 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6075999999999995e-05 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300275+0000", 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1576000000000005e-05 2024-09-11T06:20:56.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224554 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3380224~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674750297999999, 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274642999999998, 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224554 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238184+0000", 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3500000000000002e-07 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238186+0000", 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.756e-06 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238191+0000", 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6180000000000003e-06 2024-09-11T06:20:56.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238196+0000", 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999999e-06 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300304+0000", 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108236999999997 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300376+0000", 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1594000000000006e-05 2024-09-11T06:20:56.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300458+0000", 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224555 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3382272~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674733080999999, 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062436684999999999, 2024-09-11T06:20:56.947 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224555 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238203+0000", 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:20:56.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238208+0000", 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238213+0000", 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-06 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300487+0000", 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274312999999998 2024-09-11T06:20:56.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300557+0000", 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0238000000000001e-05 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300637+0000", 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0272000000000007e-05 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224556 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3384320~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674583263000002, 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062473433000000002, 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224556 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:20:56.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238354+0000", 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6690000000000002e-06 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238362+0000", 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370000000000004e-06 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238367+0000", 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300664+0000", 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062297407999999999 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300736+0000", 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2103999999999999e-05 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300824+0000", 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7484999999999993e-05 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224557 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3386368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674559475999999, 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062640965000000007, 2024-09-11T06:20:56.956 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224557 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238375+0000", 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238377+0000", 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.872e-06 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238382+0000", 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.93e-06 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238387+0000", 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300852+0000", 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062465510000000002 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300929+0000", 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6565999999999998e-05 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301015+0000", 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6508999999999995e-05 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224558 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3388416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674541662000003, 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062861117999999994, 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224558 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:20:56.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238395+0000", 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0619999999999999e-06 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238400+0000", 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1259999999999997e-06 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238403+0000", 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7929999999999999e-06 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301051+0000", 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062647184999999994 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301151+0000", 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9999000000000003e-05 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301253+0000", 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102618 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224559 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3390464~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674525449999997, 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063237010999999996, 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224559 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238409+0000", 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4400000000000001e-07 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238410+0000", 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.782e-06 2024-09-11T06:20:56.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238416+0000", 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.356e-06 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238420+0000", 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0210000000000001e-06 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301280+0000", 2024-09-11T06:20:56.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062859905999999993 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301460+0000", 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018026699999999999 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301645+0000", 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018543499999999999 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224560 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3392512~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674507409999997, 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063424783999999998, 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224560 2024-09-11T06:20:56.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238427+0000", 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.03e-07 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238429+0000", 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8330000000000001e-06 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238434+0000", 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3360000000000002e-06 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238438+0000", 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301670+0000", 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063231417999999998 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301763+0000", 2024-09-11T06:20:56.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3914999999999998e-05 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301851+0000", 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7705000000000001e-05 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224561 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3394560~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674490677000001, 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063589239000000006, 2024-09-11T06:20:56.975 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224561 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238445+0000", 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6160000000000001e-06 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238451+0000", 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238456+0000", 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9649999999999999e-06 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301876+0000", 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063419918000000006 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301950+0000", 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4187e-05 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302032+0000", 2024-09-11T06:20:56.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2168000000000003e-05 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224562 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3396608~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674466047000003, 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063734823999999995, 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224562 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238470+0000", 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0080000000000001e-06 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238476+0000", 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8209999999999998e-06 2024-09-11T06:20:56.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238480+0000", 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2250000000000002e-06 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302056+0000", 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063575452000000005 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302120+0000", 2024-09-11T06:20:56.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4689000000000004e-05 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302203+0000", 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2231000000000006e-05 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224563 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3398656~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674448058000003, 2024-09-11T06:20:56.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063882994999999998, 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224563 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:56.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238488+0000", 2024-09-11T06:20:56.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238493+0000", 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2279999999999998e-06 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238497+0000", 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9539999999999998e-06 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302225+0000", 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063728578999999994 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302291+0000", 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5953999999999999e-05 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302369+0000", 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7340000000000002e-05 2024-09-11T06:20:56.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224564 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3400704~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674432168999999, 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064035277000000002, 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224564 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238504+0000", 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.578e-06 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238509+0000", 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238513+0000", 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302390+0000", 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063877220999999998 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302454+0000", 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3812999999999994e-05 2024-09-11T06:20:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302537+0000", 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812000000000006e-05 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224565 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3402752~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674415848999999, 2024-09-11T06:20:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064466108999999994, 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224565 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:56.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238520+0000", 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238526+0000", 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.429e-06 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238530+0000", 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302559+0000", 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064029364000000005 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302843+0000", 2024-09-11T06:20:56.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028354600000000003 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302984+0000", 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014120100000000001 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224566 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3404800~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674398402999998, 2024-09-11T06:20:56.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064698612000000003, 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224566 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:56.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238536+0000", 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0600000000000001e-07 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:57.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238537+0000", 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.68e-06 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238543+0000", 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4659999999999998e-06 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238547+0000", 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1679999999999997e-06 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303014+0000", 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064467177000000001 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303085+0000", 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0916999999999999e-05 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303234+0000", 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014889800000000001 2024-09-11T06:20:57.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224567 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3406848~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674381820999997, 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064927740999999997, 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:57.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224567 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4700000000000002e-07 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238554+0000", 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238561+0000", 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238565+0000", 2024-09-11T06:20:57.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303258+0000", 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064692538999999993 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303353+0000", 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5149000000000007e-05 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303480+0000", 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012678 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:236293 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e242)", 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:51.180476+0000", 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.7324580850000002, 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.985125531, 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:20:57.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236293 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180476+0000", 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:20:57.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180476+0000", 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180478+0000", 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3180000000000001e-06 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180488+0000", 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5829999999999996e-06 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180505+0000", 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7549000000000001e-05 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180515+0000", 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0259e-05 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180584+0000", 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8421000000000001e-05 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180592+0000", 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1270000000000003e-06 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:52.165588+0000", 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98499574599999995 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:52.165601+0000", 2024-09-11T06:20:57.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3528e-05 2024-09-11T06:20:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:20:57.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:20:57.013 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:57.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:20:57.015 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:57.013+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:57.115 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:57.114+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:57.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:20:57.160 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:20:57.160 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:20:57.161 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:20:57.161 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:20:57.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:20:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-11T06:20:57.207 INFO:teuthology.orchestra.run.smithi070.stderr:clear 3.3 pg_upmap mapping 2024-09-11T06:20:57.216 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:57.215+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:57.272 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:57.272 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:57.289 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:57.305 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:57.317 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:57.316+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:57.321 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:57.321 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:57.323 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:57.323 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:57.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:20:57.339 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:57.339 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:57.356 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:57.373 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:57.391 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:57.391 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:57.418 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:57.417+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:57.443 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:57.443 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:57.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:20:57.519 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:57.518+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:57.556 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:57.556 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:57.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:20:57.649 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:57.648+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:57.708 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:57.708 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:57.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:20:57.758 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:57.757+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:57.822 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:57.821+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:57.860 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:57.860 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:57.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:20:57.923 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:57.922+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:57.972 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:57.972 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:57.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:20:58.024 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:58.023+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:58.125 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:58.125 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:58.125 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:58.124+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:58.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:20:58.226 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:58.225+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:58.241 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:58.241 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:58.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:20:58.327 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:58.326+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:58.365 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:58.365 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:58.374 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:20:58.458 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:58.457+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:58.518 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:58.518 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:58.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:20:58.528 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:58.527+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:58.630 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:58.629+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:58.670 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:58.670 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:58.679 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:20:58.763 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:20:58.762+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:20:58.823 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:58.824 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:58.832 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:20:58.833 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:58.831+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:58.933 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:58.932+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:58.976 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:58.976 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:58.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:20:59.033 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:20:59.032+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:20:59.088 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:59.088 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:59.097 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:20:59.133 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:59.132+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:59.200 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:59.200 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:59.209 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:20:59.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T06:20:59.252 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:20:59.251+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:20:59.311 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:59.311 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:59.319 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:20:59.361 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:59.360+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:59.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:20:59.447 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:20:59.446+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:20:59.464 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:59.464 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:59.472 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:20:59.523 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:20:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:20:59.536 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:20:59.535+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:20:59.539 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:20:59.539 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:20:59.555 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:20:59.555 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:20:59.571 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:20:59.571 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:20:59.576 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:20:59.576 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:20:59.585 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:20:59.587 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:20:59.588 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:20:59.604 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:20:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:20:59.620 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:20:59.620 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:20:59.637 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:20:59.637 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:20:59.637 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:20:59.636+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:20:59.729 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:59.729 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:20:59.729 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:20:59.729 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:20:59.729 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:59.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:20:59.738 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:59.738+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:20:59.840 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:20:59.839+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:20:59.842 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27340 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 2965504~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.600777924, 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017654398000000002, 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27340 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.843 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239840+0000", 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239841+0000", 2024-09-11T06:20:59.844 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9499999999999998e-07 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239842+0000", 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6220000000000001e-06 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239847+0000", 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7140000000000001e-06 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.845 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239850+0000", 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8090000000000001e-06 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257296+0000", 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017446351999999998 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257384+0000", 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8174e-05 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.846 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257495+0000", 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110432 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27341 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3293184~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.60076518599999, 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018197264000000001, 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.847 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27341 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.848 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239853+0000", 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.23e-07 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.849 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239854+0000", 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.178e-06 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239859+0000", 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239861+0000", 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.666e-06 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.850 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257532+0000", 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017670811000000002 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.257588+0000", 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6233000000000002e-05 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258050+0000", 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00046208099999999998 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.851 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27342 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3620864~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.600754053, 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018429836000000002, 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27342 2024-09-11T06:20:59.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239864+0000", 2024-09-11T06:20:59.853 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239866+0000", 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.139e-06 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239869+0000", 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7680000000000002e-06 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239872+0000", 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.638e-06 2024-09-11T06:20:59.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258099+0000", 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018227058000000001 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258188+0000", 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8690000000000006e-05 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258294+0000", 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106335 2024-09-11T06:20:59.855 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27343 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3948544~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.60074346499999, 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018715505, 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.856 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27343 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:59.857 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239875+0000", 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.17e-07 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239876+0000", 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.108e-06 2024-09-11T06:20:59.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239880+0000", 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7960000000000002e-06 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239882+0000", 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5289999999999998e-06 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258344+0000", 2024-09-11T06:20:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018461241 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258425+0000", 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.1748000000000004e-05 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258590+0000", 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000164866 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.860 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27344 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4276224~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.60073297, 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018836057, 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27344 2024-09-11T06:20:59.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239885+0000", 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.862 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239886+0000", 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239887+0000", 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239890+0000", 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.709e-06 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239893+0000", 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5459999999999998e-06 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258622+0000", 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018728720000000001 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.864 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258665+0000", 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3155999999999998e-05 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258721+0000", 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6629999999999998e-05 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.865 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27345 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4603904~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.60072265700001, 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019004696000000001, 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27345 2024-09-11T06:20:59.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.867 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239896+0000", 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.03e-07 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239897+0000", 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1540000000000001e-06 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239901+0000", 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7000000000000002e-06 2024-09-11T06:20:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239903+0000", 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5000000000000002e-06 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258766+0000", 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018862923 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258823+0000", 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7268999999999997e-05 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258900+0000", 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6946999999999994e-05 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27346 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4931584~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.60071211499999, 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019155385, 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.871 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27346 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.872 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239906+0000", 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239907+0000", 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1030000000000001e-06 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.873 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239911+0000", 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6839999999999998e-06 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239914+0000", 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.525e-06 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258933+0000", 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019019319999999999 2024-09-11T06:20:59.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.258986+0000", 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2626000000000001e-05 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259062+0000", 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5922999999999998e-05 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.875 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27347 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5259264~16384 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.60070180899999, 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019273275999999999, 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27347 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.876 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239916+0000", 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239917+0000", 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0800000000000001e-07 2024-09-11T06:20:59.877 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239918+0000", 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.097e-06 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239922+0000", 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999999e-06 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239926+0000", 2024-09-11T06:20:59.878 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7960000000000003e-06 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259090+0000", 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019163278999999998 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259131+0000", 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1669999999999999e-05 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.879 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259190+0000", 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8415999999999998e-05 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27377 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.600686231, 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019405535000000002, 2024-09-11T06:20:59.880 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27377 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:59.881 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239932+0000", 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5199999999999998e-07 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.882 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239934+0000", 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239940+0000", 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.648e-06 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239945+0000", 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2739999999999998e-06 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.883 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259216+0000", 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019271159 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259258+0000", 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2064999999999998e-05 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259338+0000", 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9207000000000002e-05 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.884 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27381 3.f 3:f7c12b4e:::rbd_header.116d770b822:head [watch reconnect cookie 139721795858736 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.60066722600001, 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.020649872, 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27381 2024-09-11T06:20:59.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.886 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239951+0000", 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0800000000000001e-07 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239957+0000", 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0619999999999997e-06 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239964+0000", 2024-09-11T06:20:59.887 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0659999999999998e-06 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.239970+0000", 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.913e-06 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259386+0000", 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019415321999999999 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.888 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.259464+0000", 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8658000000000005e-05 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.260601+0000", 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0011365430000000001 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27873 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3801088~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:59.889 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.54113785300001, 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017716928, 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27873 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.890 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299480+0000", 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299481+0000", 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4999999999999998e-07 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299482+0000", 2024-09-11T06:20:59.891 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7e-06 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299489+0000", 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6660000000000002e-06 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299494+0000", 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3900000000000003e-06 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.892 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.316980+0000", 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017486689999999999 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317020+0000", 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9335000000000002e-05 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317197+0000", 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00017779699999999999 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.893 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27874 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 3915776~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.54111938200001, 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018023879, 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.894 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27874 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:59.895 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299499+0000", 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299501+0000", 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8199999999999999e-06 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.896 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299508+0000", 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9820000000000002e-06 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299512+0000", 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4120000000000003e-06 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317241+0000", 2024-09-11T06:20:59.897 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.017728226 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317321+0000", 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0646e-05 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317523+0000", 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000201468 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.898 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27875 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4128768~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.541100892, 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018143862, 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.899 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27875 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299517+0000", 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.900 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299518+0000", 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3599999999999999e-07 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299520+0000", 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.809e-06 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299525+0000", 2024-09-11T06:20:59.901 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6099999999999997e-06 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299530+0000", 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3640000000000001e-06 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317554+0000", 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018024780000000001 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317598+0000", 2024-09-11T06:20:59.902 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4067999999999999e-05 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317661+0000", 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2895e-05 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27876 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4243456~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:59.903 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.541083824, 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018357215, 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27876 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:59.904 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.905 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.905 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299534+0000", 2024-09-11T06:20:59.905 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.905 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.905 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299535+0000", 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.39e-07 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299536+0000", 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.657e-06 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299543+0000", 2024-09-11T06:20:59.906 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7610000000000002e-06 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299547+0000", 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2749999999999997e-06 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317699+0000", 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018151052000000001 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317785+0000", 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6779000000000004e-05 2024-09-11T06:20:59.907 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317892+0000", 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000106352 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27877 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4456448~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.541065793, 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018483836999999999, 2024-09-11T06:20:59.908 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27877 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.909 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299552+0000", 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299553+0000", 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.4799999999999999e-07 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.910 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299559+0000", 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1870000000000002e-06 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299565+0000", 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299569+0000", 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1269999999999996e-06 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.911 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317922+0000", 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018353133000000001 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.317975+0000", 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3148e-05 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318036+0000", 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1068999999999994e-05 2024-09-11T06:20:59.912 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27878 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4571136~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.54104360900001, 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018697825000000001, 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.913 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27878 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.914 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299575+0000", 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6100000000000002e-07 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299577+0000", 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.866e-06 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.915 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299583+0000", 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.0090000000000004e-06 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299587+0000", 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4000000000000002e-06 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318070+0000", 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018482579999999998 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.916 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318149+0000", 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.9447e-05 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318272+0000", 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012316200000000001 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.917 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27879 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4784128~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.541025617, 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018799593, 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27879 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.918 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299593+0000", 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4499999999999997e-07 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.919 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299595+0000", 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.784e-06 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299601+0000", 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8850000000000004e-06 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299605+0000", 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.920 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318297+0000", 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018691940000000001 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318338+0000", 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1393999999999997e-05 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318392+0000", 2024-09-11T06:20:59.921 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3934999999999998e-05 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27880 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 4898816~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.541007963, 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019056937999999999, 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.922 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27880 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299610+0000", 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.923 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299611+0000", 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2500000000000001e-07 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299612+0000", 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6139999999999999e-06 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299618+0000", 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7189999999999998e-06 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.924 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299628+0000", 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6919999999999997e-06 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318424+0000", 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.018795879000000001 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.925 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318542+0000", 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000118835 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318667+0000", 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000124874 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.926 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27881 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5111808~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.54098504699999, 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019146094999999998, 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27881 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.927 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299633+0000", 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299634+0000", 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.1e-07 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.928 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299636+0000", 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.99e-06 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299641+0000", 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1710000000000001e-06 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299646+0000", 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0599999999999998e-06 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.929 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318682+0000", 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019035870999999999 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318720+0000", 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8377999999999997e-05 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318779+0000", 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9314999999999997e-05 2024-09-11T06:20:59.930 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:27882 3.f 3:f75285c3:::rbd_data.116d770b822.0000000000000002:13 [read 5226496~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 191.54096665899999, 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019281544000000001, 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:20:59.931 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 27882 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:20:59.932 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299652+0000", 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299655+0000", 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9560000000000002e-06 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299661+0000", 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1190000000000002e-06 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.299665+0000", 2024-09-11T06:20:59.933 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.408e-06 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318805+0000", 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.019139896999999999 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318861+0000", 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5436999999999998e-05 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:17:48.318933+0000", 2024-09-11T06:20:59.934 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2348000000000006e-05 2024-09-11T06:20:59.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.935 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.935 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:20:59.935 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:20:59.935 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:20:59.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:20:59.981 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:20:59.980+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:21:00.042 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:00.041+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:00.050 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:21:00.051 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:00.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:21:00.129 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-11T06:21:00.142 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:00.141+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:00.213 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:00.213 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:00.213 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:21:00.214 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:21:00.214 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:00.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:21:00.268 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:00.267+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:00.330 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153492 3.1c 3:3c85db29:::rbd_data.116ddf3f5156.0000000000000018:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.996127051000002, 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.795944965, 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153492 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332560+0000", 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332562+0000", 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.03e-06 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332847+0000", 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028474799999999998 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332869+0000", 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2229e-05 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332880+0000", 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0268999999999999e-05 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332960+0000", 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0078000000000001e-05 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.332969+0000", 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7999999999999993e-06 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123405+0000", 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79043541299999998 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123534+0000", 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012949200000000001 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.123676+0000", 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014132399999999999 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:00.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128241+0000", 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045652369999999998 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128424+0000", 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018270999999999999 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128467+0000", 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3316000000000003e-05 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128505+0000", 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8318999999999997e-05 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:154013 3.1c 3:3ee93d61:::rbd_data.116ddf3f5156.0000000000000019:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.950255192, 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.75040263299999999, 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:00.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 154013 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378432+0000", 2024-09-11T06:21:00.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378435+0000", 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378733+0000", 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029823799999999999 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378752+0000", 2024-09-11T06:21:00.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.895e-05 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378761+0000", 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2490000000000007e-06 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378829+0000", 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8008000000000003e-05 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.378840+0000", 2024-09-11T06:21:00.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1430000000000001e-05 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125782+0000", 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.74694115999999999 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125935+0000", 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000153494 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.126077+0000", 2024-09-11T06:21:00.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014160600000000001 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128365+0000", 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022886069999999998 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128745+0000", 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038012400000000002 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:00.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128802+0000", 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6949e-05 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128835+0000", 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2397999999999997e-05 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:191036 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:21:00.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.727140226000003, 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659934617, 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 191036 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:21:00.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601547+0000", 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601548+0000", 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6700000000000003e-07 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601552+0000", 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0659999999999997e-06 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601558+0000", 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8599999999999998e-06 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601561+0000", 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.253e-06 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601612+0000", 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1629000000000003e-05 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:04.601623+0000", 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0397000000000001e-05 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261189+0000", 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.659566337 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261380+0000", 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019126000000000001 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:05.261482+0000", 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101248 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224552 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3376128~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:21:00.348 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090539081000003, 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061927471999999997, 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224552 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:21:00.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238148+0000", 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238149+0000", 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-07 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238151+0000", 2024-09-11T06:21:00.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8810000000000001e-06 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238156+0000", 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7289999999999997e-06 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238161+0000", 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4870000000000004e-06 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299444+0000", 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061282879999999998 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.299839+0000", 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039492900000000003 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300076+0000", 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000237013 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224553 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3378176~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090521305999999, 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108599, 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224553 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.353 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:21:00.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238166+0000", 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7799999999999997e-07 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238168+0000", 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238174+0000", 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6849999999999998e-06 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238178+0000", 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6460000000000001e-06 2024-09-11T06:21:00.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300107+0000", 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.061928578999999997 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300183+0000", 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6075999999999995e-05 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300275+0000", 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1576000000000005e-05 2024-09-11T06:21:00.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224554 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3380224~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090503814000002, 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274642999999998, 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224554 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238183+0000", 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238184+0000", 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3500000000000002e-07 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238186+0000", 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.756e-06 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238191+0000", 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6180000000000003e-06 2024-09-11T06:21:00.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238196+0000", 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4299999999999999e-06 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300304+0000", 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062108236999999997 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300376+0000", 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1594000000000006e-05 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300458+0000", 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224555 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3382272~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.362 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090486597000002, 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062436684999999999, 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224555 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:21:00.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238201+0000", 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1399999999999998e-07 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238203+0000", 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.759e-06 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238208+0000", 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238213+0000", 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2300000000000002e-06 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300487+0000", 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062274312999999998 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300557+0000", 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0238000000000001e-05 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300637+0000", 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0272000000000007e-05 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.366 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224556 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3384320~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090336778999998, 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062473433000000002, 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224556 2024-09-11T06:21:00.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238351+0000", 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000004e-07 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238354+0000", 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6690000000000002e-06 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238362+0000", 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9370000000000004e-06 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238367+0000", 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300664+0000", 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062297407999999999 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300736+0000", 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2103999999999999e-05 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300824+0000", 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7484999999999993e-05 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224557 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3386368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090312992000001, 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062640965000000007, 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224557 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238374+0000", 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238375+0000", 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7899999999999999e-07 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238377+0000", 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.872e-06 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238382+0000", 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.93e-06 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238387+0000", 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300852+0000", 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062465510000000002 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.300929+0000", 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6565999999999998e-05 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301015+0000", 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6508999999999995e-05 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224558 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3388416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090295177999998, 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062861117999999994, 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224558 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238392+0000", 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3500000000000002e-07 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238395+0000", 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0619999999999999e-06 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238400+0000", 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1259999999999997e-06 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238403+0000", 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7929999999999999e-06 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301051+0000", 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062647184999999994 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301151+0000", 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9999000000000003e-05 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301253+0000", 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102618 2024-09-11T06:21:00.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224559 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3390464~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090278966, 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063237010999999996, 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224559 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238408+0000", 2024-09-11T06:21:00.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238409+0000", 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4400000000000001e-07 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238410+0000", 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.782e-06 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238416+0000", 2024-09-11T06:21:00.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.356e-06 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238420+0000", 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0210000000000001e-06 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301280+0000", 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.062859905999999993 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301460+0000", 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018026699999999999 2024-09-11T06:21:00.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301645+0000", 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018543499999999999 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224560 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3392512~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090260925999999, 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063424783999999998, 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224560 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238426+0000", 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238427+0000", 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.03e-07 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238429+0000", 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8330000000000001e-06 2024-09-11T06:21:00.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238434+0000", 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3360000000000002e-06 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238438+0000", 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2740000000000001e-06 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301670+0000", 2024-09-11T06:21:00.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063231417999999998 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301763+0000", 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3914999999999998e-05 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301851+0000", 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7705000000000001e-05 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224561 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3394560~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090244192999997, 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063589239000000006, 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224561 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238443+0000", 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1600000000000002e-07 2024-09-11T06:21:00.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238445+0000", 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6160000000000001e-06 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238451+0000", 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0689999999999998e-06 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238456+0000", 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9649999999999999e-06 2024-09-11T06:21:00.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301876+0000", 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063419918000000006 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.301950+0000", 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4187e-05 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302032+0000", 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2168000000000003e-05 2024-09-11T06:21:00.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224562 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3396608~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090219562999998, 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063734823999999995, 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224562 2024-09-11T06:21:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238468+0000", 2024-09-11T06:21:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9799999999999999e-07 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238470+0000", 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0080000000000001e-06 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238476+0000", 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8209999999999998e-06 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238480+0000", 2024-09-11T06:21:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2250000000000002e-06 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302056+0000", 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063575452000000005 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302120+0000", 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4689000000000004e-05 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302203+0000", 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2231000000000006e-05 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224563 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3398656~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090201573999998, 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063882994999999998, 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224563 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238486+0000", 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238488+0000", 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-11T06:21:00.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238493+0000", 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2279999999999998e-06 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238497+0000", 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9539999999999998e-06 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302225+0000", 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063728578999999994 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302291+0000", 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5953999999999999e-05 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302369+0000", 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7340000000000002e-05 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224564 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3400704~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090185685000002, 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064035277000000002, 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224564 2024-09-11T06:21:00.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238502+0000", 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0899999999999997e-07 2024-09-11T06:21:00.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238504+0000", 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.578e-06 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238509+0000", 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1250000000000001e-06 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238513+0000", 2024-09-11T06:21:00.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4190000000000004e-06 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302390+0000", 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.063877220999999998 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302454+0000", 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3812999999999994e-05 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302537+0000", 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812000000000006e-05 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224565 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3402752~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090169365000001, 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064466108999999994, 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224565 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238518+0000", 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1699999999999998e-07 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238520+0000", 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.632e-06 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238526+0000", 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.429e-06 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238530+0000", 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.42e-06 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302559+0000", 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064029364000000005 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302843+0000", 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028354600000000003 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.302984+0000", 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014120100000000001 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224566 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3404800~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.410 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090151919, 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064698612000000003, 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224566 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:21:00.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238535+0000", 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238536+0000", 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0600000000000001e-07 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238537+0000", 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.68e-06 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238543+0000", 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4659999999999998e-06 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238547+0000", 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1679999999999997e-06 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303014+0000", 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064467177000000001 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303085+0000", 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0916999999999999e-05 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303234+0000", 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014889800000000001 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:224567 3.10 3:0f5f6e78:::rbd_data.116d435f8f88.0000000000000005:53 [read 3406848~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e199)", 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.090135337, 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064927740999999997, 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224567 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:21:00.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238552+0000", 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4700000000000002e-07 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238554+0000", 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.846e-06 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238561+0000", 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6989999999999997e-06 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.238565+0000", 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2810000000000002e-06 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303258+0000", 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.064692538999999993 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303353+0000", 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5149000000000007e-05 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:09.303480+0000", 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012678 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:236293 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e242)", 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:51.180476+0000", 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1482116009999999, 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.985125531, 2024-09-11T06:21:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236293 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180476+0000", 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180476+0000", 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180478+0000", 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3180000000000001e-06 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180488+0000", 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5829999999999996e-06 2024-09-11T06:21:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180505+0000", 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7549000000000001e-05 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180515+0000", 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0259e-05 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180584+0000", 2024-09-11T06:21:00.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8421000000000001e-05 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:51.180592+0000", 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1270000000000003e-06 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:52.165588+0000", 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98499574599999995 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:52.165601+0000", 2024-09-11T06:21:00.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3528e-05 2024-09-11T06:21:00.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.424 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:00.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:21:00.426 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:21:00.424+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:21:00.529 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:00.528+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:00.569 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:21:00.570 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:00.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:21:00.629 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:00.629+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:00.682 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:21:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:21:00.682 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:00.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:21:00.731 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:00.730+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:00.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:00.831+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 120.71173284699999, 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:21:00.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715487984999996, 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:21:00.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:21:00.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:21:00.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715437073999993, 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:21:00.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.851 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.71524977, 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:21:00.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:21:00.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715212809999997, 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:21:00.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:21:00.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:21:00.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715187952999997, 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:21:00.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:21:00.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.869 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715147989000002, 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:21:00.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:21:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:21:00.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:21:00.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715117613000004, 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:21:00.875 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:21:00.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:21:00.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715096846999998, 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.881 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:21:00.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:21:00.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:21:00.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715063975999996, 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:21:00.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:21:00.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:21:00.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715044117999994, 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715023940999998, 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:21:00.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.715012576000007, 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:21:00.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.714985139000007, 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:21:00.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:21:00.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.714950883, 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.914 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:21:00.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:21:00.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:21:00.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.714937419999998, 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.920 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:21:00.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.925 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.714905690999998, 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:21:00.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:21:00.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:21:00.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.714893532999994, 2024-09-11T06:21:00.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:21:00.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:21:00.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.714868683999995, 2024-09-11T06:21:00.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:21:00.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:21:00.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.714855455000006, 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:00.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:21:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:00.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.947 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:00.948 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:00.948 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:00.949 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:21:00.948+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:21:00.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:21:01.050 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:01.049+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:01.093 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:01.093 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:21:01.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:236970 3.3 3.5a749323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e251)", 2024-09-11T06:21:01.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:01.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.91215128899999998, 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.91217482500000002, 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236970 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:01.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180652+0000", 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.61e-06 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180659+0000", 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7540000000000006e-06 2024-09-11T06:21:01.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180672+0000", 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3200999999999999e-05 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180682+0000", 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3239999999999992e-06 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180748+0000", 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6599000000000004e-05 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180757+0000", 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.799e-06 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 1 2024-09-11T06:21:01.097 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:01.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:21:01.151 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:01.150+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:01.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:01.251+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:01.255 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:21:01.256 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:21:01.256 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:01.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:21:01.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:01.352+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:01.369 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:21:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:21:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:21:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:21:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 221.563853736, 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:21:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:21:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.193420438999993, 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:21:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:21:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:21:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:21:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:21:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.191017058, 2024-09-11T06:21:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:21:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:21:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153432 3.f 3:f42e81df:::rbd_data.116ddf3f5156.000000000000000f:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.036496916000004, 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79802703600000002, 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153432 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330773+0000", 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.278e-06 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330953+0000", 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017961999999999999 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330983+0000", 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0188e-05 2024-09-11T06:21:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330994+0000", 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331072+0000", 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8141999999999998e-05 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331081+0000", 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2890000000000003e-06 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125207+0000", 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79412554300000004 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125321+0000", 2024-09-11T06:21:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011482299999999999 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125455+0000", 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013386800000000001 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128673+0000", 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032178269999999999 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128700+0000", 2024-09-11T06:21:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128754+0000", 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4716999999999998e-05 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128798+0000", 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3448000000000001e-05 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161946 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 948224~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.478225523999996, 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054041921999999999, 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161946 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890912+0000", 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018701760000000001 2024-09-11T06:21:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890917+0000", 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890928+0000", 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896999999999999e-05 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890935+0000", 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7149999999999998e-06 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942905+0000", 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051969594000000001 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942980+0000", 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4464999999999999e-05 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943084+0000", 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104558 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161955 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1095680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.476124630000001, 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053898585999999998, 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161955 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891145+0000", 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-11T06:21:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891151+0000", 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891156+0000", 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944860+0000", 2024-09-11T06:21:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053704094000000001 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944943+0000", 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3394999999999997e-05 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945042+0000", 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000005e-05 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161956 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1112064~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.476105396999998, 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054087369000000003, 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161956 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892929+0000", 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001766349 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892933+0000", 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892944+0000", 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0479000000000001e-05 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892950+0000", 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.708e-06 2024-09-11T06:21:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945075+0000", 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052124987999999997 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945154+0000", 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8792e-05 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945250+0000", 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5638999999999997e-05 2024-09-11T06:21:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161965 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1259520~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.474214177999997, 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053970817999999997, 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161965 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894904+0000", 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018509830000000001 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894909+0000", 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.087e-06 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894916+0000", 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894922+0000", 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.767e-06 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946853+0000", 2024-09-11T06:21:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931484999999999 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946931+0000", 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7737000000000005e-05 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947024+0000", 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3546000000000002e-05 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161974 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1406976~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.472157668999998, 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053855649999999998, 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161974 2024-09-11T06:21:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895113+0000", 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895119+0000", 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:21:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895124+0000", 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948788+0000", 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053664195999999997 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948866+0000", 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7417999999999996e-05 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948966+0000", 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9907000000000004e-05 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161975 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1423360~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.472136613000004, 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054030427999999998, 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161975 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896902+0000", 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017710829999999999 2024-09-11T06:21:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896910+0000", 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896919+0000", 2024-09-11T06:21:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7310000000000005e-06 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896926+0000", 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948997+0000", 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052071477999999997 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949068+0000", 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-05 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949162+0000", 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3071000000000004e-05 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161984 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1570816~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.470240708000006, 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053945050000000001, 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161984 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898905+0000", 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001878036 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898910+0000", 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898922+0000", 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-05 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898928+0000", 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950784+0000", 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051855483000000001 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950853+0000", 2024-09-11T06:21:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9239000000000006e-05 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950972+0000", 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118876 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161994 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1734656~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:21:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.468106762000005, 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053886363999999999, 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161994 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:21:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899163+0000", 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899170+0000", 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.866e-06 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899175+0000", 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952814+0000", 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053638689000000003 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952892+0000", 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7890000000000001e-05 2024-09-11T06:21:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953047+0000", 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015576300000000001 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161995 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1751040~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:21:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.468086940000006, 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054070368000000001, 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161995 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900905+0000", 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017245850000000001 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900910+0000", 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900923+0000", 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2619999999999999e-05 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900930+0000", 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4059999999999999e-06 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953077+0000", 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052147129 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953152+0000", 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5265999999999994e-05 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953251+0000", 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8666999999999996e-05 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162003 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1882112~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.466067895999998, 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054417001, 2024-09-11T06:21:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162003 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901202+0000", 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901209+0000", 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901214+0000", 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955009+0000", 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053795526000000003 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955110+0000", 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010130500000000001 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955617+0000", 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050644199999999996 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162004 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.466047908999997, 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054432803000000002, 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162004 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901222+0000", 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:21:01.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901227+0000", 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7099999999999998e-06 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901231+0000", 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.357e-06 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955645+0000", 2024-09-11T06:21:01.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054413571000000001 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955653+0000", 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162005 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:21:01.446 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.466031197999996, 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054450025999999999, 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162005 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:21:01.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901291+0000", 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4326000000000001e-05 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901294+0000", 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3459999999999998e-06 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901302+0000", 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0239999999999997e-06 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901308+0000", 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955677+0000", 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054368593999999999 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955687+0000", 2024-09-11T06:21:01.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8500000000000006e-06 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162006 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.465950386000003, 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054418451, 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:01.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162006 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902903+0000", 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015855590000000001 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902908+0000", 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902922+0000", 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3949e-05 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902929+0000", 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3150000000000003e-06 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955725+0000", 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052795684000000002 2024-09-11T06:21:01.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955736+0000", 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183479 3.15 3:ac303efb:::rbd_data.116d42e0aa2c.0000000000000010:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.073610565000003, 2024-09-11T06:21:01.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83363719300000005, 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183479 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:21:01.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293658+0000", 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293663+0000", 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293676+0000", 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2734999999999999e-05 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293683+0000", 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6559999999999992e-06 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293746+0000", 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2748000000000003e-05 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293759+0000", 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2767e-05 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.126963+0000", 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83320435800000003 2024-09-11T06:21:01.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127119+0000", 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015564999999999999 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127294+0000", 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017540899999999999 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183484 3.15 3:a84be19c:::rbd_data.116d42e0aa2c.0000000000000015:head [sparse-read 0~4259840] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.073156138999998, 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83354649000000003, 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183484 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8700000000000005e-07 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294116+0000", 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294126+0000", 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6339999999999996e-06 2024-09-11T06:21:01.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294131+0000", 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3990000000000003e-06 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294186+0000", 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5438e-05 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:01.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294196+0000", 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9769999999999995e-06 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127600+0000", 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83340399499999995 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127658+0000", 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7710000000000001e-05 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:236970 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e251)", 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.1866177630000001, 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.95716742099999996, 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:01.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236970 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180652+0000", 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.61e-06 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180659+0000", 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7540000000000006e-06 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180672+0000", 2024-09-11T06:21:01.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3200999999999999e-05 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180682+0000", 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3239999999999992e-06 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180748+0000", 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6599000000000004e-05 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:01.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180757+0000", 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.799e-06 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.136304+0000", 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.95554679200000003 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.136417+0000", 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112905 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.136555+0000", 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013774699999999999 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.137379+0000", 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082454999999999996 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.137700+0000", 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00032077499999999998 2024-09-11T06:21:01.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.137771+0000", 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0545999999999998e-05 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.137817+0000", 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6819e-05 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:01.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:01.473 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:01.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:21:01.475 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:01.473+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:01.575 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:01.574+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:01.576 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:21:01.576 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:01.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:21:01.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:21:01.689 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:01.689 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:01.689 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:21:01.689 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:21:01.689 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:01.689 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:21:01.688+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:21:01.698 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:21:01.770 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:21:01.770 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:21:01.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:01.776+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:21:01.788 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:21:01.803 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:21:01.804 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:21:01.821 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:21:01.821 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:21:01.842 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:21:01.843 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:21:01.845 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:01.845 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:01.854 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:21:01.859 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:21:01.860 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:21:01.877 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:21:01.877 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:21:01.898 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:01.897+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:01.968 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:01.968 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:01.977 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:21:01.978 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:01.977+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:02.079 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:02.078+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:02.097 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:21:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:21:02.122 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:02.122 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:02.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:21:02.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:21:02.214 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:02.214+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:02.229 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 4, 5, 6, 7, 3, 1] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-11T06:21:02.229 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T06:21:02.229 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-11T06:21:02.229 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T06:21:02.229 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T06:21:02.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-11T06:21:02.278 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:02.278 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:02.280 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:02.279+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:02.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:21:02.336 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T06:21:02.337 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:02.381 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:02.380+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:02.431 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:02.431 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:02.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:21:02.481 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:02.481+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:02.582 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:21:02.581+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:21:02.584 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:02.584 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:02.592 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:21:02.683 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:02.682+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:02.695 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:02.695 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:02.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:21:02.783 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:21:02.782+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:21:02.847 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:02.847 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:02.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:21:02.899 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:02.898+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:02.957 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:02.958 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:02.966 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:21:02.986 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:02.985+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:03.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:03.086+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:03.109 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:03.109 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:03.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:21:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:21:03.202 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:03.201+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:03.275 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:03.275 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:03.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:21:03.326 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:03.325+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:03.390 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:03.389+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:03.427 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:03.427 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:03.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:21:03.491 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:03.490+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:03.579 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:03.580 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:03.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:21:03.591 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:03.590+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:03.692 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:03.691+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:03.693 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:03.693 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:03.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:21:03.793 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:03.792+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:03.845 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:03.845 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:03.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:21:03.899 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:03.898+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:03.957 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:03.958 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:03.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:21:03.995 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:03.995+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:04.096 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:04.095+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:04.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T06:21:04.110 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:04.110 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:04.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:21:04.197 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:04.196+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:04.262 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:21:04.262 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:21:04.288 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:21:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:21:04.296 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:04.296 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:04.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:04.296+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:04.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:21:04.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:21:04.307 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:21:04.324 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:21:04.324 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:21:04.342 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:21:04.342 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:21:04.359 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:21:04.359 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:21:04.376 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:21:04.376 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:21:04.392 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:21:04.393 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:21:04.398 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:21:04.397+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118791 3.e 3:77bf8ae2:::rbd_data.116d617edd04.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 124.291480401, 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99493171000000002, 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118791 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120388+0000", 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120389+0000", 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.139e-06 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7520000000000002e-06 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120408+0000", 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2772000000000001e-05 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120426+0000", 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8107000000000001e-05 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120473+0000", 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7111999999999999e-05 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120480+0000", 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0469999999999996e-06 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115135+0000", 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99465548800000003 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115213+0000", 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7585999999999999e-05 2024-09-11T06:21:04.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.115320+0000", 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010670699999999999 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.419 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144750 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.295235539000004, 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582124690000001, 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144750 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116633+0000", 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116634+0000", 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5009999999999999e-06 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116640+0000", 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.942e-06 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116653+0000", 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2828e-05 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116663+0000", 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6260000000000007e-06 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116846+0000", 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018370600000000001 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116852+0000", 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5300000000000004e-06 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118174+0000", 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001322029 2024-09-11T06:21:04.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118190+0000", 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5661000000000001e-05 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374607+0000", 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256417841 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374712+0000", 2024-09-11T06:21:04.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010421600000000001 2024-09-11T06:21:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.374845+0000", 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013358900000000001 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144753 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.295184628000001, 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585292130000001, 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.426 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144753 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116684+0000", 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0100000000000005e-07 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116687+0000", 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0249999999999998e-06 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116781+0000", 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3541000000000004e-05 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116790+0000", 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1600000000000004e-06 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116921+0000", 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013079399999999999 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116928+0000", 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3699999999999997e-06 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118315+0000", 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013873480000000001 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118325+0000", 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6569999999999992e-06 2024-09-11T06:21:04.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375029+0000", 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.256703412 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375112+0000", 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3561999999999997e-05 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375213+0000", 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100843 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144761 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294997323999993, 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2586620559999999, 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144761 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116871+0000", 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116872+0000", 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.44e-07 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116875+0000", 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116884+0000", 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0389999999999993e-06 2024-09-11T06:21:04.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116890+0000", 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7690000000000002e-06 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116969+0000", 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9359999999999999e-05 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116975+0000", 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7130000000000002e-06 2024-09-11T06:21:04.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118368+0000", 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001392744 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118377+0000", 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8470000000000002e-06 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375257+0000", 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2568802190000001 2024-09-11T06:21:04.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375360+0000", 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103095 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375533+0000", 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017296 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.437 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144764 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294960364000005, 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2589186720000001, 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144764 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116908+0000", 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3799999999999998e-07 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116911+0000", 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7750000000000001e-06 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116919+0000", 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4760000000000001e-06 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116924+0000", 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2469999999999999e-06 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117012+0000", 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8047999999999995e-05 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117017+0000", 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3809999999999998e-06 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118418+0000", 2024-09-11T06:21:04.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001400508 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118427+0000", 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6479999999999998e-06 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375572+0000", 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257144773 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375666+0000", 2024-09-11T06:21:04.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3554999999999995e-05 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375827+0000", 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016082299999999999 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144772 3.f 3:f7e0caac:::rbd_data.116deeec7db3.0000000000000000:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:21:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294935507000005, 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259265764, 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144772 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:21:04.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116933+0000", 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.51e-07 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116936+0000", 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3879999999999998e-06 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116942+0000", 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5230000000000001e-06 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116947+0000", 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7779999999999998e-06 2024-09-11T06:21:04.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117059+0000", 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112355 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117063+0000", 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0110000000000002e-06 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118475+0000", 2024-09-11T06:21:04.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014117509999999999 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118485+0000", 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0173999999999999e-05 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.375922+0000", 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257436899 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376019+0000", 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6791000000000002e-05 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376199+0000", 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000179643 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144775 3.f 3:f7539bba:::rbd_data.116deeec7db3.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.449 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294895542999996, 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595226259999999, 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144775 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116973+0000", 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0999999999999999e-07 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116982+0000", 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5339999999999999e-06 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116989+0000", 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-06 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.116994+0000", 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4609999999999999e-06 2024-09-11T06:21:04.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117101+0000", 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106958 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117107+0000", 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4539999999999998e-06 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118516+0000", 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014093720000000001 2024-09-11T06:21:04.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118522+0000", 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7359999999999998e-06 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376229+0000", 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.257707237 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376324+0000", 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5177e-05 2024-09-11T06:21:04.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376495+0000", 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000171027 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144783 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294865166999998, 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2595423480000001, 2024-09-11T06:21:04.455 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144783 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117003+0000", 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999999e-07 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117005+0000", 2024-09-11T06:21:04.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7010000000000001e-06 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117011+0000", 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0410000000000003e-06 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117016+0000", 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9250000000000003e-06 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117137+0000", 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121067 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117140+0000", 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8729999999999999e-06 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118564+0000", 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014238860000000001 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118568+0000", 2024-09-11T06:21:04.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6219999999999998e-06 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376534+0000", 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25796592 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376546+0000", 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2014999999999999e-05 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144786 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294844401000006, 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596236730000001, 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144786 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117024+0000", 2024-09-11T06:21:04.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7300000000000002e-07 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117026+0000", 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1689999999999999e-06 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117033+0000", 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8179999999999998e-06 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117039+0000", 2024-09-11T06:21:04.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2100000000000001e-06 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117177+0000", 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138042 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117182+0000", 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.006e-06 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118590+0000", 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001408496 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118595+0000", 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7990000000000001e-06 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376636+0000", 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580408510000001 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376648+0000", 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909000000000001e-05 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144794 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294811530000004, 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596383209999999, 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144794 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117057+0000", 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8800000000000003e-07 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117060+0000", 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0469999999999998e-06 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117065+0000", 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8300000000000003e-06 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117070+0000", 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7849999999999999e-06 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117226+0000", 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155742 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117231+0000", 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5589999999999996e-06 2024-09-11T06:21:04.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118616+0000", 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001384698 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118619+0000", 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5020000000000001e-06 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376682+0000", 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580625859999999 2024-09-11T06:21:04.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376695+0000", 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3084e-05 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144797 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294791672000002, 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596565280000001, 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144797 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117077+0000", 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2099999999999998e-07 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117079+0000", 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9649999999999998e-06 2024-09-11T06:21:04.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117089+0000", 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0254999999999999e-05 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117093+0000", 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4620000000000001e-06 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117272+0000", 2024-09-11T06:21:04.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017950900000000001 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117277+0000", 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1789999999999999e-06 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118638+0000", 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013605360000000001 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118641+0000", 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.444e-06 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376724+0000", 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2580821659999999 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376733+0000", 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6909999999999992e-06 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144805 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294771495000006, 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259671534, 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144805 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.477 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117097+0000", 2024-09-11T06:21:04.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117099+0000", 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5349999999999999e-06 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117102+0000", 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4850000000000001e-06 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117105+0000", 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9799999999999998e-06 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117320+0000", 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214541 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117326+0000", 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2009999999999996e-06 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118660+0000", 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013343669999999999 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118664+0000", 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376759+0000", 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258094635 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376768+0000", 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4350000000000003e-06 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144808 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.29476013, 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2596914429999999, 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144808 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117108+0000", 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0900000000000001e-07 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117113+0000", 2024-09-11T06:21:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7079999999999996e-06 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117117+0000", 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.461e-06 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117121+0000", 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0080000000000004e-06 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117361+0000", 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024048400000000001 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117366+0000", 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118685+0000", 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001318449 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118688+0000", 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3220000000000001e-06 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376790+0000", 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581023140000001 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376800+0000", 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3479999999999993e-06 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144816 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294732693, 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259697566, 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144816 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117136+0000", 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.77e-07 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117138+0000", 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2089999999999999e-06 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117144+0000", 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1659999999999999e-06 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117149+0000", 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.498e-06 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117411+0000", 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026187299999999998 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117417+0000", 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8089999999999998e-06 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118712+0000", 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012957909999999999 2024-09-11T06:21:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118720+0000", 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3760000000000002e-06 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376822+0000", 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2581027140000001 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376833+0000", 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0753e-05 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144819 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294698436999994, 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259768124, 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144819 2024-09-11T06:21:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117170+0000", 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7300000000000002e-07 2024-09-11T06:21:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117172+0000", 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4219999999999999e-06 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117176+0000", 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3449999999999999e-06 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117180+0000", 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7529999999999999e-06 2024-09-11T06:21:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117452+0000", 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027203299999999998 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117455+0000", 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6660000000000001e-06 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118744+0000", 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012884929999999999 2024-09-11T06:21:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118748+0000", 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9620000000000004e-06 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376924+0000", 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.25817574 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376938+0000", 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4436999999999999e-05 2024-09-11T06:21:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144827 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294684974000006, 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.259792247, 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144827 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117183+0000", 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117184+0000", 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1199999999999999e-07 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117185+0000", 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1680000000000001e-06 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117188+0000", 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0960000000000001e-06 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117191+0000", 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117492+0000", 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00030103299999999998 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117494+0000", 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.768e-06 2024-09-11T06:21:04.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118770+0000", 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012754839999999999 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118774+0000", 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376962+0000", 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258188788 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.376976+0000", 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3256e-05 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.503 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144830 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294653245000006, 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2597960289999999, 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144830 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117215+0000", 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.36e-07 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117217+0000", 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5030000000000001e-06 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117221+0000", 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1729999999999997e-06 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117224+0000", 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.695e-06 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117518+0000", 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000294145 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting_for_map not empty", 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117521+0000", 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3000000000000002e-06 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118794+0000", 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00127286 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118798+0000", 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0720000000000001e-06 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377002+0000", 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258204265 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377011+0000", 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7800000000000006e-06 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144838 3.f 3.355307ef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294641087000002, 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598182520000001, 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144838 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117227+0000", 2024-09-11T06:21:04.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117229+0000", 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1489999999999999e-06 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117232+0000", 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1429999999999998e-06 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117234+0000", 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6599999999999999e-06 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118821+0000", 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015862350000000001 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118824+0000", 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.298e-06 2024-09-11T06:21:04.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377035+0000", 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582110550000001 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377046+0000", 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0502e-05 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144841 3.f 3.5dd9caef (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294616238000003, 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598266380000001, 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144841 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117252+0000", 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3900000000000001e-07 2024-09-11T06:21:04.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117254+0000", 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5710000000000001e-06 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117258+0000", 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5510000000000001e-06 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117262+0000", 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.123e-06 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118847+0000", 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00158501 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118850+0000", 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.337e-06 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377068+0000", 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.258218313 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377079+0000", 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0494e-05 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:144860 3.f 3.a6eb474f (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e173)", 2024-09-11T06:21:04.518 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 83.294603008999999, 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2598501200000001, 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 144860 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117265+0000", 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117266+0000", 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1e-07 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117267+0000", 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117270+0000", 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1990000000000002e-06 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.117273+0000", 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-06 2024-09-11T06:21:04.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118864+0000", 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015912980000000001 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:41.118867+0000", 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2559999999999998e-06 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377105+0000", 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2582381140000001 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:42.377115+0000", 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0261999999999999e-05 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.523 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:04.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T06:21:04.525 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:04.523+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:04.625 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:04.625+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:04.667 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:04.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:04.667 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:21:04.667 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:04.676 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T06:21:04.727 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:04.726+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:04.778 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:21:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:21:04.779 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:04.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T06:21:04.831 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:04.830+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:04.891 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:21:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:21:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:21:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:2651 3.3 3:c6791c99:::rbd_data.116dc3b5629f.000000000000009a:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 225.085941413, 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.22424318900000001, 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2651 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803414+0000", 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803415+0000", 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9100000000000003e-07 2024-09-11T06:21:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803419+0000", 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2799999999999997e-06 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803428+0000", 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0010000000000007e-06 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803433+0000", 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9779999999999996e-06 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803477+0000", 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4433e-05 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:19.803519+0000", 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1865e-05 2024-09-11T06:21:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.018273+0000", 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.21475335100000001 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027555+0000", 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0092820260000000005 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027585+0000", 2024-09-11T06:21:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9977000000000001e-05 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027621+0000", 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6615000000000001e-05 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:17:20.027657+0000", 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5871999999999998e-05 2024-09-11T06:21:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146861 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.715508115999995, 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0119077089999999, 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146861 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173847+0000", 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173849+0000", 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173858+0000", 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5390000000000007e-06 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173880+0000", 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1906999999999999e-05 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.173890+0000", 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0464e-05 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181404+0000", 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075135890000000002 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181412+0000", 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3860000000000007e-06 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185745+0000", 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043330070000001 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185755+0000", 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6169999999999996e-06 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:146862 3.3 3.313b4323 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.713104735000002, 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.009534047, 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 146862 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176251+0000", 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176253+0000", 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9199999999999998e-06 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176261+0000", 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5900000000000008e-06 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176282+0000", 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0894e-05 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.176293+0000", 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0762e-05 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181435+0000", 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051421699999999997 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:46.181440+0000", 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3009999999999997e-06 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185777+0000", 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0043371619999999 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:47.185785+0000", 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2479999999999999e-06 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:153432 3.f 3:f42e81df:::rbd_data.116ddf3f5156.000000000000000f:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.558584593000006, 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79802703600000002, 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 153432 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330771+0000", 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330773+0000", 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.278e-06 2024-09-11T06:21:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330953+0000", 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017961999999999999 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330983+0000", 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0188e-05 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.330994+0000", 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331072+0000", 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8141999999999998e-05 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:55.331081+0000", 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2890000000000003e-06 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125207+0000", 2024-09-11T06:21:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.79412554300000004 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125321+0000", 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011482299999999999 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.125455+0000", 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013386800000000001 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128673+0000", 2024-09-11T06:21:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032178269999999999 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128700+0000", 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6588999999999999e-05 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128754+0000", 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4716999999999998e-05 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.128798+0000", 2024-09-11T06:21:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3448000000000001e-05 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161946 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 948224~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.000313200999997, 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054041921999999999, 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161946 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.889042+0000", 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890912+0000", 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018701760000000001 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890917+0000", 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5170000000000001e-06 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890928+0000", 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0896999999999999e-05 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.890935+0000", 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7149999999999998e-06 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942905+0000", 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051969594000000001 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.942980+0000", 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4464999999999999e-05 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.943084+0000", 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104558 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161955 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1095680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.998212307000003, 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053898585999999998, 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161955 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891143+0000", 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7599999999999998e-07 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891145+0000", 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891151+0000", 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6590000000000004e-06 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891156+0000", 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8500000000000002e-06 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944860+0000", 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053704094000000001 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.944943+0000", 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3394999999999997e-05 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945042+0000", 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8220000000000005e-05 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161956 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1112064~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.998193074, 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054087369000000003, 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161956 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.891162+0000", 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892929+0000", 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001766349 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892933+0000", 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4139999999999996e-06 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892944+0000", 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0479000000000001e-05 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.892950+0000", 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.708e-06 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945075+0000", 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052124987999999997 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945154+0000", 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8792e-05 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.945250+0000", 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5638999999999997e-05 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161965 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1259520~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.996301854999999, 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053970817999999997, 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161965 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.893054+0000", 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894904+0000", 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018509830000000001 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894909+0000", 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.087e-06 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894916+0000", 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2130000000000002e-06 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.894922+0000", 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.767e-06 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946853+0000", 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051931484999999999 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.946931+0000", 2024-09-11T06:21:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7737000000000005e-05 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.947024+0000", 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3546000000000002e-05 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161974 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1406976~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.994245346, 2024-09-11T06:21:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053855649999999998, 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161974 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:21:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895110+0000", 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9700000000000002e-07 2024-09-11T06:21:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895113+0000", 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5220000000000002e-06 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895119+0000", 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895124+0000", 2024-09-11T06:21:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8539999999999996e-06 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948788+0000", 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053664195999999997 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948866+0000", 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7417999999999996e-05 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948966+0000", 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9907000000000004e-05 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161975 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1423360~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.994224290000005, 2024-09-11T06:21:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054030427999999998, 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161975 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:21:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.895131+0000", 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896902+0000", 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017710829999999999 2024-09-11T06:21:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896910+0000", 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4970000000000004e-06 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896919+0000", 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7310000000000005e-06 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.896926+0000", 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4880000000000004e-06 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.948997+0000", 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052071477999999997 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949068+0000", 2024-09-11T06:21:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1080000000000004e-05 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.949162+0000", 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3071000000000004e-05 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161984 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1570816~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:21:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.992328384999993, 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053945050000000001, 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161984 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.897027+0000", 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898905+0000", 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001878036 2024-09-11T06:21:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898910+0000", 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8369999999999996e-06 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898922+0000", 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1909999999999999e-05 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.898928+0000", 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.669e-06 2024-09-11T06:21:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950784+0000", 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.051855483000000001 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950853+0000", 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9239000000000006e-05 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.950972+0000", 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118876 2024-09-11T06:21:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161994 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1734656~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.990194439000007, 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053886363999999999, 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161994 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899161+0000", 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7399999999999999e-07 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899163+0000", 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1390000000000002e-06 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899170+0000", 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.866e-06 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899175+0000", 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6430000000000003e-06 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952814+0000", 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053638689000000003 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.952892+0000", 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7890000000000001e-05 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953047+0000", 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015576300000000001 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:161995 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1751040~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.990174616999994, 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054070368000000001, 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 161995 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.899181+0000", 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900905+0000", 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017245850000000001 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900910+0000", 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6949999999999999e-06 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900923+0000", 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2619999999999999e-05 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.900930+0000", 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4059999999999999e-06 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953077+0000", 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052147129 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953152+0000", 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5265999999999994e-05 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.953251+0000", 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8666999999999996e-05 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162003 3.1d 3:b9420444:::rbd_data.116db1306a51.0000000000000006:4f [read 1882112~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.988155573, 2024-09-11T06:21:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054417001, 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162003 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901200+0000", 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901202+0000", 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0999999999999998e-06 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901209+0000", 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3559999999999998e-06 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901214+0000", 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955009+0000", 2024-09-11T06:21:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.053795526000000003 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955110+0000", 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010130500000000001 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955617+0000", 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050644199999999996 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162004 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.988135585999999, 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054432803000000002, 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162004 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901220+0000", 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1899999999999998e-07 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901222+0000", 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.013e-06 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901227+0000", 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7099999999999998e-06 2024-09-11T06:21:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901231+0000", 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.357e-06 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955645+0000", 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054413571000000001 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955653+0000", 2024-09-11T06:21:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8329999999999994e-06 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162005 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.988118874999998, 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054450025999999999, 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162005 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901236+0000", 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901291+0000", 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4326000000000001e-05 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901294+0000", 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3459999999999998e-06 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901302+0000", 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0239999999999997e-06 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901308+0000", 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8860000000000001e-06 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955677+0000", 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054368593999999999 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955687+0000", 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8500000000000006e-06 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:162006 3.1d 3.2220429d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e188)", 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.988038063000005, 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.054418451, 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 162006 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.901317+0000", 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902903+0000", 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015855590000000001 2024-09-11T06:21:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902908+0000", 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8799999999999999e-06 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902922+0000", 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3949e-05 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.902929+0000", 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3150000000000003e-06 2024-09-11T06:21:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955725+0000", 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.052795684000000002 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:56.955736+0000", 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1063999999999999e-05 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183479 3.15 3:ac303efb:::rbd_data.116d42e0aa2c.0000000000000010:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.595698241999997, 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83363719300000005, 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183479 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293657+0000", 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293658+0000", 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5000000000000001e-07 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293663+0000", 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9200000000000003e-06 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293676+0000", 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2734999999999999e-05 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293683+0000", 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6559999999999992e-06 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293746+0000", 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2748000000000003e-05 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.293759+0000", 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2767e-05 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.126963+0000", 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83320435800000003 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127119+0000", 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015564999999999999 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127294+0000", 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017540899999999999 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:183484 3.15 3:a84be19c:::rbd_data.116d42e0aa2c.0000000000000015:head [sparse-read 0~4259840] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e192)", 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:21:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.595243815999993, 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83354649000000003, 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 183484 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:21:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294112+0000", 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8700000000000005e-07 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294116+0000", 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6500000000000002e-06 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294126+0000", 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6339999999999996e-06 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294131+0000", 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3990000000000003e-06 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294186+0000", 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5438e-05 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:00.294196+0000", 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9769999999999995e-06 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127600+0000", 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.83340399499999995 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:01.127658+0000", 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7710000000000001e-05 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:236970 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e251)", 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7087054400000001, 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.95716742099999996, 2024-09-11T06:21:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236970 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180650+0000", 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180652+0000", 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.61e-06 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180659+0000", 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7540000000000006e-06 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180672+0000", 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3200999999999999e-05 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180682+0000", 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3239999999999992e-06 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180748+0000", 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6599000000000004e-05 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:00.180757+0000", 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.799e-06 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.136304+0000", 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.95554679200000003 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.136417+0000", 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112905 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.136555+0000", 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013774699999999999 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.137379+0000", 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082454999999999996 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.137700+0000", 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00032077499999999998 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.137771+0000", 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0545999999999998e-05 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:21:01.137817+0000", 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6819e-05 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.986 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:04.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:04.987 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:04.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T06:21:04.988 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:04.987+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:05.089 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:05.088+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:05.132 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:05.132 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-11T06:21:05.133 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:05.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T06:21:05.161 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:21:05.189 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:05.189+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:05.290 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:05.289+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:05.297 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:05.297 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-11T06:21:05.297 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-11T06:21:05.297 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-11T06:21:05.297 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:05.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T06:21:05.393 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:21:05.392+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:21:05.456 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-11T06:21:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-11T06:21:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-11T06:21:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118742 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.335465713, 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99099227400000001, 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118742 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118556+0000", 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118558+0000", 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9209999999999999e-06 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118565+0000", 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3080000000000002e-06 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118582+0000", 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7251000000000001e-05 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118591+0000", 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2450000000000004e-06 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118671+0000", 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9250000000000002e-05 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118681+0000", 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0358e-05 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109243+0000", 2024-09-11T06:21:05.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99056200000000005 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109395+0000", 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015195399999999999 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.109548+0000", 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015298699999999999 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118745 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.335373011, 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147133799999998, 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118745 2024-09-11T06:21:05.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118648+0000", 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118649+0000", 2024-09-11T06:21:05.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2200000000000004e-07 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118652+0000", 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118668+0000", 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5937999999999999e-05 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118674+0000", 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1990000000000003e-06 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118706+0000", 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2400000000000001e-05 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118710+0000", 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.687e-06 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110028+0000", 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131771999999996 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110120+0000", 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2066999999999998e-05 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118750 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.335167201, 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99147861000000004, 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118750 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118854+0000", 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118855+0000", 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9800000000000002e-07 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118859+0000", 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9160000000000003e-06 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118868+0000", 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1039999999999996e-06 2024-09-11T06:21:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118876+0000", 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6750000000000002e-06 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118929+0000", 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3198999999999997e-05 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118937+0000", 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3620000000000006e-06 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110172+0000", 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99123504399999995 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110263+0000", 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.009e-05 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110333+0000", 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321999999999995e-05 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118753 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.33508163400001, 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99150722300000005, 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118753 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118940+0000", 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118941+0000", 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1600000000000001e-07 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118943+0000", 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.779e-06 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118950+0000", 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.973e-06 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118957+0000", 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5030000000000002e-06 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.118995+0000", 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8251999999999999e-05 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119002+0000", 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7349999999999999e-06 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110362+0000", 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99135994500000002 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110447+0000", 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5320000000000003e-05 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118758 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.334868376, 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99146820999999996, 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118758 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119153+0000", 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119154+0000", 2024-09-11T06:21:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6300000000000004e-07 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119157+0000", 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.439e-06 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119168+0000", 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.084e-05 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119176+0000", 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7079999999999997e-06 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119243+0000", 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7568000000000001e-05 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119253+0000", 2024-09-11T06:21:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3959999999999995e-06 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110474+0000", 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99122092399999995 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110541+0000", 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7741000000000001e-05 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110621+0000", 2024-09-11T06:21:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9831000000000002e-05 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118761 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.334785057, 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145733700000005, 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118761 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119236+0000", 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119237+0000", 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9499999999999998e-07 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119239+0000", 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7049999999999999e-06 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119246+0000", 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7519999999999999e-06 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119252+0000", 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6910000000000002e-06 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119300+0000", 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7676000000000002e-05 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119308+0000", 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0420000000000003e-06 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110648+0000", 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99134079600000002 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110694+0000", 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.528e-05 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118766 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.334528174, 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991371628, 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118766 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119493+0000", 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119494+0000", 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0500000000000003e-07 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119498+0000", 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2100000000000003e-06 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119506+0000", 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1950000000000003e-06 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119513+0000", 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3199999999999996e-06 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119558+0000", 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4985999999999999e-05 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119566+0000", 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4959999999999996e-06 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110718+0000", 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99115228300000002 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110786+0000", 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7910999999999994e-05 2024-09-11T06:21:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.110865+0000", 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8522000000000005e-05 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118769 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.33446673500001, 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156976699999999, 2024-09-11T06:21:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118769 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119555+0000", 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1300000000000001e-07 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119557+0000", 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3309999999999998e-06 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119564+0000", 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1979999999999998e-06 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119570+0000", 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9050000000000002e-06 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119617+0000", 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7731000000000001e-05 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119623+0000", 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0009999999999998e-06 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111000+0000", 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99137625399999996 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111124+0000", 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012493399999999999 2024-09-11T06:21:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118774 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.33422091, 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991560726, 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118774 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119801+0000", 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2900000000000002e-07 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119806+0000", 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.476e-06 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119816+0000", 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7850000000000003e-06 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119823+0000", 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4080000000000001e-06 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119874+0000", 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1477000000000002e-05 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119894+0000", 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9408000000000001e-05 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111161+0000", 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99126664399999997 2024-09-11T06:21:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111245+0000", 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3962999999999996e-05 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111361+0000", 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116736 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118777 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.33415278299999, 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99161743800000002, 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118777 2024-09-11T06:21:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119869+0000", 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7999999999999996e-07 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119872+0000", 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119878+0000", 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5799999999999997e-06 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119906+0000", 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7702e-05 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119941+0000", 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4606e-05 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.119945+0000", 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1139999999999999e-06 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111404+0000", 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99145921999999997 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111486+0000", 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2089999999999995e-05 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118782 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.33388512099999, 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99152320900000002, 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118782 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120136+0000", 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120137+0000", 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9699999999999994e-07 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120142+0000", 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8590000000000004e-06 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120152+0000", 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5100000000000004e-06 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120159+0000", 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9929999999999998e-06 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120199+0000", 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9929999999999999e-05 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120203+0000", 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8559999999999998e-06 2024-09-11T06:21:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111512+0000", 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99130823300000004 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111579+0000", 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7691e-05 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111660+0000", 2024-09-11T06:21:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0140000000000002e-05 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118785 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.333813081, 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.991550775, 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118785 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120208+0000", 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120209+0000", 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0500000000000004e-07 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120216+0000", 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5429999999999996e-06 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120223+0000", 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-06 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120228+0000", 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1379999999999998e-06 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120260+0000", 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1770000000000002e-05 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120264+0000", 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.518e-06 2024-09-11T06:21:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111687+0000", 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99142277199999995 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111759+0000", 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2599000000000001e-05 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118790 3.14 3:2ce1ce6e:::rbd_data.116d617edd04.0000000000000001:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.333642322, 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156790400000006, 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118790 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120379+0000", 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120380+0000", 2024-09-11T06:21:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4000000000000001e-07 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120383+0000", 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6849999999999999e-06 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120395+0000", 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1287999999999999e-05 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120411+0000", 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6107e-05 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120460+0000", 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9283000000000002e-05 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120474+0000", 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3628999999999999e-05 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111786+0000", 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99131190199999997 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111859+0000", 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2937999999999999e-05 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111947+0000", 2024-09-11T06:21:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8431999999999996e-05 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:118793 3.14 3:2ebc2366:::rbd_data.116d617edd04.0000000000000004:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e133)", 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 125.333537101, 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99156494500000003, 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 118793 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120484+0000", 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120485+0000", 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5199999999999997e-07 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120488+0000", 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0529999999999998e-06 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120495+0000", 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8469999999999998e-06 2024-09-11T06:21:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120500+0000", 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5169999999999999e-06 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120533+0000", 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3189999999999999e-05 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:00.120538+0000", 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6569999999999996e-06 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.111974+0000", 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99143543199999995 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:19:01.112049+0000", 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5697000000000004e-05 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230165 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.335115485999999, 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0055556050000001, 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230165 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118906+0000", 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118908+0000", 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7e-06 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118915+0000", 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0509999999999999e-06 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118929+0000", 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.383e-05 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.118940+0000", 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1368e-05 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129437+0000", 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010497272 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129446+0000", 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4980000000000006e-06 2024-09-11T06:21:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124450+0000", 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99500413499999996 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124462+0000", 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1751e-05 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230166 3.a 3.656d576a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e201)", 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.331868401999998, 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0023415419999999, 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230166 2024-09-11T06:21:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122153+0000", 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122155+0000", 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9410000000000001e-06 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122166+0000", 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0689e-05 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122180+0000", 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3879e-05 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.122190+0000", 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0671e-05 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129472+0000", 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072814869999999997 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:10.129477+0000", 2024-09-11T06:21:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2900000000000002e-06 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124488+0000", 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99501055000000005 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:11.124495+0000", 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0350000000000004e-06 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230931 3.d 3:b6cf8884:::rbd_data.116dc6ff1838.0000000000000049:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.316659559999998, 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99172812200000005, 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230931 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137362+0000", 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137363+0000", 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4109999999999999e-06 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137369+0000", 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5949999999999998e-06 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137381+0000", 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1838000000000001e-05 2024-09-11T06:21:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137389+0000", 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9009999999999994e-06 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137452+0000", 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3472999999999994e-05 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.137463+0000", 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0567000000000001e-05 2024-09-11T06:21:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127016+0000", 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98955333400000001 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127186+0000", 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000169715 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.127325+0000", 2024-09-11T06:21:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013924599999999999 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.128993+0000", 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016684689999999999 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129006+0000", 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3020000000000001e-05 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129049+0000", 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2178000000000002e-05 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.129090+0000", 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1375000000000003e-05 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230941 3.1d 3:bf50afcf:::rbd_data.116dc6ff1838.0000000000000053:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:21:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.313187882000001, 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.99810618600000001, 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230941 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140834+0000", 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140835+0000", 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3960000000000001e-06 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140839+0000", 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.279e-06 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140850+0000", 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0539e-05 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140857+0000", 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0060000000000003e-06 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140919+0000", 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2638999999999994e-05 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.140929+0000", 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.927e-06 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130401+0000", 2024-09-11T06:21:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98947149300000004 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130508+0000", 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106908 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.130605+0000", 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7103999999999997e-05 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134020+0000", 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003415052 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138839+0000", 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048191529999999996 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138891+0000", 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1780000000000002e-05 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138940+0000", 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8909999999999998e-05 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230966 3.1d 3:ba8846fd:::rbd_data.116dc6ff1838.000000000000006c:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.300232672, 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.98529302399999996, 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230966 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153789+0000", 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153790+0000", 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4190000000000001e-06 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153796+0000", 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.468e-06 2024-09-11T06:21:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153808+0000", 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1892000000000001e-05 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153813+0000", 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9279999999999998e-06 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153865+0000", 2024-09-11T06:21:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1841000000000001e-05 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.153872+0000", 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7660000000000001e-06 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131149+0000", 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97727708300000005 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131259+0000", 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010973500000000001 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131337+0000", 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8547999999999994e-05 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.134185+0000", 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028480189999999998 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.138986+0000", 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048007989999999997 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139037+0000", 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0321999999999997e-05 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139082+0000", 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5204000000000003e-05 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4461.0:230995 3.1d 3:beb2267b:::rbd_data.116dc6ff1838.0000000000000143:head [delete] snapc 54=[] ondisk+write+known_if_redirected+supports_pool_eio e206)", 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.288477493999999, 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.97366138199999996, 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4461", 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230995 2024-09-11T06:21:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165544+0000", 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-11T06:21:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165545+0000", 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.64e-07 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165550+0000", 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2379999999999997e-06 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165563+0000", 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2498e-05 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165570+0000", 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165628+0000", 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7707999999999997e-05 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:15.165639+0000", 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1015e-05 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131877+0000", 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.96623801099999995 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.131984+0000", 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010730600000000001 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.132078+0000", 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4215000000000005e-05 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.136247+0000", 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041684519999999996 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139124+0000", 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028775459999999999 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139170+0000", 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5763999999999998e-05 2024-09-11T06:21:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-11T06:20:16.139205+0000", 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5281999999999999e-05 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-11T06:21:05.565 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:05.567 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T06:21:05.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-11T06:21:05.566+0000 7f067ac95640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33351) UID: 0 2024-09-11T06:21:05.668 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:05.667+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:05.670 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:21:05.670 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:21:05.670 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:21:05.670 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:21:05.680 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T06:21:05.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:05.767+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:05.823 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:21:05.823 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:21:05.823 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:21:05.823 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:21:05.823 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:21:05.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T06:21:05.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:05.872+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:05.970 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-11T06:21:05.969+0000 7ff15d829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 57539) UID: 0 2024-09-11T06:21:05.976 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:21:05.976 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:144376 3.b 3:d7e0a63a:::rbd_data.116deeec7db3.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e169)", 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 88.488571514, 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66706089899999998, 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.977 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 144376 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486255+0000", 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.978 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486256+0000", 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.37e-07 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486260+0000", 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9820000000000002e-06 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486268+0000", 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2910000000000007e-06 2024-09-11T06:21:05.979 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486273+0000", 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6739999999999996e-06 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486313+0000", 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0022999999999999e-05 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.980 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:37.486318+0000", 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0669999999999999e-06 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151201+0000", 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.66488306600000002 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151292+0000", 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0351000000000003e-05 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.981 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 2", 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.151646+0000", 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00035419 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153112+0000", 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0014666 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153208+0000", 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5772000000000004e-05 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.982 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153263+0000", 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5016999999999999e-05 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:38.153316+0000", 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3128999999999999e-05 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:21:05.983 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.577045573000007, 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72623960399999998, 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.984 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397781+0000", 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.397783+0000", 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.147e-06 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.985 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398274+0000", 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00049154799999999996 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398283+0000", 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1179999999999998e-06 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398288+0000", 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1399999999999999e-06 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.986 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398330+0000", 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1692e-05 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.398336+0000", 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4689999999999996e-06 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124013+0000", 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.72567764599999995 2024-09-11T06:21:05.987 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124021+0000", 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8439999999999998e-06 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3.ad0aecbb (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:21:05.988 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.433970166999998, 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58344928699999998, 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "reached pg", 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:05.989 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540857+0000", 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.540858+0000", 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.096e-06 2024-09-11T06:21:05.990 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541443+0000", 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00058485600000000003 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541451+0000", 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0639999999999994e-06 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541456+0000", 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9980000000000003e-06 2024-09-11T06:21:05.991 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541523+0000", 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7529999999999999e-05 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.541534+0000", 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1069e-05 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124290+0000", 2024-09-11T06:21:05.992 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58275560900000001 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124306+0000", 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.6065e-05 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:154116 3.1b 3:dd3750b5:::rbd_data.116ddf3f5156.0000000000000013:head [write 0~409600 [fadvise_sequential+fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e187)", 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:21:05.993 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 70.427708820999996, 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.58172919000000001, 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 154116 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:21:05.994 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547118+0000", 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547119+0000", 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1100000000000004e-07 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547621+0000", 2024-09-11T06:21:05.995 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000501645 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547629+0000", 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.6589999999999996e-06 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547634+0000", 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.848e-06 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.996 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547686+0000", 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.147e-05 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:55.547695+0000", 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5799999999999998e-06 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124336+0000", 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.57664082699999997 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.997 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124428+0000", 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.2153999999999999e-05 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for subops from 0", 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.124519+0000", 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0313000000000001e-05 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "op_commit", 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.125614+0000", 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001095794 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.998 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "sub_op_commit_rec", 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128786+0000", 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0031712770000000001 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "commit_sent", 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128821+0000", 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5602000000000002e-05 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:56.128847+0000", 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6109999999999999e-05 2024-09-11T06:21:05.999 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227124 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 397312~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.501252051999998, 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046188726999999999, 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.000 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227124 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:21:06.001 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473575+0000", 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5899999999999998e-07 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473576+0000", 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0109999999999999e-06 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.002 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473579+0000", 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9390000000000002e-06 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473584+0000", 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.921e-06 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519653+0000", 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046069327 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.003 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519698+0000", 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4518000000000003e-05 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519764+0000", 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5752000000000003e-05 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.004 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227125 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 399360~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.501239906999999, 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046294848, 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227125 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.005 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473587+0000", 2024-09-11T06:21:06.006 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4999999999999999e-07 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473591+0000", 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.54e-06 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473594+0000", 2024-09-11T06:21:06.007 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.3299999999999999e-06 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473597+0000", 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7530000000000002e-06 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519790+0000", 2024-09-11T06:21:06.008 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046192892999999999 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519828+0000", 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8266000000000003e-05 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519882+0000", 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3816000000000001e-05 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.009 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227126 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 401408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.501226987000003, 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046400064999999997, 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.010 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227126 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.011 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473600+0000", 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6800000000000001e-07 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473602+0000", 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.3549999999999999e-06 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473607+0000", 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2050000000000001e-06 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.012 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473610+0000", 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0479999999999999e-06 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519904+0000", 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046293809999999998 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.519944+0000", 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.0621999999999998e-05 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.013 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520000+0000", 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5656999999999999e-05 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227127 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 403456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.501213161000003, 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046519645999999998, 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.014 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227127 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.015 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473614+0000", 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0900000000000002e-07 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473616+0000", 2024-09-11T06:21:06.016 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.7099999999999999e-06 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473626+0000", 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5899999999999997e-06 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473631+0000", 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8640000000000001e-06 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.017 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520035+0000", 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046403941999999997 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520077+0000", 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1282999999999998e-05 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520133+0000", 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6747999999999999e-05 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.018 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227128 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 405504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.501189357999998, 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046616360000000003, 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.019 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227128 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.020 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473638+0000", 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.96e-07 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473640+0000", 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9120000000000001e-06 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473649+0000", 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.8650000000000007e-06 2024-09-11T06:21:06.021 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473655+0000", 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1670000000000004e-06 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520159+0000", 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046503925000000002 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520202+0000", 2024-09-11T06:21:06.022 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2899999999999999e-05 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520254+0000", 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.2194999999999997e-05 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227129 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 407552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.501165761000003, 2024-09-11T06:21:06.023 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046708761000000001, 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227129 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.024 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473661+0000", 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473662+0000", 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.3599999999999999e-07 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473664+0000", 2024-09-11T06:21:06.025 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0370000000000001e-06 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473671+0000", 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0759999999999997e-06 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473676+0000", 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8969999999999999e-06 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520281+0000", 2024-09-11T06:21:06.026 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046605466999999998 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520320+0000", 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8875999999999998e-05 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520370+0000", 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9972000000000002e-05 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.027 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227130 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 409600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.501141971000003, 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046828026000000002, 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227130 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.028 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.473685+0000", 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474753+0000", 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001068334 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.029 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474757+0000", 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.737e-06 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474763+0000", 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8250000000000001e-06 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474768+0000", 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1109999999999999e-06 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.030 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520401+0000", 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045632645999999999 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520454+0000", 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3227999999999999e-05 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520513+0000", 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9144999999999997e-05 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.031 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227134 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 417792~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.500019023999997, 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046187445000000001, 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.032 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227134 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.033 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474808+0000", 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.4900000000000002e-07 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474809+0000", 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.119e-06 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474812+0000", 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.039e-06 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.034 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474815+0000", 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5359999999999999e-06 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520893+0000", 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046078467999999997 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520936+0000", 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2809999999999998e-05 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.035 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.520995+0000", 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9224000000000001e-05 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227135 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 419840~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.500009274999996, 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046298338000000001, 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.036 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227135 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.474818+0000", 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.037 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476753+0000", 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001935057 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476757+0000", 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2610000000000004e-06 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.038 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476768+0000", 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0703999999999999e-05 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.476775+0000", 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6709999999999999e-06 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521030+0000", 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044254449000000001 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521067+0000", 2024-09-11T06:21:06.039 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.7261000000000001e-05 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.521116+0000", 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8934999999999998e-05 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227146 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 442368~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.497825329999998, 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046216054999999999, 2024-09-11T06:21:06.040 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227146 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:21:06.041 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477002+0000", 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7399999999999999e-07 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477003+0000", 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1769999999999999e-06 2024-09-11T06:21:06.042 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477006+0000", 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.0709999999999999e-06 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477009+0000", 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6410000000000002e-06 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523047+0000", 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046037814000000003 2024-09-11T06:21:06.043 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523137+0000", 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0424e-05 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523218+0000", 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0654000000000004e-05 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.044 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227147 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 444416~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.497815432000003, 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046410320999999997, 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227147 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.045 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.046 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:21:06.046 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.477012+0000", 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478755+0000", 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.001743426 2024-09-11T06:21:06.048 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478759+0000", 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2200000000000003e-06 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478768+0000", 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.1779999999999992e-06 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.049 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.478775+0000", 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6699999999999997e-06 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523251+0000", 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044475796999999997 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523328+0000", 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6787999999999997e-05 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.050 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.523422+0000", 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4241999999999997e-05 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227192 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 273408~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.489071029000002, 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046102219999999999, 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.051 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227192 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485756+0000", 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.052 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485809+0000", 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3118000000000002e-05 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485812+0000", 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9299999999999999e-06 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485831+0000", 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8766e-05 2024-09-11T06:21:06.053 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485837+0000", 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9789999999999998e-06 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531732+0000", 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045895683999999999 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531781+0000", 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.8853999999999997e-05 2024-09-11T06:21:06.054 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531858+0000", 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.6889000000000002e-05 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227193 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 275456~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.488979950999997, 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046243092999999999, 2024-09-11T06:21:06.055 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227193 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.056 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.485847+0000", 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486066+0000", 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00021887 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486070+0000", 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.6490000000000001e-06 2024-09-11T06:21:06.057 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486076+0000", 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.6789999999999999e-06 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486081+0000", 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.5859999999999998e-06 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531897+0000", 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045816669999999997 2024-09-11T06:21:06.058 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.531981+0000", 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3554999999999995e-05 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532090+0000", 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000109084 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.059 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227194 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 277504~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.488731993999998, 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046160642000000002, 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227194 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.060 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486095+0000", 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486297+0000", 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000202337 2024-09-11T06:21:06.061 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486300+0000", 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9670000000000001e-06 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486308+0000", 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5089999999999996e-06 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.062 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486313+0000", 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.5600000000000001e-06 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532129+0000", 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045815225000000001 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532199+0000", 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0402999999999997e-05 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.063 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532256+0000", 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.6641000000000002e-05 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227195 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 279552~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.488504362, 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046088184999999997, 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.064 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227195 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.065 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486323+0000", 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486470+0000", 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000147754 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486474+0000", 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.2770000000000001e-06 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.066 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486484+0000", 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.8819999999999996e-06 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486488+0000", 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9459999999999997e-06 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532287+0000", 2024-09-11T06:21:06.067 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.045798959 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532345+0000", 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7584999999999998e-05 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532411+0000", 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5782000000000001e-05 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.068 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:227196 3.1b 3:d9399d2a:::rbd_data.116d435f8f88.0000000000000016:53 [read 281600~1024 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e200)", 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 56.48832505, 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.046093975000000002, 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 227196 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.069 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.486502+0000", 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487755+0000", 2024-09-11T06:21:06.070 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0012529959999999999 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487759+0000", 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.9570000000000004e-06 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487765+0000", 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5910000000000001e-06 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.487770+0000", 2024-09-11T06:21:06.071 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.2409999999999997e-06 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532448+0000", 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.044678540000000003 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532527+0000", 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.8465000000000002e-05 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.072 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:09.532596+0000", 2024-09-11T06:21:06.073 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9184999999999996e-05 2024-09-11T06:21:06.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.073 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.073 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.073 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.073 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:21:06.074 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T06:21:06.075 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:06.073+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:06.152 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:21:06.183 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:21:06.183 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:21:06.183 INFO:teuthology.orchestra.run.smithi194.stdout: "num_ops": 0 2024-09-11T06:21:06.183 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:21:06.192 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T06:21:06.214 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-11T06:21:06.213+0000 7f7b48229640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33584) UID: 0 2024-09-11T06:21:06.276 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-11T06:21:06.275+0000 7f353828c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33573) UID: 0 2024-09-11T06:21:06.301 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:21:06.301 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [], 2024-09-11T06:21:06.301 INFO:teuthology.orchestra.run.smithi194.stdout: "complaint_time": 30, 2024-09-11T06:21:06.301 INFO:teuthology.orchestra.run.smithi194.stdout: "num_blocked_ops": 0 2024-09-11T06:21:06.301 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:21:06.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T06:21:06.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:06.377+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:06.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T06:21:06.414 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "size": 20, 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 600, 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "ops": [ 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:58471 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 167.069829056, 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99660574400000002, 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.415 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 58471 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343239+0000", 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.416 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343241+0000", 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8300000000000001e-06 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343249+0000", 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.7819999999999994e-06 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343263+0000", 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4229e-05 2024-09-11T06:21:06.417 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343272+0000", 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3720000000000005e-06 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343342+0000", 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0055000000000006e-05 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:19.343354+0000", 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2224e-05 2024-09-11T06:21:06.418 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339564+0000", 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.99620991800000003 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339688+0000", 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00012414899999999999 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:18:20.339845+0000", 2024-09-11T06:21:06.419 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00015718500000000001 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124074 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2330624~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.96590487, 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050222888, 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.420 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124074 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.421 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447164+0000", 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8099999999999998e-07 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447166+0000", 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9659999999999999e-06 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447172+0000", 2024-09-11T06:21:06.422 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7139999999999998e-06 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447176+0000", 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7559999999999999e-06 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497241+0000", 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050064986999999998 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.423 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497301+0000", 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.9283999999999997e-05 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497386+0000", 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.5799999999999998e-05 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124075 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2338816~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:21:06.424 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.96587852, 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483549000000003, 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124075 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.425 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447190+0000", 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.4900000000000001e-07 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447193+0000", 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.2800000000000002e-06 2024-09-11T06:21:06.426 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447199+0000", 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1310000000000003e-06 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447203+0000", 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6689999999999997e-06 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497438+0000", 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050234187999999999 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.427 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497601+0000", 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00016377300000000001 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497673+0000", 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.2058999999999996e-05 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.428 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124076 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2347008~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.96585804, 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050624545, 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124076 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.429 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447210+0000", 2024-09-11T06:21:06.430 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447211+0000", 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.9599999999999999e-07 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447213+0000", 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.973e-06 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447219+0000", 2024-09-11T06:21:06.431 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8699999999999997e-06 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447224+0000", 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.882e-06 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497707+0000", 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050483137999999997 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497769+0000", 2024-09-11T06:21:06.432 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.2331999999999999e-05 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497835+0000", 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.5853999999999997e-05 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124077 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2355200~4096 [fadvise_nocache]] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.96583932599999, 2024-09-11T06:21:06.433 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050777023999999997, 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124077 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.434 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447229+0000", 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447230+0000", 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447232+0000", 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.9130000000000001e-06 2024-09-11T06:21:06.435 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447237+0000", 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1739999999999999e-06 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.447241+0000", 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7740000000000004e-06 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497885+0000", 2024-09-11T06:21:06.436 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050643411999999999 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.497937+0000", 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.1785e-05 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.498006+0000", 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.9422e-05 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.437 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124194 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2654208~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.957108492, 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050168208999999998, 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124194 2024-09-11T06:21:06.438 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.439 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455960+0000", 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.34e-07 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455962+0000", 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.871e-06 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455968+0000", 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4859999999999997e-06 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.440 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455972+0000", 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.702e-06 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506006+0000", 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050033929999999997 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.441 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506065+0000", 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8504000000000001e-05 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506128+0000", 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3281999999999995e-05 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124195 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2662400~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:21:06.442 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.957074908, 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050396183999999997, 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124195 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.443 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455994+0000", 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.7599999999999998e-07 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.444 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455996+0000", 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.8080000000000001e-06 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.455999+0000", 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.8240000000000001e-06 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456002+0000", 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9189999999999999e-06 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.445 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506176+0000", 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050173626999999998 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506270+0000", 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4043999999999996e-05 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506390+0000", 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011968600000000001 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.446 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124196 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2670592~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.957062079, 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050533751000000002, 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124196 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456006+0000", 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.448 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456007+0000", 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.11e-07 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456008+0000", 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2139999999999999e-06 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.449 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456011+0000", 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.01e-06 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456013+0000", 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.65e-06 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506422+0000", 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050408609 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.450 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506472+0000", 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0265000000000001e-05 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506540+0000", 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.7792000000000004e-05 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.451 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124197 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2678784~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.95705194200001, 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050750788999999998, 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124197 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.452 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456016+0000", 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456017+0000", 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6899999999999999e-07 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.453 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456018+0000", 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0839999999999999e-06 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456021+0000", 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9160000000000001e-06 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456024+0000", 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 3.5250000000000001e-06 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.454 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506572+0000", 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050548195999999997 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506656+0000", 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.3659000000000007e-05 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506767+0000", 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00011114 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.455 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124198 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2686976~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:21:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.957041124, 2024-09-11T06:21:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050883155999999999, 2024-09-11T06:21:06.456 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124198 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.457 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456027+0000", 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456029+0000", 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:21:06.458 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456032+0000", 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.9749999999999999e-06 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456034+0000", 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5629999999999999e-06 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506804+0000", 2024-09-11T06:21:06.459 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050769720999999997 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506852+0000", 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7976000000000003e-05 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506910+0000", 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.8520000000000002e-05 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.460 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124199 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2695168~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.95703124400001, 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051083061999999999, 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124199 2024-09-11T06:21:06.461 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.462 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456037+0000", 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456038+0000", 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0950000000000001e-06 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456041+0000", 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.835e-06 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.463 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456044+0000", 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6139999999999999e-06 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.506951+0000", 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050906831 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507046+0000", 2024-09-11T06:21:06.464 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5662000000000007e-05 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507120+0000", 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.3824000000000003e-05 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124200 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2703360~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.957021513, 2024-09-11T06:21:06.465 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051292289999999997, 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124200 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.466 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456047+0000", 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.04e-07 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456048+0000", 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.046e-06 2024-09-11T06:21:06.467 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456051+0000", 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8710000000000001e-06 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456054+0000", 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.543e-06 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507161+0000", 2024-09-11T06:21:06.468 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051107909999999999 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507256+0000", 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4735999999999996e-05 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507339+0000", 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.2979999999999995e-05 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.469 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124201 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2711552~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.95701189499999, 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051430280000000002, 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.470 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124201 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.471 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456057+0000", 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456058+0000", 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.079e-06 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456061+0000", 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8490000000000002e-06 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.472 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456063+0000", 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6120000000000001e-06 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507365+0000", 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051301840000000001 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507411+0000", 2024-09-11T06:21:06.473 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.6146000000000002e-05 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507487+0000", 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.5551999999999998e-05 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124202 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2719744~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.957002081, 2024-09-11T06:21:06.474 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051654548000000002, 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124202 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.475 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456066+0000", 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456067+0000", 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.1500000000000001e-07 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456071+0000", 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7119999999999999e-06 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456075+0000", 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.1989999999999999e-06 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456078+0000", 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8260000000000001e-06 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.477 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507516+0000", 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051437418999999998 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507606+0000", 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0259000000000004e-05 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.478 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507721+0000", 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114918 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124203 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2727936~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.956986714, 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051940674999999999, 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.479 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124203 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.480 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456082+0000", 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.22e-07 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456083+0000", 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1999999999999999e-06 2024-09-11T06:21:06.481 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456086+0000", 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8890000000000002e-06 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456089+0000", 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.5490000000000001e-06 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507796+0000", 2024-09-11T06:21:06.482 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.051707850999999999 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.507891+0000", 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.4729999999999996e-05 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508022+0000", 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00013123400000000001 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.483 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124204 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2736128~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.956976412, 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.052170121, 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124204 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.484 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.456092+0000", 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457756+0000", 2024-09-11T06:21:06.485 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.0016639249999999999 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457761+0000", 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 4.7530000000000001e-06 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457772+0000", 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1246e-05 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.486 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457779+0000", 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.469e-06 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508061+0000", 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050281588000000002 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508152+0000", 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.0921000000000006e-05 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.487 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508262+0000", 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000110219 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124205 3.1a 3:5e8f8b01:::rbd_data.116da7b621ae.0000000000000003:3d [read 2744320~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.955276129, 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050701098, 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.488 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124205 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457792+0000", 2024-09-11T06:21:06.489 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457793+0000", 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.44e-07 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457796+0000", 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6979999999999998e-06 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.490 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457803+0000", 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.0790000000000003e-06 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.457808+0000", 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.3689999999999998e-06 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508284+0000", 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050476193000000003 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.491 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508379+0000", 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.5001999999999996e-05 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.508493+0000", 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.000114213 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.492 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124300 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2605056~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.94912163399999, 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050185799000000003, 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124300 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.493 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463947+0000", 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0200000000000001e-07 2024-09-11T06:21:06.494 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463948+0000", 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.091e-06 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463951+0000", 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8119999999999999e-06 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463954+0000", 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.6469999999999998e-06 2024-09-11T06:21:06.495 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514020+0000", 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050066628000000002 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514071+0000", 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.0714999999999998e-05 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514133+0000", 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1704000000000004e-05 2024-09-11T06:21:06.496 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:124301 3.1a 3:5a868678:::rbd_data.116da7b621ae.0000000000000006:3d [read 2613248~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e137)", 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 121.949112075, 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050320190000000001, 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.497 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 124301 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463956+0000", 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.498 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463957+0000", 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.0100000000000001e-07 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463958+0000", 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2130000000000001e-06 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463961+0000", 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.8049999999999998e-06 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.499 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.463963+0000", 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 2.52e-06 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514158+0000", 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.050195070000000001 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514213+0000", 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.4493999999999997e-05 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.500 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:19:04.514277+0000", 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.3886999999999993e-05 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "description": "osd_op(client.4461.0:235794 3.1a 3:5becf0a6:::rbd_header.116db5c39c9d:head [watch reconnect cookie 139721594604592 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e237)", 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "initiated_at": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "age": 20.27926794, 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.0293680119999999, 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "continuous": false, 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "type_data": { 2024-09-11T06:21:06.501 INFO:teuthology.orchestra.run.smithi194.stdout: "flag_point": "started", 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "client_info": { 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "client": "client.4461", 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "client_addr": "172.21.15.70:0/3903275943", 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "tid": 235794 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "events": [ 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "initiated", 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "header_read", 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133800+0000", 2024-09-11T06:21:06.502 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "throttled", 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133802+0000", 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.4169999999999999e-06 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "all_read", 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133808+0000", 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 5.7810000000000002e-06 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "dispatched", 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133820+0000", 2024-09-11T06:21:06.503 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.2480000000000001e-05 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "queued_for_pg", 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133830+0000", 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 9.6460000000000005e-06 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133891+0000", 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 6.1577999999999999e-05 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for peered", 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:46.133903+0000", 2024-09-11T06:21:06.504 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.1833e-05 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.157160+0000", 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 1.023257206 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "waiting for rw locks", 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.157241+0000", 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 8.0480000000000002e-05 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "reached_pg", 2024-09-11T06:21:06.505 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.160048+0000", 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.002806804 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "started", 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.160119+0000", 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 7.1117000000000004e-05 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "event": "done", 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "time": "2024-09-11T06:20:47.163168+0000", 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: "duration": 0.00304967 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.506 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-11T06:21:06.507 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-11T06:21:06.507 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-11T06:21:06.508 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:06.507+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:06.508 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T06:21:06.524 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-11T06:21:06.525 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T06:21:06.541 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-11T06:21:06.541 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T06:21:06.557 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-11T06:21:06.557 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T06:21:06.573 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-11T06:21:06.573 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T06:21:06.589 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-11T06:21:06.589 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T06:21:06.606 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-11T06:21:06.606 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T06:21:06.608 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:06.608+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:06.624 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-11T06:21:06.624 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T06:21:06.641 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-11T06:21:06.641 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T06:21:06.654 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:06.654 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:06.663 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T06:21:06.709 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:06.708+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:06.807 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:06.807 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:06.810 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-11T06:21:06.810+0000 7fb1a0460640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33346) UID: 0 2024-09-11T06:21:06.816 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T06:21:06.912 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-11T06:21:06.911+0000 7f3966ea2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 49171) UID: 0 2024-09-11T06:21:06.958 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:06.959 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:06.968 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T06:21:07.012 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:07.011+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:07.071 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:07.071 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:07.079 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T06:21:07.121 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-11T06:21:07.120+0000 7ff816d33640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33343) UID: 0 2024-09-11T06:21:07.213 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-11T06:21:07.212+0000 7f2e9bd69640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33349) UID: 0 2024-09-11T06:21:07.228 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:07.228 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:07.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T06:21:07.248 INFO:teuthology.orchestra.run.smithi070.stdout:All operations completed A-OK! 2024-09-11T06:21:07.258 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:07.259 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-11T06:21:07.267 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-11T06:21:07.277 INFO:tasks.thrashosds:joining thrashosds 2024-09-11T06:21:07.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-11T06:21:07.384 INFO:teuthology.orchestra.run.smithi194.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:07.384 INFO:teuthology.orchestra.run.smithi194.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:07.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T06:21:07.460 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2024-09-11T06:21:07.461 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T06:21:07.472 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2024-09-11T06:21:07.472 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T06:21:07.480 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2024-09-11T06:21:07.481 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T06:21:07.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T06:21:07.501 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:07.501 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:07.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T06:21:07.657 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:07.657 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:07.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T06:21:07.771 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:07.771 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:07.780 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T06:21:07.884 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:07.885 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:07.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T06:21:07.993 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:07.994 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:08.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T06:21:08.105 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-11T06:21:08.105 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T06:21:08.163 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T06:21:08.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T06:21:08.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-11T06:21:09.171 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-11T06:21:09.172 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-11T06:21:09.188 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T06:21:09.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T06:21:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T06:21:10.136 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-11T06:21:10.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-11T06:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-11T06:21:11.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T06:21:12.184 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T06:21:12.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-11T06:21:13.186 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-11T06:21:13.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T06:21:14.192 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T06:21:14.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-11T06:21:15.133 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-11T06:21:15.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T06:21:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T06:21:16.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-11T06:21:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-11T06:21:17.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T06:21:18.214 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T06:21:18.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-11T06:21:19.223 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-11T06:21:19.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T06:21:20.228 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T06:21:20.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-11T06:21:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-11T06:21:21.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T06:21:22.239 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T06:21:22.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-11T06:21:23.249 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-11T06:21:23.263 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-11T06:21:23.263 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-11T06:21:23.263 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-11T06:21:23.263 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-11T06:21:23.264 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T06:21:23.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T06:21:23.542 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:23.542 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":274,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:21:23.244778+0000","last_up_change":"2024-09-11T06:18:57.153745+0000","last_in_change":"2024-09-11T06:20:51.154318+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T06:16:52.447451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T06:16:58.078189+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T06:17:07.729638+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":84,"snap_epoch":258,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6825","nonce":2621452558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6827","nonce":2621452558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6831","nonce":2621452558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6829","nonce":2621452558}]},"public_addr":"172.21.15.70:6825/2621452558","cluster_addr":"172.21.15.70:6827/2621452558","heartbeat_back_addr":"172.21.15.70:6831/2621452558","heartbeat_front_addr":"172.21.15.70:6829/2621452558","state":["exists","up"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":54,"up_from":92,"up_thru":245,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6817","nonce":747530186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6819","nonce":747530186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6823","nonce":747530186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6821","nonce":747530186}]},"public_addr":"172.21.15.70:6817/747530186","cluster_addr":"172.21.15.70:6819/747530186","heartbeat_back_addr":"172.21.15.70:6823/747530186","heartbeat_front_addr":"172.21.15.70:6821/747530186","state":["exists","up"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":109,"up_from":130,"up_thru":244,"down_at":110,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6809","nonce":4176263936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6811","nonce":4176263936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6815","nonce":4176263936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6813","nonce":4176263936}]},"public_addr":"172.21.15.70:6809/4176263936","cluster_addr":"172.21.15.70:6811/4176263936","heartbeat_back_addr":"172.21.15.70:6815/4176263936","heartbeat_front_addr":"172.21.15.70:6813/4176263936","state":["exists","up"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":250,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6801","nonce":2301707714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6803","nonce":2301707714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6807","nonce":2301707714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6805","nonce":2301707714}]},"public_addr":"172.21.15.70:6801/2301707714","cluster_addr":"172.21.15.70:6803/2301707714","heartbeat_back_addr":"172.21.15.70:6807/2301707714","heartbeat_front_addr":"172.21.15.70:6805/2301707714","state":["exists","up"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6809","nonce":2043476445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6811","nonce":2043476445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6815","nonce":2043476445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6813","nonce":2043476445}]},"public_addr":"172.21.15.194:6809/2043476445","cluster_addr":"172.21.15.194:6811/2043476445","heartbeat_back_addr":"172.21.15.194:6815/2043476445","heartbeat_front_addr":"172.21.15.194:6813/2043476445","state":["exists","up"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6817","nonce":213940923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6819","nonce":213940923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6823","nonce":213940923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6821","nonce":213940923}]},"public_addr":"172.21.15.194:6817/213940923","cluster_addr":"172.21.15.194:6819/213940923","heartbeat_back_addr":"172.21.15.194:6823/213940923","heartbeat_front_addr":"172.21.15.194:6821/213940923","state":["exists","up"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6825","nonce":3016223649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6827","nonce":3016223649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6831","nonce":3016223649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6829","nonce":3016223649}]},"public_addr":"172.21.15.194:6825/3016223649","cluster_addr":"172.21.15.194:6827/3016223649","heartbeat_back_addr":"172.21.15.194:6831/3016223649","heartbeat_front_addr":"172.21.15.194:6829/3016223649","state":["exists","up"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6801","nonce":2361511015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6803","nonce":2361511015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6807","nonce":2361511015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6805","nonce":2361511015}]},"public_addr":"172.21.15.194:6801/2361511015","cluster_addr":"172.21.15.194:6803/2361511015","heartbeat_back_addr":"172.21.15.194:6807/2361511015","heartbeat_front_addr":"172.21.15.194:6805/2361511015","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.852226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.638877+0000","dead_epoch":56},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.930981+0000","dead_epoch":110},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.677178+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.636635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.104700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.150845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.365417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":7,"to":4},{"from":6,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:21:23.554 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T06:21:23.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T06:21:23.833 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:23.834 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":274,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:21:23.244778+0000","last_up_change":"2024-09-11T06:18:57.153745+0000","last_in_change":"2024-09-11T06:20:51.154318+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T06:16:52.447451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T06:16:58.078189+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T06:17:07.729638+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":84,"snap_epoch":258,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6825","nonce":2621452558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6827","nonce":2621452558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6831","nonce":2621452558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6829","nonce":2621452558}]},"public_addr":"172.21.15.70:6825/2621452558","cluster_addr":"172.21.15.70:6827/2621452558","heartbeat_back_addr":"172.21.15.70:6831/2621452558","heartbeat_front_addr":"172.21.15.70:6829/2621452558","state":["exists","up"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":54,"up_from":92,"up_thru":245,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6817","nonce":747530186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6819","nonce":747530186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6823","nonce":747530186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6821","nonce":747530186}]},"public_addr":"172.21.15.70:6817/747530186","cluster_addr":"172.21.15.70:6819/747530186","heartbeat_back_addr":"172.21.15.70:6823/747530186","heartbeat_front_addr":"172.21.15.70:6821/747530186","state":["exists","up"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":109,"up_from":130,"up_thru":244,"down_at":110,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6809","nonce":4176263936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6811","nonce":4176263936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6815","nonce":4176263936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6813","nonce":4176263936}]},"public_addr":"172.21.15.70:6809/4176263936","cluster_addr":"172.21.15.70:6811/4176263936","heartbeat_back_addr":"172.21.15.70:6815/4176263936","heartbeat_front_addr":"172.21.15.70:6813/4176263936","state":["exists","up"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":250,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6801","nonce":2301707714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6803","nonce":2301707714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6807","nonce":2301707714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6805","nonce":2301707714}]},"public_addr":"172.21.15.70:6801/2301707714","cluster_addr":"172.21.15.70:6803/2301707714","heartbeat_back_addr":"172.21.15.70:6807/2301707714","heartbeat_front_addr":"172.21.15.70:6805/2301707714","state":["exists","up"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6809","nonce":2043476445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6811","nonce":2043476445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6815","nonce":2043476445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6813","nonce":2043476445}]},"public_addr":"172.21.15.194:6809/2043476445","cluster_addr":"172.21.15.194:6811/2043476445","heartbeat_back_addr":"172.21.15.194:6815/2043476445","heartbeat_front_addr":"172.21.15.194:6813/2043476445","state":["exists","up"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6817","nonce":213940923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6819","nonce":213940923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6823","nonce":213940923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6821","nonce":213940923}]},"public_addr":"172.21.15.194:6817/213940923","cluster_addr":"172.21.15.194:6819/213940923","heartbeat_back_addr":"172.21.15.194:6823/213940923","heartbeat_front_addr":"172.21.15.194:6821/213940923","state":["exists","up"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6825","nonce":3016223649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6827","nonce":3016223649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6831","nonce":3016223649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6829","nonce":3016223649}]},"public_addr":"172.21.15.194:6825/3016223649","cluster_addr":"172.21.15.194:6827/3016223649","heartbeat_back_addr":"172.21.15.194:6831/3016223649","heartbeat_front_addr":"172.21.15.194:6829/3016223649","state":["exists","up"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6801","nonce":2361511015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6803","nonce":2361511015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6807","nonce":2361511015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6805","nonce":2361511015}]},"public_addr":"172.21.15.194:6801/2361511015","cluster_addr":"172.21.15.194:6803/2361511015","heartbeat_back_addr":"172.21.15.194:6807/2361511015","heartbeat_front_addr":"172.21.15.194:6805/2361511015","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.852226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.638877+0000","dead_epoch":56},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.930981+0000","dead_epoch":110},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.677178+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.636635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.104700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.150845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.365417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":7,"to":4},{"from":6,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:21:23.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T06:21:23.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T06:21:23.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T06:21:23.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T06:21:23.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T06:21:23.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T06:21:23.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T06:21:23.850 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T06:21:24.083 INFO:teuthology.orchestra.run.smithi070.stdout:558345748511 2024-09-11T06:21:24.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T06:21:24.085 INFO:teuthology.orchestra.run.smithi070.stdout:64424509498 2024-09-11T06:21:24.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T06:21:24.091 INFO:teuthology.orchestra.run.smithi070.stdout:64424509499 2024-09-11T06:21:24.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T06:21:24.093 INFO:teuthology.orchestra.run.smithi070.stdout:64424509498 2024-09-11T06:21:24.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T06:21:24.094 INFO:teuthology.orchestra.run.smithi070.stdout:395136991271 2024-09-11T06:21:24.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T06:21:24.095 INFO:teuthology.orchestra.run.smithi070.stdout:60129542201 2024-09-11T06:21:24.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T06:21:24.096 INFO:teuthology.orchestra.run.smithi070.stdout:64424509498 2024-09-11T06:21:24.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T06:21:24.098 INFO:teuthology.orchestra.run.smithi070.stdout:55834574906 2024-09-11T06:21:24.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T06:21:24.634 INFO:teuthology.orchestra.run.smithi070.stdout:64424509497 2024-09-11T06:21:24.652 INFO:teuthology.orchestra.run.smithi070.stdout:558345748510 2024-09-11T06:21:24.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509498 got 64424509497 for osd.0 2024-09-11T06:21:24.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 558345748511 got 558345748510 for osd.2 2024-09-11T06:21:24.681 INFO:teuthology.orchestra.run.smithi070.stdout:64424509497 2024-09-11T06:21:24.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509499 got 64424509497 for osd.3 2024-09-11T06:21:24.703 INFO:teuthology.orchestra.run.smithi070.stdout:55834574905 2024-09-11T06:21:24.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574905 for osd.7 2024-09-11T06:21:24.725 INFO:teuthology.orchestra.run.smithi070.stdout:60129542200 2024-09-11T06:21:24.726 INFO:teuthology.orchestra.run.smithi070.stdout:64424509497 2024-09-11T06:21:24.734 INFO:teuthology.orchestra.run.smithi070.stdout:64424509497 2024-09-11T06:21:24.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542201 got 60129542200 for osd.6 2024-09-11T06:21:24.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509498 got 64424509497 for osd.5 2024-09-11T06:21:24.742 INFO:teuthology.orchestra.run.smithi070.stdout:395136991270 2024-09-11T06:21:24.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509498 got 64424509497 for osd.4 2024-09-11T06:21:24.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 395136991271 got 395136991270 for osd.1 2024-09-11T06:21:25.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T06:21:25.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T06:21:25.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T06:21:25.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T06:21:25.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T06:21:25.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T06:21:25.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T06:21:25.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T06:21:26.177 INFO:teuthology.orchestra.run.smithi070.stdout:64424509498 2024-09-11T06:21:26.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509498 got 64424509498 for osd.0 2024-09-11T06:21:26.196 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:26.246 INFO:teuthology.orchestra.run.smithi070.stdout:64424509499 2024-09-11T06:21:26.258 INFO:teuthology.orchestra.run.smithi070.stdout:558345748511 2024-09-11T06:21:26.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509499 got 64424509499 for osd.3 2024-09-11T06:21:26.266 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:26.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 558345748511 got 558345748511 for osd.2 2024-09-11T06:21:26.284 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:26.286 INFO:teuthology.orchestra.run.smithi070.stdout:395136991271 2024-09-11T06:21:26.294 INFO:teuthology.orchestra.run.smithi070.stdout:55834574907 2024-09-11T06:21:26.299 INFO:teuthology.orchestra.run.smithi070.stdout:60129542201 2024-09-11T06:21:26.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 395136991271 got 395136991271 for osd.1 2024-09-11T06:21:26.301 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:26.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574907 for osd.7 2024-09-11T06:21:26.308 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:26.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542201 got 60129542201 for osd.6 2024-09-11T06:21:26.314 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:26.320 INFO:teuthology.orchestra.run.smithi070.stdout:64424509498 2024-09-11T06:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509498 got 64424509498 for osd.5 2024-09-11T06:21:26.338 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:26.349 INFO:teuthology.orchestra.run.smithi070.stdout:64424509498 2024-09-11T06:21:26.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509498 got 64424509498 for osd.4 2024-09-11T06:21:26.362 DEBUG:teuthology.parallel:result is None 2024-09-11T06:21:26.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T06:21:26.362 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:21:26.682 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:26.682 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:21:26.693 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-11T06:21:26.464285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":240886,"num_read_kb":1384766,"num_write":25680,"num_write_kb":935456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4653,"num_bytes_recovered":643453866,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19322,"ondisk_log_size":19322,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403976,"kb_used_data":26008,"kb_used_omap":37,"kb_used_meta":377754,"kb_avail":754570744,"statfs":{"total":773094113280,"available":772680441856,"internally_reserved":0,"allocated":26632192,"data_stored":14394144,"data_compressed":18378,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":38504,"internal_metadata":386820504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"3.1f","version":"258'361","reported_seq":3850,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712707+0000","last_change":"2024-09-11T06:21:07.211570+0000","last_active":"2024-09-11T06:21:23.712707+0000","last_peered":"2024-09-11T06:21:23.712707+0000","last_clean":"2024-09-11T06:21:23.712707+0000","last_became_active":"2024-09-11T06:20:55.187911+0000","last_became_peered":"2024-09-11T06:20:55.187911+0000","last_unstale":"2024-09-11T06:21:23.712707+0000","last_undegraded":"2024-09-11T06:21:23.712707+0000","last_fullsized":"2024-09-11T06:21:23.712707+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:26.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097570600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2483,"num_read_kb":28994,"num_write":517,"num_write_kb":29011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":14150952,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"257'547","reported_seq":6056,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712704+0000","last_change":"2024-09-11T06:21:07.211065+0000","last_active":"2024-09-11T06:21:23.712704+0000","last_peered":"2024-09-11T06:21:23.712704+0000","last_clean":"2024-09-11T06:21:23.712704+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:21:23.712704+0000","last_undegraded":"2024-09-11T06:21:23.712704+0000","last_fullsized":"2024-09-11T06:21:23.712704+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:40.880540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047299499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5799,"num_read_kb":23656,"num_write":730,"num_write_kb":18043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"257'852","reported_seq":10947,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247708+0000","last_change":"2024-09-11T06:21:07.232839+0000","last_active":"2024-09-11T06:21:23.247708+0000","last_peered":"2024-09-11T06:21:23.247708+0000","last_clean":"2024-09-11T06:21:23.247708+0000","last_became_active":"2024-09-11T06:20:16.128387+0000","last_became_peered":"2024-09-11T06:20:16.128387+0000","last_unstale":"2024-09-11T06:21:23.247708+0000","last_undegraded":"2024-09-11T06:21:23.247708+0000","last_fullsized":"2024-09-11T06:21:23.247708+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:25.000017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085877900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11560,"num_read_kb":90044,"num_write":1319,"num_write_kb":37601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":52081629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"258'662","reported_seq":11802,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729811+0000","last_change":"2024-09-11T06:21:07.164562+0000","last_active":"2024-09-11T06:21:22.729811+0000","last_peered":"2024-09-11T06:21:22.729811+0000","last_clean":"2024-09-11T06:21:22.729811+0000","last_became_active":"2024-09-11T06:20:55.183472+0000","last_became_peered":"2024-09-11T06:20:55.183472+0000","last_unstale":"2024-09-11T06:21:22.729811+0000","last_undegraded":"2024-09-11T06:21:22.729811+0000","last_fullsized":"2024-09-11T06:21:22.729811+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:15.621722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151093,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12097,"num_read_kb":53988,"num_write":979,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":10143007,"num_keys_recovered":276,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"256'515","reported_seq":6222,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248917+0000","last_change":"2024-09-11T06:21:07.171198+0000","last_active":"2024-09-11T06:21:23.248917+0000","last_peered":"2024-09-11T06:21:23.248917+0000","last_clean":"2024-09-11T06:21:23.248917+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:21:23.248917+0000","last_undegraded":"2024-09-11T06:21:23.248917+0000","last_fullsized":"2024-09-11T06:21:23.248917+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:38.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055166700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5130,"num_read_kb":36360,"num_write":718,"num_write_kb":27489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"256'660","reported_seq":10754,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729843+0000","last_change":"2024-09-11T06:21:07.164604+0000","last_active":"2024-09-11T06:21:22.729843+0000","last_peered":"2024-09-11T06:21:22.729843+0000","last_clean":"2024-09-11T06:21:22.729843+0000","last_became_active":"2024-09-11T06:20:55.183560+0000","last_became_peered":"2024-09-11T06:20:55.183560+0000","last_unstale":"2024-09-11T06:21:22.729843+0000","last_undegraded":"2024-09-11T06:21:22.729843+0000","last_fullsized":"2024-09-11T06:21:22.729843+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:17.588003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078848799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10645,"num_read_kb":66160,"num_write":849,"num_write_kb":27853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":22168966,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"257'554","reported_seq":6776,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171097+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:20:55.181728+0000","last_became_peered":"2024-09-11T06:20:55.181728+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:43.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000465866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6471,"num_read_kb":29586,"num_write":634,"num_write_kb":18722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":372,"num_bytes_recovered":14762773,"num_keys_recovered":100,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"257'1131","reported_seq":9744,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712737+0000","last_change":"2024-09-11T06:21:07.211882+0000","last_active":"2024-09-11T06:21:23.712737+0000","last_peered":"2024-09-11T06:21:23.712737+0000","last_clean":"2024-09-11T06:21:23.712737+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:21:23.712737+0000","last_undegraded":"2024-09-11T06:21:23.712737+0000","last_fullsized":"2024-09-11T06:21:23.712737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:55.097907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010472719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13075,"num_read_kb":38666,"num_write":1619,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"255'295","reported_seq":4570,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712709+0000","last_change":"2024-09-11T06:21:07.211919+0000","last_active":"2024-09-11T06:21:23.712709+0000","last_peered":"2024-09-11T06:21:23.712709+0000","last_clean":"2024-09-11T06:21:23.712709+0000","last_became_active":"2024-09-11T06:20:14.140869+0000","last_became_peered":"2024-09-11T06:20:14.140869+0000","last_unstale":"2024-09-11T06:21:23.712709+0000","last_undegraded":"2024-09-11T06:21:23.712709+0000","last_fullsized":"2024-09-11T06:21:23.712709+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:22.240506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2899,"num_read_kb":36950,"num_write":396,"num_write_kb":23221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":21224115,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"257'612","reported_seq":8612,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248475+0000","last_change":"2024-09-11T06:21:07.164911+0000","last_active":"2024-09-11T06:21:23.248475+0000","last_peered":"2024-09-11T06:21:23.248475+0000","last_clean":"2024-09-11T06:21:23.248475+0000","last_became_active":"2024-09-11T06:20:15.124862+0000","last_became_peered":"2024-09-11T06:20:15.124862+0000","last_unstale":"2024-09-11T06:21:23.248475+0000","last_undegraded":"2024-09-11T06:21:23.248475+0000","last_fullsized":"2024-09-11T06:21:23.248475+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:37.528256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062779600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9055,"num_read_kb":39121,"num_write":753,"num_write_kb":29738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":17793964,"num_keys_recovered":77,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"257'496","reported_seq":4800,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729694+0000","last_change":"2024-09-11T06:21:07.168207+0000","last_active":"2024-09-11T06:21:22.729694+0000","last_peered":"2024-09-11T06:21:22.729694+0000","last_clean":"2024-09-11T06:21:22.729694+0000","last_became_active":"2024-09-11T06:20:01.126371+0000","last_became_peered":"2024-09-11T06:20:01.126371+0000","last_unstale":"2024-09-11T06:21:22.729694+0000","last_undegraded":"2024-09-11T06:21:22.729694+0000","last_fullsized":"2024-09-11T06:21:22.729694+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:26:00.929781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001549929,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3619,"num_read_kb":43290,"num_write":684,"num_write_kb":36893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":40168837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"257'400","reported_seq":11994,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247790+0000","last_change":"2024-09-11T06:21:07.232518+0000","last_active":"2024-09-11T06:21:23.247790+0000","last_peered":"2024-09-11T06:21:23.247790+0000","last_clean":"2024-09-11T06:21:23.247790+0000","last_became_active":"2024-09-11T06:20:15.123718+0000","last_became_peered":"2024-09-11T06:20:15.123718+0000","last_unstale":"2024-09-11T06:21:23.247790+0000","last_undegraded":"2024-09-11T06:21:23.247790+0000","last_fullsized":"2024-09-11T06:21:23.247790+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:16.231831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054683100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9669,"num_read_kb":71024,"num_write":411,"num_write_kb":42855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":83153006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247893+0000","last_change":"2024-09-11T06:20:11.126114+0000","last_active":"2024-09-11T06:21:23.247893+0000","last_peered":"2024-09-11T06:21:23.247893+0000","last_clean":"2024-09-11T06:21:23.247893+0000","last_became_active":"2024-09-11T06:20:11.125589+0000","last_became_peered":"2024-09-11T06:20:11.125589+0000","last_unstale":"2024-09-11T06:21:23.247893+0000","last_undegraded":"2024-09-11T06:21:23.247893+0000","last_fullsized":"2024-09-11T06:21:23.247893+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:26.809341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"258'374","reported_seq":5148,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248756+0000","last_change":"2024-09-11T06:21:07.171686+0000","last_active":"2024-09-11T06:21:23.248756+0000","last_peered":"2024-09-11T06:21:23.248756+0000","last_clean":"2024-09-11T06:21:23.248756+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:21:23.248756+0000","last_undegraded":"2024-09-11T06:21:23.248756+0000","last_fullsized":"2024-09-11T06:21:23.248756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:26.496746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095120700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3952,"num_read_kb":49104,"num_write":471,"num_write_kb":30546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":535,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248868+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:21:23.248868+0000","last_peered":"2024-09-11T06:21:23.248868+0000","last_clean":"2024-09-11T06:21:23.248868+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:21:23.248868+0000","last_undegraded":"2024-09-11T06:21:23.248868+0000","last_fullsized":"2024-09-11T06:21:23.248868+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"256'364","reported_seq":3899,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172112+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:22:13.850566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012844779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3327,"num_read_kb":33114,"num_write":460,"num_write_kb":24509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247811+0000","last_change":"2024-09-11T06:20:11.126588+0000","last_active":"2024-09-11T06:21:23.247811+0000","last_peered":"2024-09-11T06:21:23.247811+0000","last_clean":"2024-09-11T06:21:23.247811+0000","last_became_active":"2024-09-11T06:20:11.126287+0000","last_became_peered":"2024-09-11T06:20:11.126287+0000","last_unstale":"2024-09-11T06:21:23.247811+0000","last_undegraded":"2024-09-11T06:21:23.247811+0000","last_fullsized":"2024-09-11T06:21:23.247811+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:09.892331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"257'943","reported_seq":6729,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460918+0000","last_change":"2024-09-11T06:21:07.163783+0000","last_active":"2024-09-11T06:21:24.460918+0000","last_peered":"2024-09-11T06:21:24.460918+0000","last_clean":"2024-09-11T06:21:24.460918+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:21:24.460918+0000","last_undegraded":"2024-09-11T06:21:24.460918+0000","last_fullsized":"2024-09-11T06:21:24.460918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:43.468481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039519000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8223,"num_read_kb":61062,"num_write":1340,"num_write_kb":35882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712732+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:21:23.712732+0000","last_peered":"2024-09-11T06:21:23.712732+0000","last_clean":"2024-09-11T06:21:23.712732+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:21:23.712732+0000","last_undegraded":"2024-09-11T06:21:23.712732+0000","last_fullsized":"2024-09-11T06:21:23.712732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"258'974","reported_seq":9905,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247907+0000","last_change":"2024-09-11T06:21:07.164083+0000","last_active":"2024-09-11T06:21:23.247907+0000","last_peered":"2024-09-11T06:21:23.247907+0000","last_clean":"2024-09-11T06:21:23.247907+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:21:23.247907+0000","last_undegraded":"2024-09-11T06:21:23.247907+0000","last_fullsized":"2024-09-11T06:21:23.247907+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:51.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048838699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11583,"num_read_kb":37449,"num_write":1370,"num_write_kb":24166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"258'969","reported_seq":10311,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729568+0000","last_change":"2024-09-11T06:21:07.166913+0000","last_active":"2024-09-11T06:21:22.729568+0000","last_peered":"2024-09-11T06:21:22.729568+0000","last_clean":"2024-09-11T06:21:22.729568+0000","last_became_active":"2024-09-11T06:21:01.134591+0000","last_became_peered":"2024-09-11T06:21:01.134591+0000","last_unstale":"2024-09-11T06:21:22.729568+0000","last_undegraded":"2024-09-11T06:21:22.729568+0000","last_fullsized":"2024-09-11T06:21:22.729568+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:47.635577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036423400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11250,"num_read_kb":40045,"num_write":1055,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":373,"num_bytes_recovered":38854008,"num_keys_recovered":188,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247693+0000","last_change":"2024-09-11T06:20:11.130922+0000","last_active":"2024-09-11T06:21:23.247693+0000","last_peered":"2024-09-11T06:21:23.247693+0000","last_clean":"2024-09-11T06:21:23.247693+0000","last_became_active":"2024-09-11T06:20:11.125223+0000","last_became_peered":"2024-09-11T06:20:11.125223+0000","last_unstale":"2024-09-11T06:21:23.247693+0000","last_undegraded":"2024-09-11T06:21:23.247693+0000","last_fullsized":"2024-09-11T06:21:23.247693+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:32.651537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"256'597","reported_seq":6403,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712586+0000","last_change":"2024-09-11T06:21:07.211650+0000","last_active":"2024-09-11T06:21:23.712586+0000","last_peered":"2024-09-11T06:21:23.712586+0000","last_clean":"2024-09-11T06:21:23.712586+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:21:23.712586+0000","last_undegraded":"2024-09-11T06:21:23.712586+0000","last_fullsized":"2024-09-11T06:21:23.712586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:13.219129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097915299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5551,"num_read_kb":37240,"num_write":814,"num_write_kb":37266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.637461+0000","last_change":"2024-09-11T06:20:17.138900+0000","last_active":"2024-09-11T06:21:23.637461+0000","last_peered":"2024-09-11T06:21:23.637461+0000","last_clean":"2024-09-11T06:21:23.637461+0000","last_became_active":"2024-09-11T06:20:17.138587+0000","last_became_peered":"2024-09-11T06:20:17.138587+0000","last_unstale":"2024-09-11T06:21:23.637461+0000","last_undegraded":"2024-09-11T06:21:23.637461+0000","last_fullsized":"2024-09-11T06:21:23.637461+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:45.951420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"258'917","reported_seq":4060,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460865+0000","last_change":"2024-09-11T06:21:07.163704+0000","last_active":"2024-09-11T06:21:24.460865+0000","last_peered":"2024-09-11T06:21:24.460865+0000","last_clean":"2024-09-11T06:21:24.460865+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:21:24.460865+0000","last_undegraded":"2024-09-11T06:21:24.460865+0000","last_fullsized":"2024-09-11T06:21:24.460865+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:27.675499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033761000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4034,"num_read_kb":32429,"num_write":1192,"num_write_kb":32728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247705+0000","last_change":"2024-09-11T06:20:11.126087+0000","last_active":"2024-09-11T06:21:23.247705+0000","last_peered":"2024-09-11T06:21:23.247705+0000","last_clean":"2024-09-11T06:21:23.247705+0000","last_became_active":"2024-09-11T06:20:11.125761+0000","last_became_peered":"2024-09-11T06:20:11.125761+0000","last_unstale":"2024-09-11T06:21:23.247705+0000","last_undegraded":"2024-09-11T06:21:23.247705+0000","last_fullsized":"2024-09-11T06:21:23.247705+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:30.205706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"257'608","reported_seq":8302,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248717+0000","last_change":"2024-09-11T06:21:07.171394+0000","last_active":"2024-09-11T06:21:23.248717+0000","last_peered":"2024-09-11T06:21:23.248717+0000","last_clean":"2024-09-11T06:21:23.248717+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:21:23.248717+0000","last_undegraded":"2024-09-11T06:21:23.248717+0000","last_fullsized":"2024-09-11T06:21:23.248717+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:03.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074336300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8361,"num_read_kb":32287,"num_write":839,"num_write_kb":30197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248095+0000","last_change":"2024-09-11T06:20:11.132669+0000","last_active":"2024-09-11T06:21:23.248095+0000","last_peered":"2024-09-11T06:21:23.248095+0000","last_clean":"2024-09-11T06:21:23.248095+0000","last_became_active":"2024-09-11T06:20:11.128373+0000","last_became_peered":"2024-09-11T06:20:11.128373+0000","last_unstale":"2024-09-11T06:21:23.248095+0000","last_undegraded":"2024-09-11T06:21:23.248095+0000","last_fullsized":"2024-09-11T06:21:23.248095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:55.902272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729719+0000","last_change":"2024-09-11T06:20:55.186236+0000","last_active":"2024-09-11T06:21:22.729719+0000","last_peered":"2024-09-11T06:21:22.729719+0000","last_clean":"2024-09-11T06:21:22.729719+0000","last_became_active":"2024-09-11T06:20:55.185644+0000","last_became_peered":"2024-09-11T06:20:55.185644+0000","last_unstale":"2024-09-11T06:21:22.729719+0000","last_undegraded":"2024-09-11T06:21:22.729719+0000","last_fullsized":"2024-09-11T06:21:22.729719+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:08:57.958332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'617","reported_seq":9845,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171488+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:18.809578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085945499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10608,"num_read_kb":43637,"num_write":702,"num_write_kb":29819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"257'381","reported_seq":8136,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247967+0000","last_change":"2024-09-11T06:21:07.233807+0000","last_active":"2024-09-11T06:21:23.247967+0000","last_peered":"2024-09-11T06:21:23.247967+0000","last_clean":"2024-09-11T06:21:23.247967+0000","last_became_active":"2024-09-11T06:20:15.126658+0000","last_became_peered":"2024-09-11T06:20:15.126658+0000","last_unstale":"2024-09-11T06:21:23.247967+0000","last_undegraded":"2024-09-11T06:21:23.247967+0000","last_fullsized":"2024-09-11T06:21:23.247967+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:36:46.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015157700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6873,"num_read_kb":49442,"num_write":558,"num_write_kb":30232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":34465896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"258'457","reported_seq":13065,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247789+0000","last_change":"2024-09-11T06:21:07.233521+0000","last_active":"2024-09-11T06:21:23.247789+0000","last_peered":"2024-09-11T06:21:23.247789+0000","last_clean":"2024-09-11T06:21:23.247789+0000","last_became_active":"2024-09-11T06:20:55.185551+0000","last_became_peered":"2024-09-11T06:20:55.185551+0000","last_unstale":"2024-09-11T06:21:23.247789+0000","last_undegraded":"2024-09-11T06:21:23.247789+0000","last_fullsized":"2024-09-11T06:21:23.247789+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:14.553047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013440069999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11885,"num_read_kb":48576,"num_write":550,"num_write_kb":27176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":312,"num_bytes_recovered":43677693,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"258'591","reported_seq":3605,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172022+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:33.648367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011988350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3308,"num_read_kb":19950,"num_write":926,"num_write_kb":26888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"257'662","reported_seq":3665,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729617+0000","last_change":"2024-09-11T06:21:07.167902+0000","last_active":"2024-09-11T06:21:22.729617+0000","last_peered":"2024-09-11T06:21:22.729617+0000","last_clean":"2024-09-11T06:21:22.729617+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:21:22.729617+0000","last_undegraded":"2024-09-11T06:21:22.729617+0000","last_fullsized":"2024-09-11T06:21:22.729617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:35.433625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012361620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3701,"num_read_kb":23930,"num_write":870,"num_write_kb":19296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"256'543","reported_seq":8287,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247910+0000","last_change":"2024-09-11T06:21:07.233878+0000","last_active":"2024-09-11T06:21:23.247910+0000","last_peered":"2024-09-11T06:21:23.247910+0000","last_clean":"2024-09-11T06:21:23.247910+0000","last_became_active":"2024-09-11T06:20:55.187089+0000","last_became_peered":"2024-09-11T06:20:55.187089+0000","last_unstale":"2024-09-11T06:21:23.247910+0000","last_undegraded":"2024-09-11T06:21:23.247910+0000","last_fullsized":"2024-09-11T06:21:23.247910+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:55.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001394836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7264,"num_read_kb":39003,"num_write":875,"num_write_kb":32876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":46719635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"257'647","reported_seq":20365,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248092+0000","last_change":"2024-09-11T06:21:07.165097+0000","last_active":"2024-09-11T06:21:23.248092+0000","last_peered":"2024-09-11T06:21:23.248092+0000","last_clean":"2024-09-11T06:21:23.248092+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:21:23.248092+0000","last_undegraded":"2024-09-11T06:21:23.248092+0000","last_fullsized":"2024-09-11T06:21:23.248092+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:29.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046631299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19910,"num_read_kb":76827,"num_write":792,"num_write_kb":30925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"258'605","reported_seq":5587,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729661+0000","last_change":"2024-09-11T06:21:07.167856+0000","last_active":"2024-09-11T06:21:22.729661+0000","last_peered":"2024-09-11T06:21:22.729661+0000","last_clean":"2024-09-11T06:21:22.729661+0000","last_became_active":"2024-09-11T06:20:55.184580+0000","last_became_peered":"2024-09-11T06:20:55.184580+0000","last_unstale":"2024-09-11T06:21:22.729661+0000","last_undegraded":"2024-09-11T06:21:22.729661+0000","last_fullsized":"2024-09-11T06:21:22.729661+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:46.496101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5156,"num_read_kb":38869,"num_write":703,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":26301332,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"258'540","reported_seq":8824,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729676+0000","last_change":"2024-09-11T06:21:07.163986+0000","last_active":"2024-09-11T06:21:22.729676+0000","last_peered":"2024-09-11T06:21:22.729676+0000","last_clean":"2024-09-11T06:21:22.729676+0000","last_became_active":"2024-09-11T06:20:55.183516+0000","last_became_peered":"2024-09-11T06:20:55.183516+0000","last_unstale":"2024-09-11T06:21:22.729676+0000","last_undegraded":"2024-09-11T06:21:22.729676+0000","last_fullsized":"2024-09-11T06:21:22.729676+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:33.254338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058563300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10001,"num_read_kb":48815,"num_write":537,"num_write_kb":34952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":20336086,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"255'455","reported_seq":8137,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247616+0000","last_change":"2024-09-11T06:21:07.233623+0000","last_active":"2024-09-11T06:21:23.247616+0000","last_peered":"2024-09-11T06:21:23.247616+0000","last_clean":"2024-09-11T06:21:23.247616+0000","last_became_active":"2024-09-11T06:20:15.123510+0000","last_became_peered":"2024-09-11T06:20:15.123510+0000","last_unstale":"2024-09-11T06:21:23.247616+0000","last_undegraded":"2024-09-11T06:21:23.247616+0000","last_fullsized":"2024-09-11T06:21:23.247616+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:39.520602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014223840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7512,"num_read_kb":50605,"num_write":531,"num_write_kb":34454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":37321190,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"257'453","reported_seq":3526,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460876+0000","last_change":"2024-09-11T06:21:07.163974+0000","last_active":"2024-09-11T06:21:24.460876+0000","last_peered":"2024-09-11T06:21:24.460876+0000","last_clean":"2024-09-11T06:21:24.460876+0000","last_became_active":"2024-09-11T06:20:14.140669+0000","last_became_peered":"2024-09-11T06:20:14.140669+0000","last_unstale":"2024-09-11T06:21:24.460876+0000","last_undegraded":"2024-09-11T06:21:24.460876+0000","last_fullsized":"2024-09-11T06:21:24.460876+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:29:21.007653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053784199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2621,"num_read_kb":28703,"num_write":734,"num_write_kb":23980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":19686402,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"256'420","reported_seq":4184,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247810+0000","last_change":"2024-09-11T06:21:07.232571+0000","last_active":"2024-09-11T06:21:23.247810+0000","last_peered":"2024-09-11T06:21:23.247810+0000","last_clean":"2024-09-11T06:21:23.247810+0000","last_became_active":"2024-09-11T06:20:15.128338+0000","last_became_peered":"2024-09-11T06:20:15.128338+0000","last_unstale":"2024-09-11T06:21:23.247810+0000","last_undegraded":"2024-09-11T06:21:23.247810+0000","last_fullsized":"2024-09-11T06:21:23.247810+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:11.186605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067989400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3148,"num_read_kb":35740,"num_write":591,"num_write_kb":26613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":24813340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240770,"num_read_kb":1384666,"num_write":25519,"num_write_kb":933038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4648,"num_bytes_recovered":642863479,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25754,"internal_metadata":0},"log_size":19202,"ondisk_log_size":19202,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":28087,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56696,"kb_used_data":3300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315144,"statfs":{"total":96636764160,"available":96578707456,"internally_reserved":0,"allocated":3379200,"data_stored":2243516,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34428,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337412,"statfs":{"total":96636764160,"available":96601509888,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48324,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323516,"statfs":{"total":96636764160,"available":96587280384,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748512,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":3240,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991271,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35996,"kb_used_data":3272,"kb_used_omap":10,"kb_used_meta":32693,"kb_avail":94335844,"statfs":{"total":96636764160,"available":96599904256,"internally_reserved":0,"allocated":3350528,"data_stored":2237666,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":10357,"internal_metadata":33478539},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64948,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306892,"statfs":{"total":96636764160,"available":96570257408,"internally_reserved":0,"allocated":3305472,"data_stored":1647279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52484,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:21:26.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:21:26.971 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:26.971 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:21:26.983 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-11T06:21:26.464285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":240886,"num_read_kb":1384766,"num_write":25680,"num_write_kb":935456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4653,"num_bytes_recovered":643453866,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19322,"ondisk_log_size":19322,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403976,"kb_used_data":26008,"kb_used_omap":37,"kb_used_meta":377754,"kb_avail":754570744,"statfs":{"total":773094113280,"available":772680441856,"internally_reserved":0,"allocated":26632192,"data_stored":14394144,"data_compressed":18378,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":38504,"internal_metadata":386820504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"3.1f","version":"258'361","reported_seq":3850,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712707+0000","last_change":"2024-09-11T06:21:07.211570+0000","last_active":"2024-09-11T06:21:23.712707+0000","last_peered":"2024-09-11T06:21:23.712707+0000","last_clean":"2024-09-11T06:21:23.712707+0000","last_became_active":"2024-09-11T06:20:55.187911+0000","last_became_peered":"2024-09-11T06:20:55.187911+0000","last_unstale":"2024-09-11T06:21:23.712707+0000","last_undegraded":"2024-09-11T06:21:23.712707+0000","last_fullsized":"2024-09-11T06:21:23.712707+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:26.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097570600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2483,"num_read_kb":28994,"num_write":517,"num_write_kb":29011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":14150952,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"257'547","reported_seq":6056,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712704+0000","last_change":"2024-09-11T06:21:07.211065+0000","last_active":"2024-09-11T06:21:23.712704+0000","last_peered":"2024-09-11T06:21:23.712704+0000","last_clean":"2024-09-11T06:21:23.712704+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:21:23.712704+0000","last_undegraded":"2024-09-11T06:21:23.712704+0000","last_fullsized":"2024-09-11T06:21:23.712704+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:40.880540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047299499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5799,"num_read_kb":23656,"num_write":730,"num_write_kb":18043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"257'852","reported_seq":10947,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247708+0000","last_change":"2024-09-11T06:21:07.232839+0000","last_active":"2024-09-11T06:21:23.247708+0000","last_peered":"2024-09-11T06:21:23.247708+0000","last_clean":"2024-09-11T06:21:23.247708+0000","last_became_active":"2024-09-11T06:20:16.128387+0000","last_became_peered":"2024-09-11T06:20:16.128387+0000","last_unstale":"2024-09-11T06:21:23.247708+0000","last_undegraded":"2024-09-11T06:21:23.247708+0000","last_fullsized":"2024-09-11T06:21:23.247708+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:25.000017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085877900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11560,"num_read_kb":90044,"num_write":1319,"num_write_kb":37601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":52081629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"258'662","reported_seq":11802,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729811+0000","last_change":"2024-09-11T06:21:07.164562+0000","last_active":"2024-09-11T06:21:22.729811+0000","last_peered":"2024-09-11T06:21:22.729811+0000","last_clean":"2024-09-11T06:21:22.729811+0000","last_became_active":"2024-09-11T06:20:55.183472+0000","last_became_peered":"2024-09-11T06:20:55.183472+0000","last_unstale":"2024-09-11T06:21:22.729811+0000","last_undegraded":"2024-09-11T06:21:22.729811+0000","last_fullsized":"2024-09-11T06:21:22.729811+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:15.621722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151093,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12097,"num_read_kb":53988,"num_write":979,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":10143007,"num_keys_recovered":276,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"256'515","reported_seq":6222,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248917+0000","last_change":"2024-09-11T06:21:07.171198+0000","last_active":"2024-09-11T06:21:23.248917+0000","last_peered":"2024-09-11T06:21:23.248917+0000","last_clean":"2024-09-11T06:21:23.248917+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:21:23.248917+0000","last_undegraded":"2024-09-11T06:21:23.248917+0000","last_fullsized":"2024-09-11T06:21:23.248917+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:38.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055166700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5130,"num_read_kb":36360,"num_write":718,"num_write_kb":27489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"256'660","reported_seq":10754,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729843+0000","last_change":"2024-09-11T06:21:07.164604+0000","last_active":"2024-09-11T06:21:22.729843+0000","last_peered":"2024-09-11T06:21:22.729843+0000","last_clean":"2024-09-11T06:21:22.729843+0000","last_became_active":"2024-09-11T06:20:55.183560+0000","last_became_peered":"2024-09-11T06:20:55.183560+0000","last_unstale":"2024-09-11T06:21:22.729843+0000","last_undegraded":"2024-09-11T06:21:22.729843+0000","last_fullsized":"2024-09-11T06:21:22.729843+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:17.588003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078848799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10645,"num_read_kb":66160,"num_write":849,"num_write_kb":27853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":22168966,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"257'554","reported_seq":6776,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171097+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:20:55.181728+0000","last_became_peered":"2024-09-11T06:20:55.181728+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:43.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000465866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6471,"num_read_kb":29586,"num_write":634,"num_write_kb":18722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":372,"num_bytes_recovered":14762773,"num_keys_recovered":100,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"257'1131","reported_seq":9744,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712737+0000","last_change":"2024-09-11T06:21:07.211882+0000","last_active":"2024-09-11T06:21:23.712737+0000","last_peered":"2024-09-11T06:21:23.712737+0000","last_clean":"2024-09-11T06:21:23.712737+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:21:23.712737+0000","last_undegraded":"2024-09-11T06:21:23.712737+0000","last_fullsized":"2024-09-11T06:21:23.712737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:55.097907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010472719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13075,"num_read_kb":38666,"num_write":1619,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"255'295","reported_seq":4570,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712709+0000","last_change":"2024-09-11T06:21:07.211919+0000","last_active":"2024-09-11T06:21:23.712709+0000","last_peered":"2024-09-11T06:21:23.712709+0000","last_clean":"2024-09-11T06:21:23.712709+0000","last_became_active":"2024-09-11T06:20:14.140869+0000","last_became_peered":"2024-09-11T06:20:14.140869+0000","last_unstale":"2024-09-11T06:21:23.712709+0000","last_undegraded":"2024-09-11T06:21:23.712709+0000","last_fullsized":"2024-09-11T06:21:23.712709+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:22.240506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2899,"num_read_kb":36950,"num_write":396,"num_write_kb":23221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":21224115,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"257'612","reported_seq":8612,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248475+0000","last_change":"2024-09-11T06:21:07.164911+0000","last_active":"2024-09-11T06:21:23.248475+0000","last_peered":"2024-09-11T06:21:23.248475+0000","last_clean":"2024-09-11T06:21:23.248475+0000","last_became_active":"2024-09-11T06:20:15.124862+0000","last_became_peered":"2024-09-11T06:20:15.124862+0000","last_unstale":"2024-09-11T06:21:23.248475+0000","last_undegraded":"2024-09-11T06:21:23.248475+0000","last_fullsized":"2024-09-11T06:21:23.248475+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:37.528256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062779600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9055,"num_read_kb":39121,"num_write":753,"num_write_kb":29738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":17793964,"num_keys_recovered":77,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"257'496","reported_seq":4800,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729694+0000","last_change":"2024-09-11T06:21:07.168207+0000","last_active":"2024-09-11T06:21:22.729694+0000","last_peered":"2024-09-11T06:21:22.729694+0000","last_clean":"2024-09-11T06:21:22.729694+0000","last_became_active":"2024-09-11T06:20:01.126371+0000","last_became_peered":"2024-09-11T06:20:01.126371+0000","last_unstale":"2024-09-11T06:21:22.729694+0000","last_undegraded":"2024-09-11T06:21:22.729694+0000","last_fullsized":"2024-09-11T06:21:22.729694+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:26:00.929781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001549929,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3619,"num_read_kb":43290,"num_write":684,"num_write_kb":36893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":40168837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"257'400","reported_seq":11994,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247790+0000","last_change":"2024-09-11T06:21:07.232518+0000","last_active":"2024-09-11T06:21:23.247790+0000","last_peered":"2024-09-11T06:21:23.247790+0000","last_clean":"2024-09-11T06:21:23.247790+0000","last_became_active":"2024-09-11T06:20:15.123718+0000","last_became_peered":"2024-09-11T06:20:15.123718+0000","last_unstale":"2024-09-11T06:21:23.247790+0000","last_undegraded":"2024-09-11T06:21:23.247790+0000","last_fullsized":"2024-09-11T06:21:23.247790+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:16.231831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054683100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9669,"num_read_kb":71024,"num_write":411,"num_write_kb":42855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":83153006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247893+0000","last_change":"2024-09-11T06:20:11.126114+0000","last_active":"2024-09-11T06:21:23.247893+0000","last_peered":"2024-09-11T06:21:23.247893+0000","last_clean":"2024-09-11T06:21:23.247893+0000","last_became_active":"2024-09-11T06:20:11.125589+0000","last_became_peered":"2024-09-11T06:20:11.125589+0000","last_unstale":"2024-09-11T06:21:23.247893+0000","last_undegraded":"2024-09-11T06:21:23.247893+0000","last_fullsized":"2024-09-11T06:21:23.247893+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:26.809341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"258'374","reported_seq":5148,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248756+0000","last_change":"2024-09-11T06:21:07.171686+0000","last_active":"2024-09-11T06:21:23.248756+0000","last_peered":"2024-09-11T06:21:23.248756+0000","last_clean":"2024-09-11T06:21:23.248756+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:21:23.248756+0000","last_undegraded":"2024-09-11T06:21:23.248756+0000","last_fullsized":"2024-09-11T06:21:23.248756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:26.496746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095120700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3952,"num_read_kb":49104,"num_write":471,"num_write_kb":30546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":535,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248868+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:21:23.248868+0000","last_peered":"2024-09-11T06:21:23.248868+0000","last_clean":"2024-09-11T06:21:23.248868+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:21:23.248868+0000","last_undegraded":"2024-09-11T06:21:23.248868+0000","last_fullsized":"2024-09-11T06:21:23.248868+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"256'364","reported_seq":3899,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172112+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:22:13.850566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012844779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3327,"num_read_kb":33114,"num_write":460,"num_write_kb":24509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247811+0000","last_change":"2024-09-11T06:20:11.126588+0000","last_active":"2024-09-11T06:21:23.247811+0000","last_peered":"2024-09-11T06:21:23.247811+0000","last_clean":"2024-09-11T06:21:23.247811+0000","last_became_active":"2024-09-11T06:20:11.126287+0000","last_became_peered":"2024-09-11T06:20:11.126287+0000","last_unstale":"2024-09-11T06:21:23.247811+0000","last_undegraded":"2024-09-11T06:21:23.247811+0000","last_fullsized":"2024-09-11T06:21:23.247811+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:09.892331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"257'943","reported_seq":6729,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460918+0000","last_change":"2024-09-11T06:21:07.163783+0000","last_active":"2024-09-11T06:21:24.460918+0000","last_peered":"2024-09-11T06:21:24.460918+0000","last_clean":"2024-09-11T06:21:24.460918+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:21:24.460918+0000","last_undegraded":"2024-09-11T06:21:24.460918+0000","last_fullsized":"2024-09-11T06:21:24.460918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:43.468481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039519000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8223,"num_read_kb":61062,"num_write":1340,"num_write_kb":35882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712732+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:21:23.712732+0000","last_peered":"2024-09-11T06:21:23.712732+0000","last_clean":"2024-09-11T06:21:23.712732+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:21:23.712732+0000","last_undegraded":"2024-09-11T06:21:23.712732+0000","last_fullsized":"2024-09-11T06:21:23.712732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"258'974","reported_seq":9905,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247907+0000","last_change":"2024-09-11T06:21:07.164083+0000","last_active":"2024-09-11T06:21:23.247907+0000","last_peered":"2024-09-11T06:21:23.247907+0000","last_clean":"2024-09-11T06:21:23.247907+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:21:23.247907+0000","last_undegraded":"2024-09-11T06:21:23.247907+0000","last_fullsized":"2024-09-11T06:21:23.247907+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:51.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048838699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11583,"num_read_kb":37449,"num_write":1370,"num_write_kb":24166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"258'969","reported_seq":10311,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729568+0000","last_change":"2024-09-11T06:21:07.166913+0000","last_active":"2024-09-11T06:21:22.729568+0000","last_peered":"2024-09-11T06:21:22.729568+0000","last_clean":"2024-09-11T06:21:22.729568+0000","last_became_active":"2024-09-11T06:21:01.134591+0000","last_became_peered":"2024-09-11T06:21:01.134591+0000","last_unstale":"2024-09-11T06:21:22.729568+0000","last_undegraded":"2024-09-11T06:21:22.729568+0000","last_fullsized":"2024-09-11T06:21:22.729568+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:47.635577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036423400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11250,"num_read_kb":40045,"num_write":1055,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":373,"num_bytes_recovered":38854008,"num_keys_recovered":188,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247693+0000","last_change":"2024-09-11T06:20:11.130922+0000","last_active":"2024-09-11T06:21:23.247693+0000","last_peered":"2024-09-11T06:21:23.247693+0000","last_clean":"2024-09-11T06:21:23.247693+0000","last_became_active":"2024-09-11T06:20:11.125223+0000","last_became_peered":"2024-09-11T06:20:11.125223+0000","last_unstale":"2024-09-11T06:21:23.247693+0000","last_undegraded":"2024-09-11T06:21:23.247693+0000","last_fullsized":"2024-09-11T06:21:23.247693+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:32.651537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"256'597","reported_seq":6403,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712586+0000","last_change":"2024-09-11T06:21:07.211650+0000","last_active":"2024-09-11T06:21:23.712586+0000","last_peered":"2024-09-11T06:21:23.712586+0000","last_clean":"2024-09-11T06:21:23.712586+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:21:23.712586+0000","last_undegraded":"2024-09-11T06:21:23.712586+0000","last_fullsized":"2024-09-11T06:21:23.712586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:13.219129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097915299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5551,"num_read_kb":37240,"num_write":814,"num_write_kb":37266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.637461+0000","last_change":"2024-09-11T06:20:17.138900+0000","last_active":"2024-09-11T06:21:23.637461+0000","last_peered":"2024-09-11T06:21:23.637461+0000","last_clean":"2024-09-11T06:21:23.637461+0000","last_became_active":"2024-09-11T06:20:17.138587+0000","last_became_peered":"2024-09-11T06:20:17.138587+0000","last_unstale":"2024-09-11T06:21:23.637461+0000","last_undegraded":"2024-09-11T06:21:23.637461+0000","last_fullsized":"2024-09-11T06:21:23.637461+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:45.951420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"258'917","reported_seq":4060,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460865+0000","last_change":"2024-09-11T06:21:07.163704+0000","last_active":"2024-09-11T06:21:24.460865+0000","last_peered":"2024-09-11T06:21:24.460865+0000","last_clean":"2024-09-11T06:21:24.460865+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:21:24.460865+0000","last_undegraded":"2024-09-11T06:21:24.460865+0000","last_fullsized":"2024-09-11T06:21:24.460865+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:27.675499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033761000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4034,"num_read_kb":32429,"num_write":1192,"num_write_kb":32728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247705+0000","last_change":"2024-09-11T06:20:11.126087+0000","last_active":"2024-09-11T06:21:23.247705+0000","last_peered":"2024-09-11T06:21:23.247705+0000","last_clean":"2024-09-11T06:21:23.247705+0000","last_became_active":"2024-09-11T06:20:11.125761+0000","last_became_peered":"2024-09-11T06:20:11.125761+0000","last_unstale":"2024-09-11T06:21:23.247705+0000","last_undegraded":"2024-09-11T06:21:23.247705+0000","last_fullsized":"2024-09-11T06:21:23.247705+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:30.205706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"257'608","reported_seq":8302,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248717+0000","last_change":"2024-09-11T06:21:07.171394+0000","last_active":"2024-09-11T06:21:23.248717+0000","last_peered":"2024-09-11T06:21:23.248717+0000","last_clean":"2024-09-11T06:21:23.248717+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:21:23.248717+0000","last_undegraded":"2024-09-11T06:21:23.248717+0000","last_fullsized":"2024-09-11T06:21:23.248717+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:03.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074336300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8361,"num_read_kb":32287,"num_write":839,"num_write_kb":30197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248095+0000","last_change":"2024-09-11T06:20:11.132669+0000","last_active":"2024-09-11T06:21:23.248095+0000","last_peered":"2024-09-11T06:21:23.248095+0000","last_clean":"2024-09-11T06:21:23.248095+0000","last_became_active":"2024-09-11T06:20:11.128373+0000","last_became_peered":"2024-09-11T06:20:11.128373+0000","last_unstale":"2024-09-11T06:21:23.248095+0000","last_undegraded":"2024-09-11T06:21:23.248095+0000","last_fullsized":"2024-09-11T06:21:23.248095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:55.902272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729719+0000","last_change":"2024-09-11T06:20:55.186236+0000","last_active":"2024-09-11T06:21:22.729719+0000","last_peered":"2024-09-11T06:21:22.729719+0000","last_clean":"2024-09-11T06:21:22.729719+0000","last_became_active":"2024-09-11T06:20:55.185644+0000","last_became_peered":"2024-09-11T06:20:55.185644+0000","last_unstale":"2024-09-11T06:21:22.729719+0000","last_undegraded":"2024-09-11T06:21:22.729719+0000","last_fullsized":"2024-09-11T06:21:22.729719+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:08:57.958332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'617","reported_seq":9845,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171488+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:18.809578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085945499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10608,"num_read_kb":43637,"num_write":702,"num_write_kb":29819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"257'381","reported_seq":8136,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247967+0000","last_change":"2024-09-11T06:21:07.233807+0000","last_active":"2024-09-11T06:21:23.247967+0000","last_peered":"2024-09-11T06:21:23.247967+0000","last_clean":"2024-09-11T06:21:23.247967+0000","last_became_active":"2024-09-11T06:20:15.126658+0000","last_became_peered":"2024-09-11T06:20:15.126658+0000","last_unstale":"2024-09-11T06:21:23.247967+0000","last_undegraded":"2024-09-11T06:21:23.247967+0000","last_fullsized":"2024-09-11T06:21:23.247967+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:36:46.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015157700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6873,"num_read_kb":49442,"num_write":558,"num_write_kb":30232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":34465896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"258'457","reported_seq":13065,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247789+0000","last_change":"2024-09-11T06:21:07.233521+0000","last_active":"2024-09-11T06:21:23.247789+0000","last_peered":"2024-09-11T06:21:23.247789+0000","last_clean":"2024-09-11T06:21:23.247789+0000","last_became_active":"2024-09-11T06:20:55.185551+0000","last_became_peered":"2024-09-11T06:20:55.185551+0000","last_unstale":"2024-09-11T06:21:23.247789+0000","last_undegraded":"2024-09-11T06:21:23.247789+0000","last_fullsized":"2024-09-11T06:21:23.247789+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:14.553047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013440069999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11885,"num_read_kb":48576,"num_write":550,"num_write_kb":27176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":312,"num_bytes_recovered":43677693,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"258'591","reported_seq":3605,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172022+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:33.648367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011988350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3308,"num_read_kb":19950,"num_write":926,"num_write_kb":26888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"257'662","reported_seq":3665,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729617+0000","last_change":"2024-09-11T06:21:07.167902+0000","last_active":"2024-09-11T06:21:22.729617+0000","last_peered":"2024-09-11T06:21:22.729617+0000","last_clean":"2024-09-11T06:21:22.729617+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:21:22.729617+0000","last_undegraded":"2024-09-11T06:21:22.729617+0000","last_fullsized":"2024-09-11T06:21:22.729617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:35.433625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012361620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3701,"num_read_kb":23930,"num_write":870,"num_write_kb":19296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"256'543","reported_seq":8287,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247910+0000","last_change":"2024-09-11T06:21:07.233878+0000","last_active":"2024-09-11T06:21:23.247910+0000","last_peered":"2024-09-11T06:21:23.247910+0000","last_clean":"2024-09-11T06:21:23.247910+0000","last_became_active":"2024-09-11T06:20:55.187089+0000","last_became_peered":"2024-09-11T06:20:55.187089+0000","last_unstale":"2024-09-11T06:21:23.247910+0000","last_undegraded":"2024-09-11T06:21:23.247910+0000","last_fullsized":"2024-09-11T06:21:23.247910+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:55.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001394836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7264,"num_read_kb":39003,"num_write":875,"num_write_kb":32876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":46719635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"257'647","reported_seq":20365,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248092+0000","last_change":"2024-09-11T06:21:07.165097+0000","last_active":"2024-09-11T06:21:23.248092+0000","last_peered":"2024-09-11T06:21:23.248092+0000","last_clean":"2024-09-11T06:21:23.248092+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:21:23.248092+0000","last_undegraded":"2024-09-11T06:21:23.248092+0000","last_fullsized":"2024-09-11T06:21:23.248092+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:29.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046631299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19910,"num_read_kb":76827,"num_write":792,"num_write_kb":30925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"258'605","reported_seq":5587,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729661+0000","last_change":"2024-09-11T06:21:07.167856+0000","last_active":"2024-09-11T06:21:22.729661+0000","last_peered":"2024-09-11T06:21:22.729661+0000","last_clean":"2024-09-11T06:21:22.729661+0000","last_became_active":"2024-09-11T06:20:55.184580+0000","last_became_peered":"2024-09-11T06:20:55.184580+0000","last_unstale":"2024-09-11T06:21:22.729661+0000","last_undegraded":"2024-09-11T06:21:22.729661+0000","last_fullsized":"2024-09-11T06:21:22.729661+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:46.496101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5156,"num_read_kb":38869,"num_write":703,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":26301332,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"258'540","reported_seq":8824,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729676+0000","last_change":"2024-09-11T06:21:07.163986+0000","last_active":"2024-09-11T06:21:22.729676+0000","last_peered":"2024-09-11T06:21:22.729676+0000","last_clean":"2024-09-11T06:21:22.729676+0000","last_became_active":"2024-09-11T06:20:55.183516+0000","last_became_peered":"2024-09-11T06:20:55.183516+0000","last_unstale":"2024-09-11T06:21:22.729676+0000","last_undegraded":"2024-09-11T06:21:22.729676+0000","last_fullsized":"2024-09-11T06:21:22.729676+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:33.254338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058563300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10001,"num_read_kb":48815,"num_write":537,"num_write_kb":34952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":20336086,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"255'455","reported_seq":8137,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247616+0000","last_change":"2024-09-11T06:21:07.233623+0000","last_active":"2024-09-11T06:21:23.247616+0000","last_peered":"2024-09-11T06:21:23.247616+0000","last_clean":"2024-09-11T06:21:23.247616+0000","last_became_active":"2024-09-11T06:20:15.123510+0000","last_became_peered":"2024-09-11T06:20:15.123510+0000","last_unstale":"2024-09-11T06:21:23.247616+0000","last_undegraded":"2024-09-11T06:21:23.247616+0000","last_fullsized":"2024-09-11T06:21:23.247616+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:39.520602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014223840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7512,"num_read_kb":50605,"num_write":531,"num_write_kb":34454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":37321190,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"257'453","reported_seq":3526,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460876+0000","last_change":"2024-09-11T06:21:07.163974+0000","last_active":"2024-09-11T06:21:24.460876+0000","last_peered":"2024-09-11T06:21:24.460876+0000","last_clean":"2024-09-11T06:21:24.460876+0000","last_became_active":"2024-09-11T06:20:14.140669+0000","last_became_peered":"2024-09-11T06:20:14.140669+0000","last_unstale":"2024-09-11T06:21:24.460876+0000","last_undegraded":"2024-09-11T06:21:24.460876+0000","last_fullsized":"2024-09-11T06:21:24.460876+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:29:21.007653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053784199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2621,"num_read_kb":28703,"num_write":734,"num_write_kb":23980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":19686402,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"256'420","reported_seq":4184,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247810+0000","last_change":"2024-09-11T06:21:07.232571+0000","last_active":"2024-09-11T06:21:23.247810+0000","last_peered":"2024-09-11T06:21:23.247810+0000","last_clean":"2024-09-11T06:21:23.247810+0000","last_became_active":"2024-09-11T06:20:15.128338+0000","last_became_peered":"2024-09-11T06:20:15.128338+0000","last_unstale":"2024-09-11T06:21:23.247810+0000","last_undegraded":"2024-09-11T06:21:23.247810+0000","last_fullsized":"2024-09-11T06:21:23.247810+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:11.186605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067989400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3148,"num_read_kb":35740,"num_write":591,"num_write_kb":26613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":24813340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240770,"num_read_kb":1384666,"num_write":25519,"num_write_kb":933038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4648,"num_bytes_recovered":642863479,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25754,"internal_metadata":0},"log_size":19202,"ondisk_log_size":19202,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":28087,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56696,"kb_used_data":3300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315144,"statfs":{"total":96636764160,"available":96578707456,"internally_reserved":0,"allocated":3379200,"data_stored":2243516,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34428,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337412,"statfs":{"total":96636764160,"available":96601509888,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48324,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323516,"statfs":{"total":96636764160,"available":96587280384,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748512,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":3240,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991271,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35996,"kb_used_data":3272,"kb_used_omap":10,"kb_used_meta":32693,"kb_avail":94335844,"statfs":{"total":96636764160,"available":96599904256,"internally_reserved":0,"allocated":3350528,"data_stored":2237666,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":10357,"internal_metadata":33478539},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64948,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306892,"statfs":{"total":96636764160,"available":96570257408,"internally_reserved":0,"allocated":3305472,"data_stored":1647279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52484,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:21:26.985 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T06:21:26.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-11T06:21:27.285 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T06:21:27.298 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T06:21:27.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:21:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:27.575 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:21:27.586 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-11T06:21:26.464285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":240886,"num_read_kb":1384766,"num_write":25680,"num_write_kb":935456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4653,"num_bytes_recovered":643453866,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19322,"ondisk_log_size":19322,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403976,"kb_used_data":26008,"kb_used_omap":37,"kb_used_meta":377754,"kb_avail":754570744,"statfs":{"total":773094113280,"available":772680441856,"internally_reserved":0,"allocated":26632192,"data_stored":14394144,"data_compressed":18378,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":38504,"internal_metadata":386820504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"3.1f","version":"258'361","reported_seq":3850,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712707+0000","last_change":"2024-09-11T06:21:07.211570+0000","last_active":"2024-09-11T06:21:23.712707+0000","last_peered":"2024-09-11T06:21:23.712707+0000","last_clean":"2024-09-11T06:21:23.712707+0000","last_became_active":"2024-09-11T06:20:55.187911+0000","last_became_peered":"2024-09-11T06:20:55.187911+0000","last_unstale":"2024-09-11T06:21:23.712707+0000","last_undegraded":"2024-09-11T06:21:23.712707+0000","last_fullsized":"2024-09-11T06:21:23.712707+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:26.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097570600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2483,"num_read_kb":28994,"num_write":517,"num_write_kb":29011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":14150952,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"257'547","reported_seq":6056,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712704+0000","last_change":"2024-09-11T06:21:07.211065+0000","last_active":"2024-09-11T06:21:23.712704+0000","last_peered":"2024-09-11T06:21:23.712704+0000","last_clean":"2024-09-11T06:21:23.712704+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:21:23.712704+0000","last_undegraded":"2024-09-11T06:21:23.712704+0000","last_fullsized":"2024-09-11T06:21:23.712704+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:40.880540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047299499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5799,"num_read_kb":23656,"num_write":730,"num_write_kb":18043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"257'852","reported_seq":10947,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247708+0000","last_change":"2024-09-11T06:21:07.232839+0000","last_active":"2024-09-11T06:21:23.247708+0000","last_peered":"2024-09-11T06:21:23.247708+0000","last_clean":"2024-09-11T06:21:23.247708+0000","last_became_active":"2024-09-11T06:20:16.128387+0000","last_became_peered":"2024-09-11T06:20:16.128387+0000","last_unstale":"2024-09-11T06:21:23.247708+0000","last_undegraded":"2024-09-11T06:21:23.247708+0000","last_fullsized":"2024-09-11T06:21:23.247708+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:25.000017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085877900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11560,"num_read_kb":90044,"num_write":1319,"num_write_kb":37601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":52081629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"258'662","reported_seq":11802,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729811+0000","last_change":"2024-09-11T06:21:07.164562+0000","last_active":"2024-09-11T06:21:22.729811+0000","last_peered":"2024-09-11T06:21:22.729811+0000","last_clean":"2024-09-11T06:21:22.729811+0000","last_became_active":"2024-09-11T06:20:55.183472+0000","last_became_peered":"2024-09-11T06:20:55.183472+0000","last_unstale":"2024-09-11T06:21:22.729811+0000","last_undegraded":"2024-09-11T06:21:22.729811+0000","last_fullsized":"2024-09-11T06:21:22.729811+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:15.621722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151093,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12097,"num_read_kb":53988,"num_write":979,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":10143007,"num_keys_recovered":276,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"256'515","reported_seq":6222,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248917+0000","last_change":"2024-09-11T06:21:07.171198+0000","last_active":"2024-09-11T06:21:23.248917+0000","last_peered":"2024-09-11T06:21:23.248917+0000","last_clean":"2024-09-11T06:21:23.248917+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:21:23.248917+0000","last_undegraded":"2024-09-11T06:21:23.248917+0000","last_fullsized":"2024-09-11T06:21:23.248917+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:38.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055166700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5130,"num_read_kb":36360,"num_write":718,"num_write_kb":27489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"256'660","reported_seq":10754,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729843+0000","last_change":"2024-09-11T06:21:07.164604+0000","last_active":"2024-09-11T06:21:22.729843+0000","last_peered":"2024-09-11T06:21:22.729843+0000","last_clean":"2024-09-11T06:21:22.729843+0000","last_became_active":"2024-09-11T06:20:55.183560+0000","last_became_peered":"2024-09-11T06:20:55.183560+0000","last_unstale":"2024-09-11T06:21:22.729843+0000","last_undegraded":"2024-09-11T06:21:22.729843+0000","last_fullsized":"2024-09-11T06:21:22.729843+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:17.588003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078848799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10645,"num_read_kb":66160,"num_write":849,"num_write_kb":27853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":22168966,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"257'554","reported_seq":6776,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171097+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:20:55.181728+0000","last_became_peered":"2024-09-11T06:20:55.181728+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:43.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000465866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6471,"num_read_kb":29586,"num_write":634,"num_write_kb":18722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":372,"num_bytes_recovered":14762773,"num_keys_recovered":100,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"257'1131","reported_seq":9744,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712737+0000","last_change":"2024-09-11T06:21:07.211882+0000","last_active":"2024-09-11T06:21:23.712737+0000","last_peered":"2024-09-11T06:21:23.712737+0000","last_clean":"2024-09-11T06:21:23.712737+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:21:23.712737+0000","last_undegraded":"2024-09-11T06:21:23.712737+0000","last_fullsized":"2024-09-11T06:21:23.712737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:55.097907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010472719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13075,"num_read_kb":38666,"num_write":1619,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"255'295","reported_seq":4570,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712709+0000","last_change":"2024-09-11T06:21:07.211919+0000","last_active":"2024-09-11T06:21:23.712709+0000","last_peered":"2024-09-11T06:21:23.712709+0000","last_clean":"2024-09-11T06:21:23.712709+0000","last_became_active":"2024-09-11T06:20:14.140869+0000","last_became_peered":"2024-09-11T06:20:14.140869+0000","last_unstale":"2024-09-11T06:21:23.712709+0000","last_undegraded":"2024-09-11T06:21:23.712709+0000","last_fullsized":"2024-09-11T06:21:23.712709+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:22.240506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2899,"num_read_kb":36950,"num_write":396,"num_write_kb":23221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":21224115,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"257'612","reported_seq":8612,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248475+0000","last_change":"2024-09-11T06:21:07.164911+0000","last_active":"2024-09-11T06:21:23.248475+0000","last_peered":"2024-09-11T06:21:23.248475+0000","last_clean":"2024-09-11T06:21:23.248475+0000","last_became_active":"2024-09-11T06:20:15.124862+0000","last_became_peered":"2024-09-11T06:20:15.124862+0000","last_unstale":"2024-09-11T06:21:23.248475+0000","last_undegraded":"2024-09-11T06:21:23.248475+0000","last_fullsized":"2024-09-11T06:21:23.248475+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:37.528256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062779600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9055,"num_read_kb":39121,"num_write":753,"num_write_kb":29738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":17793964,"num_keys_recovered":77,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"257'496","reported_seq":4800,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729694+0000","last_change":"2024-09-11T06:21:07.168207+0000","last_active":"2024-09-11T06:21:22.729694+0000","last_peered":"2024-09-11T06:21:22.729694+0000","last_clean":"2024-09-11T06:21:22.729694+0000","last_became_active":"2024-09-11T06:20:01.126371+0000","last_became_peered":"2024-09-11T06:20:01.126371+0000","last_unstale":"2024-09-11T06:21:22.729694+0000","last_undegraded":"2024-09-11T06:21:22.729694+0000","last_fullsized":"2024-09-11T06:21:22.729694+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:26:00.929781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001549929,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3619,"num_read_kb":43290,"num_write":684,"num_write_kb":36893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":40168837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"257'400","reported_seq":11994,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247790+0000","last_change":"2024-09-11T06:21:07.232518+0000","last_active":"2024-09-11T06:21:23.247790+0000","last_peered":"2024-09-11T06:21:23.247790+0000","last_clean":"2024-09-11T06:21:23.247790+0000","last_became_active":"2024-09-11T06:20:15.123718+0000","last_became_peered":"2024-09-11T06:20:15.123718+0000","last_unstale":"2024-09-11T06:21:23.247790+0000","last_undegraded":"2024-09-11T06:21:23.247790+0000","last_fullsized":"2024-09-11T06:21:23.247790+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:16.231831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054683100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9669,"num_read_kb":71024,"num_write":411,"num_write_kb":42855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":83153006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247893+0000","last_change":"2024-09-11T06:20:11.126114+0000","last_active":"2024-09-11T06:21:23.247893+0000","last_peered":"2024-09-11T06:21:23.247893+0000","last_clean":"2024-09-11T06:21:23.247893+0000","last_became_active":"2024-09-11T06:20:11.125589+0000","last_became_peered":"2024-09-11T06:20:11.125589+0000","last_unstale":"2024-09-11T06:21:23.247893+0000","last_undegraded":"2024-09-11T06:21:23.247893+0000","last_fullsized":"2024-09-11T06:21:23.247893+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:26.809341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"258'374","reported_seq":5148,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248756+0000","last_change":"2024-09-11T06:21:07.171686+0000","last_active":"2024-09-11T06:21:23.248756+0000","last_peered":"2024-09-11T06:21:23.248756+0000","last_clean":"2024-09-11T06:21:23.248756+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:21:23.248756+0000","last_undegraded":"2024-09-11T06:21:23.248756+0000","last_fullsized":"2024-09-11T06:21:23.248756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:26.496746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095120700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3952,"num_read_kb":49104,"num_write":471,"num_write_kb":30546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":535,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248868+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:21:23.248868+0000","last_peered":"2024-09-11T06:21:23.248868+0000","last_clean":"2024-09-11T06:21:23.248868+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:21:23.248868+0000","last_undegraded":"2024-09-11T06:21:23.248868+0000","last_fullsized":"2024-09-11T06:21:23.248868+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"256'364","reported_seq":3899,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172112+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:22:13.850566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012844779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3327,"num_read_kb":33114,"num_write":460,"num_write_kb":24509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247811+0000","last_change":"2024-09-11T06:20:11.126588+0000","last_active":"2024-09-11T06:21:23.247811+0000","last_peered":"2024-09-11T06:21:23.247811+0000","last_clean":"2024-09-11T06:21:23.247811+0000","last_became_active":"2024-09-11T06:20:11.126287+0000","last_became_peered":"2024-09-11T06:20:11.126287+0000","last_unstale":"2024-09-11T06:21:23.247811+0000","last_undegraded":"2024-09-11T06:21:23.247811+0000","last_fullsized":"2024-09-11T06:21:23.247811+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:09.892331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"257'943","reported_seq":6729,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460918+0000","last_change":"2024-09-11T06:21:07.163783+0000","last_active":"2024-09-11T06:21:24.460918+0000","last_peered":"2024-09-11T06:21:24.460918+0000","last_clean":"2024-09-11T06:21:24.460918+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:21:24.460918+0000","last_undegraded":"2024-09-11T06:21:24.460918+0000","last_fullsized":"2024-09-11T06:21:24.460918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:43.468481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039519000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8223,"num_read_kb":61062,"num_write":1340,"num_write_kb":35882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712732+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:21:23.712732+0000","last_peered":"2024-09-11T06:21:23.712732+0000","last_clean":"2024-09-11T06:21:23.712732+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:21:23.712732+0000","last_undegraded":"2024-09-11T06:21:23.712732+0000","last_fullsized":"2024-09-11T06:21:23.712732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"258'974","reported_seq":9905,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247907+0000","last_change":"2024-09-11T06:21:07.164083+0000","last_active":"2024-09-11T06:21:23.247907+0000","last_peered":"2024-09-11T06:21:23.247907+0000","last_clean":"2024-09-11T06:21:23.247907+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:21:23.247907+0000","last_undegraded":"2024-09-11T06:21:23.247907+0000","last_fullsized":"2024-09-11T06:21:23.247907+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:51.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048838699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11583,"num_read_kb":37449,"num_write":1370,"num_write_kb":24166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"258'969","reported_seq":10311,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729568+0000","last_change":"2024-09-11T06:21:07.166913+0000","last_active":"2024-09-11T06:21:22.729568+0000","last_peered":"2024-09-11T06:21:22.729568+0000","last_clean":"2024-09-11T06:21:22.729568+0000","last_became_active":"2024-09-11T06:21:01.134591+0000","last_became_peered":"2024-09-11T06:21:01.134591+0000","last_unstale":"2024-09-11T06:21:22.729568+0000","last_undegraded":"2024-09-11T06:21:22.729568+0000","last_fullsized":"2024-09-11T06:21:22.729568+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:47.635577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036423400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11250,"num_read_kb":40045,"num_write":1055,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":373,"num_bytes_recovered":38854008,"num_keys_recovered":188,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247693+0000","last_change":"2024-09-11T06:20:11.130922+0000","last_active":"2024-09-11T06:21:23.247693+0000","last_peered":"2024-09-11T06:21:23.247693+0000","last_clean":"2024-09-11T06:21:23.247693+0000","last_became_active":"2024-09-11T06:20:11.125223+0000","last_became_peered":"2024-09-11T06:20:11.125223+0000","last_unstale":"2024-09-11T06:21:23.247693+0000","last_undegraded":"2024-09-11T06:21:23.247693+0000","last_fullsized":"2024-09-11T06:21:23.247693+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:32.651537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"256'597","reported_seq":6403,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712586+0000","last_change":"2024-09-11T06:21:07.211650+0000","last_active":"2024-09-11T06:21:23.712586+0000","last_peered":"2024-09-11T06:21:23.712586+0000","last_clean":"2024-09-11T06:21:23.712586+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:21:23.712586+0000","last_undegraded":"2024-09-11T06:21:23.712586+0000","last_fullsized":"2024-09-11T06:21:23.712586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:13.219129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097915299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5551,"num_read_kb":37240,"num_write":814,"num_write_kb":37266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.637461+0000","last_change":"2024-09-11T06:20:17.138900+0000","last_active":"2024-09-11T06:21:23.637461+0000","last_peered":"2024-09-11T06:21:23.637461+0000","last_clean":"2024-09-11T06:21:23.637461+0000","last_became_active":"2024-09-11T06:20:17.138587+0000","last_became_peered":"2024-09-11T06:20:17.138587+0000","last_unstale":"2024-09-11T06:21:23.637461+0000","last_undegraded":"2024-09-11T06:21:23.637461+0000","last_fullsized":"2024-09-11T06:21:23.637461+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:45.951420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"258'917","reported_seq":4060,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460865+0000","last_change":"2024-09-11T06:21:07.163704+0000","last_active":"2024-09-11T06:21:24.460865+0000","last_peered":"2024-09-11T06:21:24.460865+0000","last_clean":"2024-09-11T06:21:24.460865+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:21:24.460865+0000","last_undegraded":"2024-09-11T06:21:24.460865+0000","last_fullsized":"2024-09-11T06:21:24.460865+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:27.675499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033761000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4034,"num_read_kb":32429,"num_write":1192,"num_write_kb":32728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247705+0000","last_change":"2024-09-11T06:20:11.126087+0000","last_active":"2024-09-11T06:21:23.247705+0000","last_peered":"2024-09-11T06:21:23.247705+0000","last_clean":"2024-09-11T06:21:23.247705+0000","last_became_active":"2024-09-11T06:20:11.125761+0000","last_became_peered":"2024-09-11T06:20:11.125761+0000","last_unstale":"2024-09-11T06:21:23.247705+0000","last_undegraded":"2024-09-11T06:21:23.247705+0000","last_fullsized":"2024-09-11T06:21:23.247705+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:30.205706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"257'608","reported_seq":8302,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248717+0000","last_change":"2024-09-11T06:21:07.171394+0000","last_active":"2024-09-11T06:21:23.248717+0000","last_peered":"2024-09-11T06:21:23.248717+0000","last_clean":"2024-09-11T06:21:23.248717+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:21:23.248717+0000","last_undegraded":"2024-09-11T06:21:23.248717+0000","last_fullsized":"2024-09-11T06:21:23.248717+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:03.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074336300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8361,"num_read_kb":32287,"num_write":839,"num_write_kb":30197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248095+0000","last_change":"2024-09-11T06:20:11.132669+0000","last_active":"2024-09-11T06:21:23.248095+0000","last_peered":"2024-09-11T06:21:23.248095+0000","last_clean":"2024-09-11T06:21:23.248095+0000","last_became_active":"2024-09-11T06:20:11.128373+0000","last_became_peered":"2024-09-11T06:20:11.128373+0000","last_unstale":"2024-09-11T06:21:23.248095+0000","last_undegraded":"2024-09-11T06:21:23.248095+0000","last_fullsized":"2024-09-11T06:21:23.248095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:55.902272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729719+0000","last_change":"2024-09-11T06:20:55.186236+0000","last_active":"2024-09-11T06:21:22.729719+0000","last_peered":"2024-09-11T06:21:22.729719+0000","last_clean":"2024-09-11T06:21:22.729719+0000","last_became_active":"2024-09-11T06:20:55.185644+0000","last_became_peered":"2024-09-11T06:20:55.185644+0000","last_unstale":"2024-09-11T06:21:22.729719+0000","last_undegraded":"2024-09-11T06:21:22.729719+0000","last_fullsized":"2024-09-11T06:21:22.729719+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:08:57.958332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'617","reported_seq":9845,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171488+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:18.809578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085945499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10608,"num_read_kb":43637,"num_write":702,"num_write_kb":29819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"257'381","reported_seq":8136,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247967+0000","last_change":"2024-09-11T06:21:07.233807+0000","last_active":"2024-09-11T06:21:23.247967+0000","last_peered":"2024-09-11T06:21:23.247967+0000","last_clean":"2024-09-11T06:21:23.247967+0000","last_became_active":"2024-09-11T06:20:15.126658+0000","last_became_peered":"2024-09-11T06:20:15.126658+0000","last_unstale":"2024-09-11T06:21:23.247967+0000","last_undegraded":"2024-09-11T06:21:23.247967+0000","last_fullsized":"2024-09-11T06:21:23.247967+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:36:46.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015157700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6873,"num_read_kb":49442,"num_write":558,"num_write_kb":30232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":34465896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"258'457","reported_seq":13065,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247789+0000","last_change":"2024-09-11T06:21:07.233521+0000","last_active":"2024-09-11T06:21:23.247789+0000","last_peered":"2024-09-11T06:21:23.247789+0000","last_clean":"2024-09-11T06:21:23.247789+0000","last_became_active":"2024-09-11T06:20:55.185551+0000","last_became_peered":"2024-09-11T06:20:55.185551+0000","last_unstale":"2024-09-11T06:21:23.247789+0000","last_undegraded":"2024-09-11T06:21:23.247789+0000","last_fullsized":"2024-09-11T06:21:23.247789+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:14.553047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013440069999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11885,"num_read_kb":48576,"num_write":550,"num_write_kb":27176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":312,"num_bytes_recovered":43677693,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"258'591","reported_seq":3605,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172022+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:33.648367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011988350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3308,"num_read_kb":19950,"num_write":926,"num_write_kb":26888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"257'662","reported_seq":3665,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729617+0000","last_change":"2024-09-11T06:21:07.167902+0000","last_active":"2024-09-11T06:21:22.729617+0000","last_peered":"2024-09-11T06:21:22.729617+0000","last_clean":"2024-09-11T06:21:22.729617+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:21:22.729617+0000","last_undegraded":"2024-09-11T06:21:22.729617+0000","last_fullsized":"2024-09-11T06:21:22.729617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:35.433625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012361620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3701,"num_read_kb":23930,"num_write":870,"num_write_kb":19296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"256'543","reported_seq":8287,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247910+0000","last_change":"2024-09-11T06:21:07.233878+0000","last_active":"2024-09-11T06:21:23.247910+0000","last_peered":"2024-09-11T06:21:23.247910+0000","last_clean":"2024-09-11T06:21:23.247910+0000","last_became_active":"2024-09-11T06:20:55.187089+0000","last_became_peered":"2024-09-11T06:20:55.187089+0000","last_unstale":"2024-09-11T06:21:23.247910+0000","last_undegraded":"2024-09-11T06:21:23.247910+0000","last_fullsized":"2024-09-11T06:21:23.247910+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:55.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001394836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7264,"num_read_kb":39003,"num_write":875,"num_write_kb":32876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":46719635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"257'647","reported_seq":20365,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248092+0000","last_change":"2024-09-11T06:21:07.165097+0000","last_active":"2024-09-11T06:21:23.248092+0000","last_peered":"2024-09-11T06:21:23.248092+0000","last_clean":"2024-09-11T06:21:23.248092+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:21:23.248092+0000","last_undegraded":"2024-09-11T06:21:23.248092+0000","last_fullsized":"2024-09-11T06:21:23.248092+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:29.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046631299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19910,"num_read_kb":76827,"num_write":792,"num_write_kb":30925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"258'605","reported_seq":5587,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729661+0000","last_change":"2024-09-11T06:21:07.167856+0000","last_active":"2024-09-11T06:21:22.729661+0000","last_peered":"2024-09-11T06:21:22.729661+0000","last_clean":"2024-09-11T06:21:22.729661+0000","last_became_active":"2024-09-11T06:20:55.184580+0000","last_became_peered":"2024-09-11T06:20:55.184580+0000","last_unstale":"2024-09-11T06:21:22.729661+0000","last_undegraded":"2024-09-11T06:21:22.729661+0000","last_fullsized":"2024-09-11T06:21:22.729661+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:46.496101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5156,"num_read_kb":38869,"num_write":703,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":26301332,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"258'540","reported_seq":8824,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729676+0000","last_change":"2024-09-11T06:21:07.163986+0000","last_active":"2024-09-11T06:21:22.729676+0000","last_peered":"2024-09-11T06:21:22.729676+0000","last_clean":"2024-09-11T06:21:22.729676+0000","last_became_active":"2024-09-11T06:20:55.183516+0000","last_became_peered":"2024-09-11T06:20:55.183516+0000","last_unstale":"2024-09-11T06:21:22.729676+0000","last_undegraded":"2024-09-11T06:21:22.729676+0000","last_fullsized":"2024-09-11T06:21:22.729676+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:33.254338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058563300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10001,"num_read_kb":48815,"num_write":537,"num_write_kb":34952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":20336086,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"255'455","reported_seq":8137,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247616+0000","last_change":"2024-09-11T06:21:07.233623+0000","last_active":"2024-09-11T06:21:23.247616+0000","last_peered":"2024-09-11T06:21:23.247616+0000","last_clean":"2024-09-11T06:21:23.247616+0000","last_became_active":"2024-09-11T06:20:15.123510+0000","last_became_peered":"2024-09-11T06:20:15.123510+0000","last_unstale":"2024-09-11T06:21:23.247616+0000","last_undegraded":"2024-09-11T06:21:23.247616+0000","last_fullsized":"2024-09-11T06:21:23.247616+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:39.520602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014223840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7512,"num_read_kb":50605,"num_write":531,"num_write_kb":34454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":37321190,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"257'453","reported_seq":3526,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460876+0000","last_change":"2024-09-11T06:21:07.163974+0000","last_active":"2024-09-11T06:21:24.460876+0000","last_peered":"2024-09-11T06:21:24.460876+0000","last_clean":"2024-09-11T06:21:24.460876+0000","last_became_active":"2024-09-11T06:20:14.140669+0000","last_became_peered":"2024-09-11T06:20:14.140669+0000","last_unstale":"2024-09-11T06:21:24.460876+0000","last_undegraded":"2024-09-11T06:21:24.460876+0000","last_fullsized":"2024-09-11T06:21:24.460876+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:29:21.007653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053784199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2621,"num_read_kb":28703,"num_write":734,"num_write_kb":23980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":19686402,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"256'420","reported_seq":4184,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247810+0000","last_change":"2024-09-11T06:21:07.232571+0000","last_active":"2024-09-11T06:21:23.247810+0000","last_peered":"2024-09-11T06:21:23.247810+0000","last_clean":"2024-09-11T06:21:23.247810+0000","last_became_active":"2024-09-11T06:20:15.128338+0000","last_became_peered":"2024-09-11T06:20:15.128338+0000","last_unstale":"2024-09-11T06:21:23.247810+0000","last_undegraded":"2024-09-11T06:21:23.247810+0000","last_fullsized":"2024-09-11T06:21:23.247810+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:11.186605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067989400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3148,"num_read_kb":35740,"num_write":591,"num_write_kb":26613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":24813340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240770,"num_read_kb":1384666,"num_write":25519,"num_write_kb":933038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4648,"num_bytes_recovered":642863479,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25754,"internal_metadata":0},"log_size":19202,"ondisk_log_size":19202,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":28087,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56696,"kb_used_data":3300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315144,"statfs":{"total":96636764160,"available":96578707456,"internally_reserved":0,"allocated":3379200,"data_stored":2243516,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34428,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337412,"statfs":{"total":96636764160,"available":96601509888,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48324,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323516,"statfs":{"total":96636764160,"available":96587280384,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748512,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":3240,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991271,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35996,"kb_used_data":3272,"kb_used_omap":10,"kb_used_meta":32693,"kb_avail":94335844,"statfs":{"total":96636764160,"available":96599904256,"internally_reserved":0,"allocated":3350528,"data_stored":2237666,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":10357,"internal_metadata":33478539},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64948,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306892,"statfs":{"total":96636764160,"available":96570257408,"internally_reserved":0,"allocated":3305472,"data_stored":1647279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52484,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:21:27.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:21:27.864 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:27.864 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:21:27.876 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-11T06:21:26.464285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":240886,"num_read_kb":1384766,"num_write":25680,"num_write_kb":935456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4653,"num_bytes_recovered":643453866,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19322,"ondisk_log_size":19322,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403976,"kb_used_data":26008,"kb_used_omap":37,"kb_used_meta":377754,"kb_avail":754570744,"statfs":{"total":773094113280,"available":772680441856,"internally_reserved":0,"allocated":26632192,"data_stored":14394144,"data_compressed":18378,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":38504,"internal_metadata":386820504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"3.1f","version":"258'361","reported_seq":3850,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712707+0000","last_change":"2024-09-11T06:21:07.211570+0000","last_active":"2024-09-11T06:21:23.712707+0000","last_peered":"2024-09-11T06:21:23.712707+0000","last_clean":"2024-09-11T06:21:23.712707+0000","last_became_active":"2024-09-11T06:20:55.187911+0000","last_became_peered":"2024-09-11T06:20:55.187911+0000","last_unstale":"2024-09-11T06:21:23.712707+0000","last_undegraded":"2024-09-11T06:21:23.712707+0000","last_fullsized":"2024-09-11T06:21:23.712707+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:26.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097570600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2483,"num_read_kb":28994,"num_write":517,"num_write_kb":29011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":14150952,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"257'547","reported_seq":6056,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712704+0000","last_change":"2024-09-11T06:21:07.211065+0000","last_active":"2024-09-11T06:21:23.712704+0000","last_peered":"2024-09-11T06:21:23.712704+0000","last_clean":"2024-09-11T06:21:23.712704+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:21:23.712704+0000","last_undegraded":"2024-09-11T06:21:23.712704+0000","last_fullsized":"2024-09-11T06:21:23.712704+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:40.880540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047299499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5799,"num_read_kb":23656,"num_write":730,"num_write_kb":18043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"257'852","reported_seq":10947,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247708+0000","last_change":"2024-09-11T06:21:07.232839+0000","last_active":"2024-09-11T06:21:23.247708+0000","last_peered":"2024-09-11T06:21:23.247708+0000","last_clean":"2024-09-11T06:21:23.247708+0000","last_became_active":"2024-09-11T06:20:16.128387+0000","last_became_peered":"2024-09-11T06:20:16.128387+0000","last_unstale":"2024-09-11T06:21:23.247708+0000","last_undegraded":"2024-09-11T06:21:23.247708+0000","last_fullsized":"2024-09-11T06:21:23.247708+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:25.000017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085877900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11560,"num_read_kb":90044,"num_write":1319,"num_write_kb":37601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":52081629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"258'662","reported_seq":11802,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729811+0000","last_change":"2024-09-11T06:21:07.164562+0000","last_active":"2024-09-11T06:21:22.729811+0000","last_peered":"2024-09-11T06:21:22.729811+0000","last_clean":"2024-09-11T06:21:22.729811+0000","last_became_active":"2024-09-11T06:20:55.183472+0000","last_became_peered":"2024-09-11T06:20:55.183472+0000","last_unstale":"2024-09-11T06:21:22.729811+0000","last_undegraded":"2024-09-11T06:21:22.729811+0000","last_fullsized":"2024-09-11T06:21:22.729811+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:15.621722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151093,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12097,"num_read_kb":53988,"num_write":979,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":10143007,"num_keys_recovered":276,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"256'515","reported_seq":6222,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248917+0000","last_change":"2024-09-11T06:21:07.171198+0000","last_active":"2024-09-11T06:21:23.248917+0000","last_peered":"2024-09-11T06:21:23.248917+0000","last_clean":"2024-09-11T06:21:23.248917+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:21:23.248917+0000","last_undegraded":"2024-09-11T06:21:23.248917+0000","last_fullsized":"2024-09-11T06:21:23.248917+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:38.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055166700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5130,"num_read_kb":36360,"num_write":718,"num_write_kb":27489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"256'660","reported_seq":10754,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729843+0000","last_change":"2024-09-11T06:21:07.164604+0000","last_active":"2024-09-11T06:21:22.729843+0000","last_peered":"2024-09-11T06:21:22.729843+0000","last_clean":"2024-09-11T06:21:22.729843+0000","last_became_active":"2024-09-11T06:20:55.183560+0000","last_became_peered":"2024-09-11T06:20:55.183560+0000","last_unstale":"2024-09-11T06:21:22.729843+0000","last_undegraded":"2024-09-11T06:21:22.729843+0000","last_fullsized":"2024-09-11T06:21:22.729843+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:17.588003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078848799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10645,"num_read_kb":66160,"num_write":849,"num_write_kb":27853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":22168966,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"257'554","reported_seq":6776,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171097+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:20:55.181728+0000","last_became_peered":"2024-09-11T06:20:55.181728+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:43.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000465866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6471,"num_read_kb":29586,"num_write":634,"num_write_kb":18722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":372,"num_bytes_recovered":14762773,"num_keys_recovered":100,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"257'1131","reported_seq":9744,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712737+0000","last_change":"2024-09-11T06:21:07.211882+0000","last_active":"2024-09-11T06:21:23.712737+0000","last_peered":"2024-09-11T06:21:23.712737+0000","last_clean":"2024-09-11T06:21:23.712737+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:21:23.712737+0000","last_undegraded":"2024-09-11T06:21:23.712737+0000","last_fullsized":"2024-09-11T06:21:23.712737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:55.097907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010472719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13075,"num_read_kb":38666,"num_write":1619,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"255'295","reported_seq":4570,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712709+0000","last_change":"2024-09-11T06:21:07.211919+0000","last_active":"2024-09-11T06:21:23.712709+0000","last_peered":"2024-09-11T06:21:23.712709+0000","last_clean":"2024-09-11T06:21:23.712709+0000","last_became_active":"2024-09-11T06:20:14.140869+0000","last_became_peered":"2024-09-11T06:20:14.140869+0000","last_unstale":"2024-09-11T06:21:23.712709+0000","last_undegraded":"2024-09-11T06:21:23.712709+0000","last_fullsized":"2024-09-11T06:21:23.712709+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:22.240506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2899,"num_read_kb":36950,"num_write":396,"num_write_kb":23221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":21224115,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"257'612","reported_seq":8612,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248475+0000","last_change":"2024-09-11T06:21:07.164911+0000","last_active":"2024-09-11T06:21:23.248475+0000","last_peered":"2024-09-11T06:21:23.248475+0000","last_clean":"2024-09-11T06:21:23.248475+0000","last_became_active":"2024-09-11T06:20:15.124862+0000","last_became_peered":"2024-09-11T06:20:15.124862+0000","last_unstale":"2024-09-11T06:21:23.248475+0000","last_undegraded":"2024-09-11T06:21:23.248475+0000","last_fullsized":"2024-09-11T06:21:23.248475+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:37.528256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062779600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9055,"num_read_kb":39121,"num_write":753,"num_write_kb":29738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":17793964,"num_keys_recovered":77,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"257'496","reported_seq":4800,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729694+0000","last_change":"2024-09-11T06:21:07.168207+0000","last_active":"2024-09-11T06:21:22.729694+0000","last_peered":"2024-09-11T06:21:22.729694+0000","last_clean":"2024-09-11T06:21:22.729694+0000","last_became_active":"2024-09-11T06:20:01.126371+0000","last_became_peered":"2024-09-11T06:20:01.126371+0000","last_unstale":"2024-09-11T06:21:22.729694+0000","last_undegraded":"2024-09-11T06:21:22.729694+0000","last_fullsized":"2024-09-11T06:21:22.729694+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:26:00.929781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001549929,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3619,"num_read_kb":43290,"num_write":684,"num_write_kb":36893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":40168837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"257'400","reported_seq":11994,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247790+0000","last_change":"2024-09-11T06:21:07.232518+0000","last_active":"2024-09-11T06:21:23.247790+0000","last_peered":"2024-09-11T06:21:23.247790+0000","last_clean":"2024-09-11T06:21:23.247790+0000","last_became_active":"2024-09-11T06:20:15.123718+0000","last_became_peered":"2024-09-11T06:20:15.123718+0000","last_unstale":"2024-09-11T06:21:23.247790+0000","last_undegraded":"2024-09-11T06:21:23.247790+0000","last_fullsized":"2024-09-11T06:21:23.247790+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:16.231831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054683100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9669,"num_read_kb":71024,"num_write":411,"num_write_kb":42855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":83153006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247893+0000","last_change":"2024-09-11T06:20:11.126114+0000","last_active":"2024-09-11T06:21:23.247893+0000","last_peered":"2024-09-11T06:21:23.247893+0000","last_clean":"2024-09-11T06:21:23.247893+0000","last_became_active":"2024-09-11T06:20:11.125589+0000","last_became_peered":"2024-09-11T06:20:11.125589+0000","last_unstale":"2024-09-11T06:21:23.247893+0000","last_undegraded":"2024-09-11T06:21:23.247893+0000","last_fullsized":"2024-09-11T06:21:23.247893+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:26.809341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"258'374","reported_seq":5148,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248756+0000","last_change":"2024-09-11T06:21:07.171686+0000","last_active":"2024-09-11T06:21:23.248756+0000","last_peered":"2024-09-11T06:21:23.248756+0000","last_clean":"2024-09-11T06:21:23.248756+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:21:23.248756+0000","last_undegraded":"2024-09-11T06:21:23.248756+0000","last_fullsized":"2024-09-11T06:21:23.248756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:26.496746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095120700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3952,"num_read_kb":49104,"num_write":471,"num_write_kb":30546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":535,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248868+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:21:23.248868+0000","last_peered":"2024-09-11T06:21:23.248868+0000","last_clean":"2024-09-11T06:21:23.248868+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:21:23.248868+0000","last_undegraded":"2024-09-11T06:21:23.248868+0000","last_fullsized":"2024-09-11T06:21:23.248868+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"256'364","reported_seq":3899,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172112+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:22:13.850566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012844779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3327,"num_read_kb":33114,"num_write":460,"num_write_kb":24509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247811+0000","last_change":"2024-09-11T06:20:11.126588+0000","last_active":"2024-09-11T06:21:23.247811+0000","last_peered":"2024-09-11T06:21:23.247811+0000","last_clean":"2024-09-11T06:21:23.247811+0000","last_became_active":"2024-09-11T06:20:11.126287+0000","last_became_peered":"2024-09-11T06:20:11.126287+0000","last_unstale":"2024-09-11T06:21:23.247811+0000","last_undegraded":"2024-09-11T06:21:23.247811+0000","last_fullsized":"2024-09-11T06:21:23.247811+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:09.892331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"257'943","reported_seq":6729,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460918+0000","last_change":"2024-09-11T06:21:07.163783+0000","last_active":"2024-09-11T06:21:24.460918+0000","last_peered":"2024-09-11T06:21:24.460918+0000","last_clean":"2024-09-11T06:21:24.460918+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:21:24.460918+0000","last_undegraded":"2024-09-11T06:21:24.460918+0000","last_fullsized":"2024-09-11T06:21:24.460918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:43.468481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039519000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8223,"num_read_kb":61062,"num_write":1340,"num_write_kb":35882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712732+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:21:23.712732+0000","last_peered":"2024-09-11T06:21:23.712732+0000","last_clean":"2024-09-11T06:21:23.712732+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:21:23.712732+0000","last_undegraded":"2024-09-11T06:21:23.712732+0000","last_fullsized":"2024-09-11T06:21:23.712732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"258'974","reported_seq":9905,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247907+0000","last_change":"2024-09-11T06:21:07.164083+0000","last_active":"2024-09-11T06:21:23.247907+0000","last_peered":"2024-09-11T06:21:23.247907+0000","last_clean":"2024-09-11T06:21:23.247907+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:21:23.247907+0000","last_undegraded":"2024-09-11T06:21:23.247907+0000","last_fullsized":"2024-09-11T06:21:23.247907+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:51.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048838699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11583,"num_read_kb":37449,"num_write":1370,"num_write_kb":24166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"258'969","reported_seq":10311,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729568+0000","last_change":"2024-09-11T06:21:07.166913+0000","last_active":"2024-09-11T06:21:22.729568+0000","last_peered":"2024-09-11T06:21:22.729568+0000","last_clean":"2024-09-11T06:21:22.729568+0000","last_became_active":"2024-09-11T06:21:01.134591+0000","last_became_peered":"2024-09-11T06:21:01.134591+0000","last_unstale":"2024-09-11T06:21:22.729568+0000","last_undegraded":"2024-09-11T06:21:22.729568+0000","last_fullsized":"2024-09-11T06:21:22.729568+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:47.635577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036423400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11250,"num_read_kb":40045,"num_write":1055,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":373,"num_bytes_recovered":38854008,"num_keys_recovered":188,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247693+0000","last_change":"2024-09-11T06:20:11.130922+0000","last_active":"2024-09-11T06:21:23.247693+0000","last_peered":"2024-09-11T06:21:23.247693+0000","last_clean":"2024-09-11T06:21:23.247693+0000","last_became_active":"2024-09-11T06:20:11.125223+0000","last_became_peered":"2024-09-11T06:20:11.125223+0000","last_unstale":"2024-09-11T06:21:23.247693+0000","last_undegraded":"2024-09-11T06:21:23.247693+0000","last_fullsized":"2024-09-11T06:21:23.247693+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:32.651537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"256'597","reported_seq":6403,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712586+0000","last_change":"2024-09-11T06:21:07.211650+0000","last_active":"2024-09-11T06:21:23.712586+0000","last_peered":"2024-09-11T06:21:23.712586+0000","last_clean":"2024-09-11T06:21:23.712586+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:21:23.712586+0000","last_undegraded":"2024-09-11T06:21:23.712586+0000","last_fullsized":"2024-09-11T06:21:23.712586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:13.219129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097915299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5551,"num_read_kb":37240,"num_write":814,"num_write_kb":37266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.637461+0000","last_change":"2024-09-11T06:20:17.138900+0000","last_active":"2024-09-11T06:21:23.637461+0000","last_peered":"2024-09-11T06:21:23.637461+0000","last_clean":"2024-09-11T06:21:23.637461+0000","last_became_active":"2024-09-11T06:20:17.138587+0000","last_became_peered":"2024-09-11T06:20:17.138587+0000","last_unstale":"2024-09-11T06:21:23.637461+0000","last_undegraded":"2024-09-11T06:21:23.637461+0000","last_fullsized":"2024-09-11T06:21:23.637461+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:45.951420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"258'917","reported_seq":4060,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460865+0000","last_change":"2024-09-11T06:21:07.163704+0000","last_active":"2024-09-11T06:21:24.460865+0000","last_peered":"2024-09-11T06:21:24.460865+0000","last_clean":"2024-09-11T06:21:24.460865+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:21:24.460865+0000","last_undegraded":"2024-09-11T06:21:24.460865+0000","last_fullsized":"2024-09-11T06:21:24.460865+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:27.675499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033761000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4034,"num_read_kb":32429,"num_write":1192,"num_write_kb":32728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247705+0000","last_change":"2024-09-11T06:20:11.126087+0000","last_active":"2024-09-11T06:21:23.247705+0000","last_peered":"2024-09-11T06:21:23.247705+0000","last_clean":"2024-09-11T06:21:23.247705+0000","last_became_active":"2024-09-11T06:20:11.125761+0000","last_became_peered":"2024-09-11T06:20:11.125761+0000","last_unstale":"2024-09-11T06:21:23.247705+0000","last_undegraded":"2024-09-11T06:21:23.247705+0000","last_fullsized":"2024-09-11T06:21:23.247705+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:30.205706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"257'608","reported_seq":8302,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248717+0000","last_change":"2024-09-11T06:21:07.171394+0000","last_active":"2024-09-11T06:21:23.248717+0000","last_peered":"2024-09-11T06:21:23.248717+0000","last_clean":"2024-09-11T06:21:23.248717+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:21:23.248717+0000","last_undegraded":"2024-09-11T06:21:23.248717+0000","last_fullsized":"2024-09-11T06:21:23.248717+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:03.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074336300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8361,"num_read_kb":32287,"num_write":839,"num_write_kb":30197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248095+0000","last_change":"2024-09-11T06:20:11.132669+0000","last_active":"2024-09-11T06:21:23.248095+0000","last_peered":"2024-09-11T06:21:23.248095+0000","last_clean":"2024-09-11T06:21:23.248095+0000","last_became_active":"2024-09-11T06:20:11.128373+0000","last_became_peered":"2024-09-11T06:20:11.128373+0000","last_unstale":"2024-09-11T06:21:23.248095+0000","last_undegraded":"2024-09-11T06:21:23.248095+0000","last_fullsized":"2024-09-11T06:21:23.248095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:55.902272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729719+0000","last_change":"2024-09-11T06:20:55.186236+0000","last_active":"2024-09-11T06:21:22.729719+0000","last_peered":"2024-09-11T06:21:22.729719+0000","last_clean":"2024-09-11T06:21:22.729719+0000","last_became_active":"2024-09-11T06:20:55.185644+0000","last_became_peered":"2024-09-11T06:20:55.185644+0000","last_unstale":"2024-09-11T06:21:22.729719+0000","last_undegraded":"2024-09-11T06:21:22.729719+0000","last_fullsized":"2024-09-11T06:21:22.729719+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:08:57.958332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'617","reported_seq":9845,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171488+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:18.809578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085945499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10608,"num_read_kb":43637,"num_write":702,"num_write_kb":29819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"257'381","reported_seq":8136,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247967+0000","last_change":"2024-09-11T06:21:07.233807+0000","last_active":"2024-09-11T06:21:23.247967+0000","last_peered":"2024-09-11T06:21:23.247967+0000","last_clean":"2024-09-11T06:21:23.247967+0000","last_became_active":"2024-09-11T06:20:15.126658+0000","last_became_peered":"2024-09-11T06:20:15.126658+0000","last_unstale":"2024-09-11T06:21:23.247967+0000","last_undegraded":"2024-09-11T06:21:23.247967+0000","last_fullsized":"2024-09-11T06:21:23.247967+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:36:46.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015157700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6873,"num_read_kb":49442,"num_write":558,"num_write_kb":30232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":34465896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"258'457","reported_seq":13065,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247789+0000","last_change":"2024-09-11T06:21:07.233521+0000","last_active":"2024-09-11T06:21:23.247789+0000","last_peered":"2024-09-11T06:21:23.247789+0000","last_clean":"2024-09-11T06:21:23.247789+0000","last_became_active":"2024-09-11T06:20:55.185551+0000","last_became_peered":"2024-09-11T06:20:55.185551+0000","last_unstale":"2024-09-11T06:21:23.247789+0000","last_undegraded":"2024-09-11T06:21:23.247789+0000","last_fullsized":"2024-09-11T06:21:23.247789+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:14.553047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013440069999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11885,"num_read_kb":48576,"num_write":550,"num_write_kb":27176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":312,"num_bytes_recovered":43677693,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"258'591","reported_seq":3605,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172022+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:33.648367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011988350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3308,"num_read_kb":19950,"num_write":926,"num_write_kb":26888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"257'662","reported_seq":3665,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729617+0000","last_change":"2024-09-11T06:21:07.167902+0000","last_active":"2024-09-11T06:21:22.729617+0000","last_peered":"2024-09-11T06:21:22.729617+0000","last_clean":"2024-09-11T06:21:22.729617+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:21:22.729617+0000","last_undegraded":"2024-09-11T06:21:22.729617+0000","last_fullsized":"2024-09-11T06:21:22.729617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:35.433625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012361620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3701,"num_read_kb":23930,"num_write":870,"num_write_kb":19296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"256'543","reported_seq":8287,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247910+0000","last_change":"2024-09-11T06:21:07.233878+0000","last_active":"2024-09-11T06:21:23.247910+0000","last_peered":"2024-09-11T06:21:23.247910+0000","last_clean":"2024-09-11T06:21:23.247910+0000","last_became_active":"2024-09-11T06:20:55.187089+0000","last_became_peered":"2024-09-11T06:20:55.187089+0000","last_unstale":"2024-09-11T06:21:23.247910+0000","last_undegraded":"2024-09-11T06:21:23.247910+0000","last_fullsized":"2024-09-11T06:21:23.247910+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:55.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001394836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7264,"num_read_kb":39003,"num_write":875,"num_write_kb":32876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":46719635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"257'647","reported_seq":20365,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248092+0000","last_change":"2024-09-11T06:21:07.165097+0000","last_active":"2024-09-11T06:21:23.248092+0000","last_peered":"2024-09-11T06:21:23.248092+0000","last_clean":"2024-09-11T06:21:23.248092+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:21:23.248092+0000","last_undegraded":"2024-09-11T06:21:23.248092+0000","last_fullsized":"2024-09-11T06:21:23.248092+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:29.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046631299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19910,"num_read_kb":76827,"num_write":792,"num_write_kb":30925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"258'605","reported_seq":5587,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729661+0000","last_change":"2024-09-11T06:21:07.167856+0000","last_active":"2024-09-11T06:21:22.729661+0000","last_peered":"2024-09-11T06:21:22.729661+0000","last_clean":"2024-09-11T06:21:22.729661+0000","last_became_active":"2024-09-11T06:20:55.184580+0000","last_became_peered":"2024-09-11T06:20:55.184580+0000","last_unstale":"2024-09-11T06:21:22.729661+0000","last_undegraded":"2024-09-11T06:21:22.729661+0000","last_fullsized":"2024-09-11T06:21:22.729661+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:46.496101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5156,"num_read_kb":38869,"num_write":703,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":26301332,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"258'540","reported_seq":8824,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729676+0000","last_change":"2024-09-11T06:21:07.163986+0000","last_active":"2024-09-11T06:21:22.729676+0000","last_peered":"2024-09-11T06:21:22.729676+0000","last_clean":"2024-09-11T06:21:22.729676+0000","last_became_active":"2024-09-11T06:20:55.183516+0000","last_became_peered":"2024-09-11T06:20:55.183516+0000","last_unstale":"2024-09-11T06:21:22.729676+0000","last_undegraded":"2024-09-11T06:21:22.729676+0000","last_fullsized":"2024-09-11T06:21:22.729676+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:33.254338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058563300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10001,"num_read_kb":48815,"num_write":537,"num_write_kb":34952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":20336086,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"255'455","reported_seq":8137,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247616+0000","last_change":"2024-09-11T06:21:07.233623+0000","last_active":"2024-09-11T06:21:23.247616+0000","last_peered":"2024-09-11T06:21:23.247616+0000","last_clean":"2024-09-11T06:21:23.247616+0000","last_became_active":"2024-09-11T06:20:15.123510+0000","last_became_peered":"2024-09-11T06:20:15.123510+0000","last_unstale":"2024-09-11T06:21:23.247616+0000","last_undegraded":"2024-09-11T06:21:23.247616+0000","last_fullsized":"2024-09-11T06:21:23.247616+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:39.520602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014223840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7512,"num_read_kb":50605,"num_write":531,"num_write_kb":34454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":37321190,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"257'453","reported_seq":3526,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460876+0000","last_change":"2024-09-11T06:21:07.163974+0000","last_active":"2024-09-11T06:21:24.460876+0000","last_peered":"2024-09-11T06:21:24.460876+0000","last_clean":"2024-09-11T06:21:24.460876+0000","last_became_active":"2024-09-11T06:20:14.140669+0000","last_became_peered":"2024-09-11T06:20:14.140669+0000","last_unstale":"2024-09-11T06:21:24.460876+0000","last_undegraded":"2024-09-11T06:21:24.460876+0000","last_fullsized":"2024-09-11T06:21:24.460876+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:29:21.007653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053784199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2621,"num_read_kb":28703,"num_write":734,"num_write_kb":23980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":19686402,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"256'420","reported_seq":4184,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247810+0000","last_change":"2024-09-11T06:21:07.232571+0000","last_active":"2024-09-11T06:21:23.247810+0000","last_peered":"2024-09-11T06:21:23.247810+0000","last_clean":"2024-09-11T06:21:23.247810+0000","last_became_active":"2024-09-11T06:20:15.128338+0000","last_became_peered":"2024-09-11T06:20:15.128338+0000","last_unstale":"2024-09-11T06:21:23.247810+0000","last_undegraded":"2024-09-11T06:21:23.247810+0000","last_fullsized":"2024-09-11T06:21:23.247810+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:11.186605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067989400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3148,"num_read_kb":35740,"num_write":591,"num_write_kb":26613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":24813340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240770,"num_read_kb":1384666,"num_write":25519,"num_write_kb":933038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4648,"num_bytes_recovered":642863479,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25754,"internal_metadata":0},"log_size":19202,"ondisk_log_size":19202,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":28087,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56696,"kb_used_data":3300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315144,"statfs":{"total":96636764160,"available":96578707456,"internally_reserved":0,"allocated":3379200,"data_stored":2243516,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34428,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337412,"statfs":{"total":96636764160,"available":96601509888,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48324,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323516,"statfs":{"total":96636764160,"available":96587280384,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748512,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":3240,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991271,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35996,"kb_used_data":3272,"kb_used_omap":10,"kb_used_meta":32693,"kb_avail":94335844,"statfs":{"total":96636764160,"available":96599904256,"internally_reserved":0,"allocated":3350528,"data_stored":2237666,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":10357,"internal_metadata":33478539},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64948,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306892,"statfs":{"total":96636764160,"available":96570257408,"internally_reserved":0,"allocated":3305472,"data_stored":1647279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52484,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:21:27.878 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T06:21:27.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:21:28.155 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:28.155 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:21:28.167 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-11T06:21:26.464285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":240886,"num_read_kb":1384766,"num_write":25680,"num_write_kb":935456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4653,"num_bytes_recovered":643453866,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19322,"ondisk_log_size":19322,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403976,"kb_used_data":26008,"kb_used_omap":37,"kb_used_meta":377754,"kb_avail":754570744,"statfs":{"total":773094113280,"available":772680441856,"internally_reserved":0,"allocated":26632192,"data_stored":14394144,"data_compressed":18378,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":38504,"internal_metadata":386820504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"3.1f","version":"258'361","reported_seq":3850,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712707+0000","last_change":"2024-09-11T06:21:07.211570+0000","last_active":"2024-09-11T06:21:23.712707+0000","last_peered":"2024-09-11T06:21:23.712707+0000","last_clean":"2024-09-11T06:21:23.712707+0000","last_became_active":"2024-09-11T06:20:55.187911+0000","last_became_peered":"2024-09-11T06:20:55.187911+0000","last_unstale":"2024-09-11T06:21:23.712707+0000","last_undegraded":"2024-09-11T06:21:23.712707+0000","last_fullsized":"2024-09-11T06:21:23.712707+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:26.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097570600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2483,"num_read_kb":28994,"num_write":517,"num_write_kb":29011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":14150952,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"257'547","reported_seq":6056,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712704+0000","last_change":"2024-09-11T06:21:07.211065+0000","last_active":"2024-09-11T06:21:23.712704+0000","last_peered":"2024-09-11T06:21:23.712704+0000","last_clean":"2024-09-11T06:21:23.712704+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:21:23.712704+0000","last_undegraded":"2024-09-11T06:21:23.712704+0000","last_fullsized":"2024-09-11T06:21:23.712704+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:40.880540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047299499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5799,"num_read_kb":23656,"num_write":730,"num_write_kb":18043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"257'852","reported_seq":10947,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247708+0000","last_change":"2024-09-11T06:21:07.232839+0000","last_active":"2024-09-11T06:21:23.247708+0000","last_peered":"2024-09-11T06:21:23.247708+0000","last_clean":"2024-09-11T06:21:23.247708+0000","last_became_active":"2024-09-11T06:20:16.128387+0000","last_became_peered":"2024-09-11T06:20:16.128387+0000","last_unstale":"2024-09-11T06:21:23.247708+0000","last_undegraded":"2024-09-11T06:21:23.247708+0000","last_fullsized":"2024-09-11T06:21:23.247708+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:25.000017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085877900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11560,"num_read_kb":90044,"num_write":1319,"num_write_kb":37601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":52081629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"258'662","reported_seq":11802,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729811+0000","last_change":"2024-09-11T06:21:07.164562+0000","last_active":"2024-09-11T06:21:22.729811+0000","last_peered":"2024-09-11T06:21:22.729811+0000","last_clean":"2024-09-11T06:21:22.729811+0000","last_became_active":"2024-09-11T06:20:55.183472+0000","last_became_peered":"2024-09-11T06:20:55.183472+0000","last_unstale":"2024-09-11T06:21:22.729811+0000","last_undegraded":"2024-09-11T06:21:22.729811+0000","last_fullsized":"2024-09-11T06:21:22.729811+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:15.621722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151093,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12097,"num_read_kb":53988,"num_write":979,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":10143007,"num_keys_recovered":276,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"256'515","reported_seq":6222,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248917+0000","last_change":"2024-09-11T06:21:07.171198+0000","last_active":"2024-09-11T06:21:23.248917+0000","last_peered":"2024-09-11T06:21:23.248917+0000","last_clean":"2024-09-11T06:21:23.248917+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:21:23.248917+0000","last_undegraded":"2024-09-11T06:21:23.248917+0000","last_fullsized":"2024-09-11T06:21:23.248917+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:38.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055166700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5130,"num_read_kb":36360,"num_write":718,"num_write_kb":27489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"256'660","reported_seq":10754,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729843+0000","last_change":"2024-09-11T06:21:07.164604+0000","last_active":"2024-09-11T06:21:22.729843+0000","last_peered":"2024-09-11T06:21:22.729843+0000","last_clean":"2024-09-11T06:21:22.729843+0000","last_became_active":"2024-09-11T06:20:55.183560+0000","last_became_peered":"2024-09-11T06:20:55.183560+0000","last_unstale":"2024-09-11T06:21:22.729843+0000","last_undegraded":"2024-09-11T06:21:22.729843+0000","last_fullsized":"2024-09-11T06:21:22.729843+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:17.588003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078848799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10645,"num_read_kb":66160,"num_write":849,"num_write_kb":27853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":22168966,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"257'554","reported_seq":6776,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171097+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:20:55.181728+0000","last_became_peered":"2024-09-11T06:20:55.181728+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:43.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000465866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6471,"num_read_kb":29586,"num_write":634,"num_write_kb":18722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":372,"num_bytes_recovered":14762773,"num_keys_recovered":100,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"257'1131","reported_seq":9744,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712737+0000","last_change":"2024-09-11T06:21:07.211882+0000","last_active":"2024-09-11T06:21:23.712737+0000","last_peered":"2024-09-11T06:21:23.712737+0000","last_clean":"2024-09-11T06:21:23.712737+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:21:23.712737+0000","last_undegraded":"2024-09-11T06:21:23.712737+0000","last_fullsized":"2024-09-11T06:21:23.712737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:55.097907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010472719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13075,"num_read_kb":38666,"num_write":1619,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"255'295","reported_seq":4570,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712709+0000","last_change":"2024-09-11T06:21:07.211919+0000","last_active":"2024-09-11T06:21:23.712709+0000","last_peered":"2024-09-11T06:21:23.712709+0000","last_clean":"2024-09-11T06:21:23.712709+0000","last_became_active":"2024-09-11T06:20:14.140869+0000","last_became_peered":"2024-09-11T06:20:14.140869+0000","last_unstale":"2024-09-11T06:21:23.712709+0000","last_undegraded":"2024-09-11T06:21:23.712709+0000","last_fullsized":"2024-09-11T06:21:23.712709+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:22.240506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2899,"num_read_kb":36950,"num_write":396,"num_write_kb":23221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":21224115,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"257'612","reported_seq":8612,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248475+0000","last_change":"2024-09-11T06:21:07.164911+0000","last_active":"2024-09-11T06:21:23.248475+0000","last_peered":"2024-09-11T06:21:23.248475+0000","last_clean":"2024-09-11T06:21:23.248475+0000","last_became_active":"2024-09-11T06:20:15.124862+0000","last_became_peered":"2024-09-11T06:20:15.124862+0000","last_unstale":"2024-09-11T06:21:23.248475+0000","last_undegraded":"2024-09-11T06:21:23.248475+0000","last_fullsized":"2024-09-11T06:21:23.248475+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:37.528256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062779600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9055,"num_read_kb":39121,"num_write":753,"num_write_kb":29738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":17793964,"num_keys_recovered":77,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"257'496","reported_seq":4800,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729694+0000","last_change":"2024-09-11T06:21:07.168207+0000","last_active":"2024-09-11T06:21:22.729694+0000","last_peered":"2024-09-11T06:21:22.729694+0000","last_clean":"2024-09-11T06:21:22.729694+0000","last_became_active":"2024-09-11T06:20:01.126371+0000","last_became_peered":"2024-09-11T06:20:01.126371+0000","last_unstale":"2024-09-11T06:21:22.729694+0000","last_undegraded":"2024-09-11T06:21:22.729694+0000","last_fullsized":"2024-09-11T06:21:22.729694+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:26:00.929781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001549929,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3619,"num_read_kb":43290,"num_write":684,"num_write_kb":36893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":40168837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"257'400","reported_seq":11994,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247790+0000","last_change":"2024-09-11T06:21:07.232518+0000","last_active":"2024-09-11T06:21:23.247790+0000","last_peered":"2024-09-11T06:21:23.247790+0000","last_clean":"2024-09-11T06:21:23.247790+0000","last_became_active":"2024-09-11T06:20:15.123718+0000","last_became_peered":"2024-09-11T06:20:15.123718+0000","last_unstale":"2024-09-11T06:21:23.247790+0000","last_undegraded":"2024-09-11T06:21:23.247790+0000","last_fullsized":"2024-09-11T06:21:23.247790+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:16.231831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054683100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9669,"num_read_kb":71024,"num_write":411,"num_write_kb":42855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":83153006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247893+0000","last_change":"2024-09-11T06:20:11.126114+0000","last_active":"2024-09-11T06:21:23.247893+0000","last_peered":"2024-09-11T06:21:23.247893+0000","last_clean":"2024-09-11T06:21:23.247893+0000","last_became_active":"2024-09-11T06:20:11.125589+0000","last_became_peered":"2024-09-11T06:20:11.125589+0000","last_unstale":"2024-09-11T06:21:23.247893+0000","last_undegraded":"2024-09-11T06:21:23.247893+0000","last_fullsized":"2024-09-11T06:21:23.247893+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:26.809341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"258'374","reported_seq":5148,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248756+0000","last_change":"2024-09-11T06:21:07.171686+0000","last_active":"2024-09-11T06:21:23.248756+0000","last_peered":"2024-09-11T06:21:23.248756+0000","last_clean":"2024-09-11T06:21:23.248756+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:21:23.248756+0000","last_undegraded":"2024-09-11T06:21:23.248756+0000","last_fullsized":"2024-09-11T06:21:23.248756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:26.496746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095120700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3952,"num_read_kb":49104,"num_write":471,"num_write_kb":30546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":535,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248868+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:21:23.248868+0000","last_peered":"2024-09-11T06:21:23.248868+0000","last_clean":"2024-09-11T06:21:23.248868+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:21:23.248868+0000","last_undegraded":"2024-09-11T06:21:23.248868+0000","last_fullsized":"2024-09-11T06:21:23.248868+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:22.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"256'364","reported_seq":3899,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172112+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:22:13.850566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012844779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3327,"num_read_kb":33114,"num_write":460,"num_write_kb":24509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247811+0000","last_change":"2024-09-11T06:20:11.126588+0000","last_active":"2024-09-11T06:21:23.247811+0000","last_peered":"2024-09-11T06:21:23.247811+0000","last_clean":"2024-09-11T06:21:23.247811+0000","last_became_active":"2024-09-11T06:20:11.126287+0000","last_became_peered":"2024-09-11T06:20:11.126287+0000","last_unstale":"2024-09-11T06:21:23.247811+0000","last_undegraded":"2024-09-11T06:21:23.247811+0000","last_fullsized":"2024-09-11T06:21:23.247811+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:09.892331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"257'943","reported_seq":6729,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460918+0000","last_change":"2024-09-11T06:21:07.163783+0000","last_active":"2024-09-11T06:21:24.460918+0000","last_peered":"2024-09-11T06:21:24.460918+0000","last_clean":"2024-09-11T06:21:24.460918+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:21:24.460918+0000","last_undegraded":"2024-09-11T06:21:24.460918+0000","last_fullsized":"2024-09-11T06:21:24.460918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:43.468481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039519000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8223,"num_read_kb":61062,"num_write":1340,"num_write_kb":35882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712732+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:21:23.712732+0000","last_peered":"2024-09-11T06:21:23.712732+0000","last_clean":"2024-09-11T06:21:23.712732+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:21:23.712732+0000","last_undegraded":"2024-09-11T06:21:23.712732+0000","last_fullsized":"2024-09-11T06:21:23.712732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.868106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"258'974","reported_seq":9905,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247907+0000","last_change":"2024-09-11T06:21:07.164083+0000","last_active":"2024-09-11T06:21:23.247907+0000","last_peered":"2024-09-11T06:21:23.247907+0000","last_clean":"2024-09-11T06:21:23.247907+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:21:23.247907+0000","last_undegraded":"2024-09-11T06:21:23.247907+0000","last_fullsized":"2024-09-11T06:21:23.247907+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:51.023366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048838699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11583,"num_read_kb":37449,"num_write":1370,"num_write_kb":24166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"258'969","reported_seq":10311,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729568+0000","last_change":"2024-09-11T06:21:07.166913+0000","last_active":"2024-09-11T06:21:22.729568+0000","last_peered":"2024-09-11T06:21:22.729568+0000","last_clean":"2024-09-11T06:21:22.729568+0000","last_became_active":"2024-09-11T06:21:01.134591+0000","last_became_peered":"2024-09-11T06:21:01.134591+0000","last_unstale":"2024-09-11T06:21:22.729568+0000","last_undegraded":"2024-09-11T06:21:22.729568+0000","last_fullsized":"2024-09-11T06:21:22.729568+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:47.635577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036423400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11250,"num_read_kb":40045,"num_write":1055,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":373,"num_bytes_recovered":38854008,"num_keys_recovered":188,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247693+0000","last_change":"2024-09-11T06:20:11.130922+0000","last_active":"2024-09-11T06:21:23.247693+0000","last_peered":"2024-09-11T06:21:23.247693+0000","last_clean":"2024-09-11T06:21:23.247693+0000","last_became_active":"2024-09-11T06:20:11.125223+0000","last_became_peered":"2024-09-11T06:20:11.125223+0000","last_unstale":"2024-09-11T06:21:23.247693+0000","last_undegraded":"2024-09-11T06:21:23.247693+0000","last_fullsized":"2024-09-11T06:21:23.247693+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:32.651537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"256'597","reported_seq":6403,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712586+0000","last_change":"2024-09-11T06:21:07.211650+0000","last_active":"2024-09-11T06:21:23.712586+0000","last_peered":"2024-09-11T06:21:23.712586+0000","last_clean":"2024-09-11T06:21:23.712586+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:21:23.712586+0000","last_undegraded":"2024-09-11T06:21:23.712586+0000","last_fullsized":"2024-09-11T06:21:23.712586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:13.219129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097915299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5551,"num_read_kb":37240,"num_write":814,"num_write_kb":37266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.637461+0000","last_change":"2024-09-11T06:20:17.138900+0000","last_active":"2024-09-11T06:21:23.637461+0000","last_peered":"2024-09-11T06:21:23.637461+0000","last_clean":"2024-09-11T06:21:23.637461+0000","last_became_active":"2024-09-11T06:20:17.138587+0000","last_became_peered":"2024-09-11T06:20:17.138587+0000","last_unstale":"2024-09-11T06:21:23.637461+0000","last_undegraded":"2024-09-11T06:21:23.637461+0000","last_fullsized":"2024-09-11T06:21:23.637461+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:45.951420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"258'917","reported_seq":4060,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460865+0000","last_change":"2024-09-11T06:21:07.163704+0000","last_active":"2024-09-11T06:21:24.460865+0000","last_peered":"2024-09-11T06:21:24.460865+0000","last_clean":"2024-09-11T06:21:24.460865+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:21:24.460865+0000","last_undegraded":"2024-09-11T06:21:24.460865+0000","last_fullsized":"2024-09-11T06:21:24.460865+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:27.675499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033761000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4034,"num_read_kb":32429,"num_write":1192,"num_write_kb":32728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247705+0000","last_change":"2024-09-11T06:20:11.126087+0000","last_active":"2024-09-11T06:21:23.247705+0000","last_peered":"2024-09-11T06:21:23.247705+0000","last_clean":"2024-09-11T06:21:23.247705+0000","last_became_active":"2024-09-11T06:20:11.125761+0000","last_became_peered":"2024-09-11T06:20:11.125761+0000","last_unstale":"2024-09-11T06:21:23.247705+0000","last_undegraded":"2024-09-11T06:21:23.247705+0000","last_fullsized":"2024-09-11T06:21:23.247705+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:30.205706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"257'608","reported_seq":8302,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248717+0000","last_change":"2024-09-11T06:21:07.171394+0000","last_active":"2024-09-11T06:21:23.248717+0000","last_peered":"2024-09-11T06:21:23.248717+0000","last_clean":"2024-09-11T06:21:23.248717+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:21:23.248717+0000","last_undegraded":"2024-09-11T06:21:23.248717+0000","last_fullsized":"2024-09-11T06:21:23.248717+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:03.428989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074336300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8361,"num_read_kb":32287,"num_write":839,"num_write_kb":30197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248095+0000","last_change":"2024-09-11T06:20:11.132669+0000","last_active":"2024-09-11T06:21:23.248095+0000","last_peered":"2024-09-11T06:21:23.248095+0000","last_clean":"2024-09-11T06:21:23.248095+0000","last_became_active":"2024-09-11T06:20:11.128373+0000","last_became_peered":"2024-09-11T06:20:11.128373+0000","last_unstale":"2024-09-11T06:21:23.248095+0000","last_undegraded":"2024-09-11T06:21:23.248095+0000","last_fullsized":"2024-09-11T06:21:23.248095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:55.902272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":305,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729719+0000","last_change":"2024-09-11T06:20:55.186236+0000","last_active":"2024-09-11T06:21:22.729719+0000","last_peered":"2024-09-11T06:21:22.729719+0000","last_clean":"2024-09-11T06:21:22.729719+0000","last_became_active":"2024-09-11T06:20:55.185644+0000","last_became_peered":"2024-09-11T06:20:55.185644+0000","last_unstale":"2024-09-11T06:21:22.729719+0000","last_undegraded":"2024-09-11T06:21:22.729719+0000","last_fullsized":"2024-09-11T06:21:22.729719+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:08:57.958332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'617","reported_seq":9845,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248703+0000","last_change":"2024-09-11T06:21:07.171488+0000","last_active":"2024-09-11T06:21:23.248703+0000","last_peered":"2024-09-11T06:21:23.248703+0000","last_clean":"2024-09-11T06:21:23.248703+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:21:23.248703+0000","last_undegraded":"2024-09-11T06:21:23.248703+0000","last_fullsized":"2024-09-11T06:21:23.248703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:18.809578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085945499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10608,"num_read_kb":43637,"num_write":702,"num_write_kb":29819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"257'381","reported_seq":8136,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247967+0000","last_change":"2024-09-11T06:21:07.233807+0000","last_active":"2024-09-11T06:21:23.247967+0000","last_peered":"2024-09-11T06:21:23.247967+0000","last_clean":"2024-09-11T06:21:23.247967+0000","last_became_active":"2024-09-11T06:20:15.126658+0000","last_became_peered":"2024-09-11T06:20:15.126658+0000","last_unstale":"2024-09-11T06:21:23.247967+0000","last_undegraded":"2024-09-11T06:21:23.247967+0000","last_fullsized":"2024-09-11T06:21:23.247967+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:36:46.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015157700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6873,"num_read_kb":49442,"num_write":558,"num_write_kb":30232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":34465896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"258'457","reported_seq":13065,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247789+0000","last_change":"2024-09-11T06:21:07.233521+0000","last_active":"2024-09-11T06:21:23.247789+0000","last_peered":"2024-09-11T06:21:23.247789+0000","last_clean":"2024-09-11T06:21:23.247789+0000","last_became_active":"2024-09-11T06:20:55.185551+0000","last_became_peered":"2024-09-11T06:20:55.185551+0000","last_unstale":"2024-09-11T06:21:23.247789+0000","last_undegraded":"2024-09-11T06:21:23.247789+0000","last_fullsized":"2024-09-11T06:21:23.247789+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:14.553047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013440069999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11885,"num_read_kb":48576,"num_write":550,"num_write_kb":27176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":312,"num_bytes_recovered":43677693,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"258'591","reported_seq":3605,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248870+0000","last_change":"2024-09-11T06:21:07.172022+0000","last_active":"2024-09-11T06:21:23.248870+0000","last_peered":"2024-09-11T06:21:23.248870+0000","last_clean":"2024-09-11T06:21:23.248870+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:21:23.248870+0000","last_undegraded":"2024-09-11T06:21:23.248870+0000","last_fullsized":"2024-09-11T06:21:23.248870+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:33.648367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011988350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3308,"num_read_kb":19950,"num_write":926,"num_write_kb":26888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"257'662","reported_seq":3665,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729617+0000","last_change":"2024-09-11T06:21:07.167902+0000","last_active":"2024-09-11T06:21:22.729617+0000","last_peered":"2024-09-11T06:21:22.729617+0000","last_clean":"2024-09-11T06:21:22.729617+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:21:22.729617+0000","last_undegraded":"2024-09-11T06:21:22.729617+0000","last_fullsized":"2024-09-11T06:21:22.729617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:35.433625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012361620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3701,"num_read_kb":23930,"num_write":870,"num_write_kb":19296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"256'543","reported_seq":8287,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247910+0000","last_change":"2024-09-11T06:21:07.233878+0000","last_active":"2024-09-11T06:21:23.247910+0000","last_peered":"2024-09-11T06:21:23.247910+0000","last_clean":"2024-09-11T06:21:23.247910+0000","last_became_active":"2024-09-11T06:20:55.187089+0000","last_became_peered":"2024-09-11T06:20:55.187089+0000","last_unstale":"2024-09-11T06:21:23.247910+0000","last_undegraded":"2024-09-11T06:21:23.247910+0000","last_fullsized":"2024-09-11T06:21:23.247910+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:55.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001394836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7264,"num_read_kb":39003,"num_write":875,"num_write_kb":32876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":46719635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"257'647","reported_seq":20365,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248092+0000","last_change":"2024-09-11T06:21:07.165097+0000","last_active":"2024-09-11T06:21:23.248092+0000","last_peered":"2024-09-11T06:21:23.248092+0000","last_clean":"2024-09-11T06:21:23.248092+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:21:23.248092+0000","last_undegraded":"2024-09-11T06:21:23.248092+0000","last_fullsized":"2024-09-11T06:21:23.248092+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:29.935287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046631299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19910,"num_read_kb":76827,"num_write":792,"num_write_kb":30925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"258'605","reported_seq":5587,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729661+0000","last_change":"2024-09-11T06:21:07.167856+0000","last_active":"2024-09-11T06:21:22.729661+0000","last_peered":"2024-09-11T06:21:22.729661+0000","last_clean":"2024-09-11T06:21:22.729661+0000","last_became_active":"2024-09-11T06:20:55.184580+0000","last_became_peered":"2024-09-11T06:20:55.184580+0000","last_unstale":"2024-09-11T06:21:22.729661+0000","last_undegraded":"2024-09-11T06:21:22.729661+0000","last_fullsized":"2024-09-11T06:21:22.729661+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:46.496101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5156,"num_read_kb":38869,"num_write":703,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":26301332,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"258'540","reported_seq":8824,"reported_epoch":273,"state":"active+clean","last_fresh":"2024-09-11T06:21:22.729676+0000","last_change":"2024-09-11T06:21:07.163986+0000","last_active":"2024-09-11T06:21:22.729676+0000","last_peered":"2024-09-11T06:21:22.729676+0000","last_clean":"2024-09-11T06:21:22.729676+0000","last_became_active":"2024-09-11T06:20:55.183516+0000","last_became_peered":"2024-09-11T06:20:55.183516+0000","last_unstale":"2024-09-11T06:21:22.729676+0000","last_undegraded":"2024-09-11T06:21:22.729676+0000","last_fullsized":"2024-09-11T06:21:22.729676+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:33.254338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058563300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10001,"num_read_kb":48815,"num_write":537,"num_write_kb":34952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":20336086,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"255'455","reported_seq":8137,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247616+0000","last_change":"2024-09-11T06:21:07.233623+0000","last_active":"2024-09-11T06:21:23.247616+0000","last_peered":"2024-09-11T06:21:23.247616+0000","last_clean":"2024-09-11T06:21:23.247616+0000","last_became_active":"2024-09-11T06:20:15.123510+0000","last_became_peered":"2024-09-11T06:20:15.123510+0000","last_unstale":"2024-09-11T06:21:23.247616+0000","last_undegraded":"2024-09-11T06:21:23.247616+0000","last_fullsized":"2024-09-11T06:21:23.247616+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:39.520602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014223840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7512,"num_read_kb":50605,"num_write":531,"num_write_kb":34454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":37321190,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"257'453","reported_seq":3526,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460876+0000","last_change":"2024-09-11T06:21:07.163974+0000","last_active":"2024-09-11T06:21:24.460876+0000","last_peered":"2024-09-11T06:21:24.460876+0000","last_clean":"2024-09-11T06:21:24.460876+0000","last_became_active":"2024-09-11T06:20:14.140669+0000","last_became_peered":"2024-09-11T06:20:14.140669+0000","last_unstale":"2024-09-11T06:21:24.460876+0000","last_undegraded":"2024-09-11T06:21:24.460876+0000","last_fullsized":"2024-09-11T06:21:24.460876+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:29:21.007653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053784199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2621,"num_read_kb":28703,"num_write":734,"num_write_kb":23980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":19686402,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"256'420","reported_seq":4184,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247810+0000","last_change":"2024-09-11T06:21:07.232571+0000","last_active":"2024-09-11T06:21:23.247810+0000","last_peered":"2024-09-11T06:21:23.247810+0000","last_clean":"2024-09-11T06:21:23.247810+0000","last_became_active":"2024-09-11T06:20:15.128338+0000","last_became_peered":"2024-09-11T06:20:15.128338+0000","last_unstale":"2024-09-11T06:21:23.247810+0000","last_undegraded":"2024-09-11T06:21:23.247810+0000","last_fullsized":"2024-09-11T06:21:23.247810+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:11.186605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067989400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3148,"num_read_kb":35740,"num_write":591,"num_write_kb":26613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":24813340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240770,"num_read_kb":1384666,"num_write":25519,"num_write_kb":933038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4648,"num_bytes_recovered":642863479,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25754,"internal_metadata":0},"log_size":19202,"ondisk_log_size":19202,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":28087,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56696,"kb_used_data":3300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315144,"statfs":{"total":96636764160,"available":96578707456,"internally_reserved":0,"allocated":3379200,"data_stored":2243516,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34428,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337412,"statfs":{"total":96636764160,"available":96601509888,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48324,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323516,"statfs":{"total":96636764160,"available":96587280384,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748512,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":3240,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991271,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35996,"kb_used_data":3272,"kb_used_omap":10,"kb_used_meta":32693,"kb_avail":94335844,"statfs":{"total":96636764160,"available":96599904256,"internally_reserved":0,"allocated":3350528,"data_stored":2237666,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":10357,"internal_metadata":33478539},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64948,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306892,"statfs":{"total":96636764160,"available":96570257408,"internally_reserved":0,"allocated":3305472,"data_stored":1647279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52484,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:21:28.169 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T06:21:28.447 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:28.447 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":274,"fsid":"7a868aca-1727-4b78-b18f-580564f1ab22","created":"2024-09-11T06:16:40.301387+0000","modified":"2024-09-11T06:21:23.244778+0000","last_up_change":"2024-09-11T06:18:57.153745+0000","last_in_change":"2024-09-11T06:20:51.154318+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T06:16:52.447451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T06:16:58.078189+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T06:17:07.729638+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":84,"snap_epoch":258,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba31bd4-e78d-407b-b639-5bb5104f3693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6825","nonce":2621452558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6827","nonce":2621452558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6831","nonce":2621452558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2621452558},{"type":"v1","addr":"172.21.15.70:6829","nonce":2621452558}]},"public_addr":"172.21.15.70:6825/2621452558","cluster_addr":"172.21.15.70:6827/2621452558","heartbeat_back_addr":"172.21.15.70:6831/2621452558","heartbeat_front_addr":"172.21.15.70:6829/2621452558","state":["exists","up"]},{"osd":1,"uuid":"7595b4c2-1d7e-4a8d-ab1e-ec15a9b2ab0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":54,"up_from":92,"up_thru":245,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6817","nonce":747530186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6819","nonce":747530186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6823","nonce":747530186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":747530186},{"type":"v1","addr":"172.21.15.70:6821","nonce":747530186}]},"public_addr":"172.21.15.70:6817/747530186","cluster_addr":"172.21.15.70:6819/747530186","heartbeat_back_addr":"172.21.15.70:6823/747530186","heartbeat_front_addr":"172.21.15.70:6821/747530186","state":["exists","up"]},{"osd":2,"uuid":"1c946778-5c51-4d07-94a2-ada9d70d1bba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":109,"up_from":130,"up_thru":244,"down_at":110,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6809","nonce":4176263936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6811","nonce":4176263936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6815","nonce":4176263936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":4176263936},{"type":"v1","addr":"172.21.15.70:6813","nonce":4176263936}]},"public_addr":"172.21.15.70:6809/4176263936","cluster_addr":"172.21.15.70:6811/4176263936","heartbeat_back_addr":"172.21.15.70:6815/4176263936","heartbeat_front_addr":"172.21.15.70:6813/4176263936","state":["exists","up"]},{"osd":3,"uuid":"1833d4e7-d511-4086-bbde-e7822ec6c1f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":250,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6801","nonce":2301707714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6803","nonce":2301707714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6807","nonce":2301707714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":2301707714},{"type":"v1","addr":"172.21.15.70:6805","nonce":2301707714}]},"public_addr":"172.21.15.70:6801/2301707714","cluster_addr":"172.21.15.70:6803/2301707714","heartbeat_back_addr":"172.21.15.70:6807/2301707714","heartbeat_front_addr":"172.21.15.70:6805/2301707714","state":["exists","up"]},{"osd":4,"uuid":"28e56042-c64d-4193-be5b-752137116220","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6809","nonce":2043476445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6811","nonce":2043476445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6815","nonce":2043476445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2043476445},{"type":"v1","addr":"172.21.15.194:6813","nonce":2043476445}]},"public_addr":"172.21.15.194:6809/2043476445","cluster_addr":"172.21.15.194:6811/2043476445","heartbeat_back_addr":"172.21.15.194:6815/2043476445","heartbeat_front_addr":"172.21.15.194:6813/2043476445","state":["exists","up"]},{"osd":5,"uuid":"80e06445-79b9-4069-851a-b5f63a882000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":245,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6817","nonce":213940923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6819","nonce":213940923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6823","nonce":213940923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":213940923},{"type":"v1","addr":"172.21.15.194:6821","nonce":213940923}]},"public_addr":"172.21.15.194:6817/213940923","cluster_addr":"172.21.15.194:6819/213940923","heartbeat_back_addr":"172.21.15.194:6823/213940923","heartbeat_front_addr":"172.21.15.194:6821/213940923","state":["exists","up"]},{"osd":6,"uuid":"05e46d6f-c759-41f4-bfd4-9514c0bd73fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6825","nonce":3016223649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6827","nonce":3016223649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6831","nonce":3016223649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":3016223649},{"type":"v1","addr":"172.21.15.194:6829","nonce":3016223649}]},"public_addr":"172.21.15.194:6825/3016223649","cluster_addr":"172.21.15.194:6827/3016223649","heartbeat_back_addr":"172.21.15.194:6831/3016223649","heartbeat_front_addr":"172.21.15.194:6829/3016223649","state":["exists","up"]},{"osd":7,"uuid":"26bcdc28-2387-4117-9005-399f68fc0439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6801","nonce":2361511015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6803","nonce":2361511015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6807","nonce":2361511015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2361511015},{"type":"v1","addr":"172.21.15.194:6805","nonce":2361511015}]},"public_addr":"172.21.15.194:6801/2361511015","cluster_addr":"172.21.15.194:6803/2361511015","heartbeat_back_addr":"172.21.15.194:6807/2361511015","heartbeat_front_addr":"172.21.15.194:6805/2361511015","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.852226+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.638877+0000","dead_epoch":56},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.930981+0000","dead_epoch":110},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.677178+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.636635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.104700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:49.150845+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T06:16:48.365417+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":7,"to":4},{"from":6,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T06:21:29.461 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T06:21:29.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T06:21:29.598 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:29.598 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T06:21:29.598 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:29.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T06:21:29.888 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T06:21:29.901 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T06:21:29.901 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T06:21:30.023 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T06:21:30.024 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:30.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T06:21:30.315 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T06:21:30.327 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T06:21:30.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T06:21:30.451 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:30.451 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T06:21:30.451 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:30.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T06:21:30.738 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T06:21:30.751 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T06:21:30.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T06:21:30.874 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:30.874 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T06:21:30.874 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:30.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T06:21:31.162 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T06:21:31.175 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T06:21:31.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T06:21:31.298 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:31.298 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T06:21:31.298 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:31.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T06:21:31.584 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T06:21:31.596 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T06:21:31.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T06:21:31.721 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:31.721 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T06:21:31.721 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:31.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T06:21:32.009 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T06:21:32.022 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T06:21:32.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T06:21:32.145 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:32.145 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T06:21:32.145 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:32.155 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T06:21:32.433 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T06:21:32.446 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T06:21:32.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T06:21:32.570 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-11T06:21:32.570 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T06:21:32.571 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-11T06:21:32.581 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T06:21:32.859 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T06:21:32.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:21:33.148 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:33.149 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:21:33.161 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-11T06:21:32.465227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":240886,"num_read_kb":1384766,"num_write":25680,"num_write_kb":935456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4653,"num_bytes_recovered":643453866,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19323,"ondisk_log_size":19323,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403984,"kb_used_data":26032,"kb_used_omap":37,"kb_used_meta":377754,"kb_avail":754570736,"statfs":{"total":773094113280,"available":772680433664,"internally_reserved":0,"allocated":26656768,"data_stored":14405844,"data_compressed":18378,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":38504,"internal_metadata":386820504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001683"},"pg_stats":[{"pgid":"3.1f","version":"258'361","reported_seq":3851,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712786+0000","last_change":"2024-09-11T06:21:07.211570+0000","last_active":"2024-09-11T06:21:23.712786+0000","last_peered":"2024-09-11T06:21:23.712786+0000","last_clean":"2024-09-11T06:21:23.712786+0000","last_became_active":"2024-09-11T06:20:55.187911+0000","last_became_peered":"2024-09-11T06:20:55.187911+0000","last_unstale":"2024-09-11T06:21:23.712786+0000","last_undegraded":"2024-09-11T06:21:23.712786+0000","last_fullsized":"2024-09-11T06:21:23.712786+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097570600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2483,"num_read_kb":28994,"num_write":517,"num_write_kb":29011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":14150952,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"257'547","reported_seq":6057,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712778+0000","last_change":"2024-09-11T06:21:07.211065+0000","last_active":"2024-09-11T06:21:23.712778+0000","last_peered":"2024-09-11T06:21:23.712778+0000","last_clean":"2024-09-11T06:21:23.712778+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:21:23.712778+0000","last_undegraded":"2024-09-11T06:21:23.712778+0000","last_fullsized":"2024-09-11T06:21:23.712778+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047299499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5799,"num_read_kb":23656,"num_write":730,"num_write_kb":18043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"257'852","reported_seq":10947,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247708+0000","last_change":"2024-09-11T06:21:07.232839+0000","last_active":"2024-09-11T06:21:23.247708+0000","last_peered":"2024-09-11T06:21:23.247708+0000","last_clean":"2024-09-11T06:21:23.247708+0000","last_became_active":"2024-09-11T06:20:16.128387+0000","last_became_peered":"2024-09-11T06:20:16.128387+0000","last_unstale":"2024-09-11T06:21:23.247708+0000","last_undegraded":"2024-09-11T06:21:23.247708+0000","last_fullsized":"2024-09-11T06:21:23.247708+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:25.000017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085877900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11560,"num_read_kb":90044,"num_write":1319,"num_write_kb":37601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":52081629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"258'662","reported_seq":11813,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.697685+0000","last_change":"2024-09-11T06:21:31.697729+0000","last_active":"2024-09-11T06:21:31.697685+0000","last_peered":"2024-09-11T06:21:31.697685+0000","last_clean":"2024-09-11T06:21:31.697685+0000","last_became_active":"2024-09-11T06:20:55.183472+0000","last_became_peered":"2024-09-11T06:20:55.183472+0000","last_unstale":"2024-09-11T06:21:31.697685+0000","last_undegraded":"2024-09-11T06:21:31.697685+0000","last_fullsized":"2024-09-11T06:21:31.697685+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'662","last_scrub_stamp":"2024-09-11T06:21:31.697592+0000","last_deep_scrub":"258'662","last_deep_scrub_stamp":"2024-09-11T06:21:31.697592+0000","last_clean_scrub_stamp":"2024-09-11T06:21:31.697592+0000","objects_scrubbed":1,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:30.605449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151093,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12097,"num_read_kb":53988,"num_write":979,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":10143007,"num_keys_recovered":276,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"256'515","reported_seq":6223,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248965+0000","last_change":"2024-09-11T06:21:07.171198+0000","last_active":"2024-09-11T06:21:23.248965+0000","last_peered":"2024-09-11T06:21:23.248965+0000","last_clean":"2024-09-11T06:21:23.248965+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:21:23.248965+0000","last_undegraded":"2024-09-11T06:21:23.248965+0000","last_fullsized":"2024-09-11T06:21:23.248965+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055166700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5130,"num_read_kb":36360,"num_write":718,"num_write_kb":27489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"274'661","reported_seq":10766,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:30.737719+0000","last_change":"2024-09-11T06:21:30.737742+0000","last_active":"2024-09-11T06:21:30.737719+0000","last_peered":"2024-09-11T06:21:30.737719+0000","last_clean":"2024-09-11T06:21:30.737719+0000","last_became_active":"2024-09-11T06:20:55.183560+0000","last_became_peered":"2024-09-11T06:20:55.183560+0000","last_unstale":"2024-09-11T06:21:30.737719+0000","last_undegraded":"2024-09-11T06:21:30.737719+0000","last_fullsized":"2024-09-11T06:21:30.737719+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"274'661","last_scrub_stamp":"2024-09-11T06:21:30.737655+0000","last_deep_scrub":"274'661","last_deep_scrub_stamp":"2024-09-11T06:21:30.737655+0000","last_clean_scrub_stamp":"2024-09-11T06:21:30.737655+0000","objects_scrubbed":1,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:58.686012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00078848799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10645,"num_read_kb":66160,"num_write":849,"num_write_kb":27853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":22168966,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"257'554","reported_seq":6777,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248788+0000","last_change":"2024-09-11T06:21:07.171097+0000","last_active":"2024-09-11T06:21:23.248788+0000","last_peered":"2024-09-11T06:21:23.248788+0000","last_clean":"2024-09-11T06:21:23.248788+0000","last_became_active":"2024-09-11T06:20:55.181728+0000","last_became_peered":"2024-09-11T06:20:55.181728+0000","last_unstale":"2024-09-11T06:21:23.248788+0000","last_undegraded":"2024-09-11T06:21:23.248788+0000","last_fullsized":"2024-09-11T06:21:23.248788+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000465866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6471,"num_read_kb":29586,"num_write":634,"num_write_kb":18722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":372,"num_bytes_recovered":14762773,"num_keys_recovered":100,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"257'1131","reported_seq":9745,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712793+0000","last_change":"2024-09-11T06:21:07.211882+0000","last_active":"2024-09-11T06:21:23.712793+0000","last_peered":"2024-09-11T06:21:23.712793+0000","last_clean":"2024-09-11T06:21:23.712793+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:21:23.712793+0000","last_undegraded":"2024-09-11T06:21:23.712793+0000","last_fullsized":"2024-09-11T06:21:23.712793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010472719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13075,"num_read_kb":38666,"num_write":1619,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"255'295","reported_seq":4571,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712767+0000","last_change":"2024-09-11T06:21:07.211919+0000","last_active":"2024-09-11T06:21:23.712767+0000","last_peered":"2024-09-11T06:21:23.712767+0000","last_clean":"2024-09-11T06:21:23.712767+0000","last_became_active":"2024-09-11T06:20:14.140869+0000","last_became_peered":"2024-09-11T06:20:14.140869+0000","last_unstale":"2024-09-11T06:21:23.712767+0000","last_undegraded":"2024-09-11T06:21:23.712767+0000","last_fullsized":"2024-09-11T06:21:23.712767+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2899,"num_read_kb":36950,"num_write":396,"num_write_kb":23221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":21224115,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"257'612","reported_seq":8613,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248527+0000","last_change":"2024-09-11T06:21:07.164911+0000","last_active":"2024-09-11T06:21:23.248527+0000","last_peered":"2024-09-11T06:21:23.248527+0000","last_clean":"2024-09-11T06:21:23.248527+0000","last_became_active":"2024-09-11T06:20:15.124862+0000","last_became_peered":"2024-09-11T06:20:15.124862+0000","last_unstale":"2024-09-11T06:21:23.248527+0000","last_undegraded":"2024-09-11T06:21:23.248527+0000","last_fullsized":"2024-09-11T06:21:23.248527+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062779600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9055,"num_read_kb":39121,"num_write":753,"num_write_kb":29738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":17793964,"num_keys_recovered":77,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"257'496","reported_seq":4811,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:30.936251+0000","last_change":"2024-09-11T06:21:30.936290+0000","last_active":"2024-09-11T06:21:30.936251+0000","last_peered":"2024-09-11T06:21:30.936251+0000","last_clean":"2024-09-11T06:21:30.936251+0000","last_became_active":"2024-09-11T06:20:01.126371+0000","last_became_peered":"2024-09-11T06:20:01.126371+0000","last_unstale":"2024-09-11T06:21:30.936251+0000","last_undegraded":"2024-09-11T06:21:30.936251+0000","last_fullsized":"2024-09-11T06:21:30.936251+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'496","last_scrub_stamp":"2024-09-11T06:21:30.936169+0000","last_deep_scrub":"257'496","last_deep_scrub_stamp":"2024-09-11T06:21:30.936169+0000","last_clean_scrub_stamp":"2024-09-11T06:21:30.936169+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:03:12.736985+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001549929,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3619,"num_read_kb":43290,"num_write":684,"num_write_kb":36893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":40168837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"257'400","reported_seq":11994,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247790+0000","last_change":"2024-09-11T06:21:07.232518+0000","last_active":"2024-09-11T06:21:23.247790+0000","last_peered":"2024-09-11T06:21:23.247790+0000","last_clean":"2024-09-11T06:21:23.247790+0000","last_became_active":"2024-09-11T06:20:15.123718+0000","last_became_peered":"2024-09-11T06:20:15.123718+0000","last_unstale":"2024-09-11T06:21:23.247790+0000","last_undegraded":"2024-09-11T06:21:23.247790+0000","last_fullsized":"2024-09-11T06:21:23.247790+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:16.231831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054683100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9669,"num_read_kb":71024,"num_write":411,"num_write_kb":42855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":83153006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247893+0000","last_change":"2024-09-11T06:20:11.126114+0000","last_active":"2024-09-11T06:21:23.247893+0000","last_peered":"2024-09-11T06:21:23.247893+0000","last_clean":"2024-09-11T06:21:23.247893+0000","last_became_active":"2024-09-11T06:20:11.125589+0000","last_became_peered":"2024-09-11T06:20:11.125589+0000","last_unstale":"2024-09-11T06:21:23.247893+0000","last_undegraded":"2024-09-11T06:21:23.247893+0000","last_fullsized":"2024-09-11T06:21:23.247893+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:26.809341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"258'374","reported_seq":5150,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.584017+0000","last_change":"2024-09-11T06:21:07.171686+0000","last_active":"2024-09-11T06:21:31.584017+0000","last_peered":"2024-09-11T06:21:31.584017+0000","last_clean":"2024-09-11T06:21:31.584017+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:21:31.584017+0000","last_undegraded":"2024-09-11T06:21:31.584017+0000","last_fullsized":"2024-09-11T06:21:31.584017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095120700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3952,"num_read_kb":49104,"num_write":471,"num_write_kb":30546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248935+0000","last_change":"2024-09-11T06:19:53.215498+0000","last_active":"2024-09-11T06:21:23.248935+0000","last_peered":"2024-09-11T06:21:23.248935+0000","last_clean":"2024-09-11T06:21:23.248935+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:21:23.248935+0000","last_undegraded":"2024-09-11T06:21:23.248935+0000","last_fullsized":"2024-09-11T06:21:23.248935+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"256'364","reported_seq":3901,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.584054+0000","last_change":"2024-09-11T06:21:07.172112+0000","last_active":"2024-09-11T06:21:31.584054+0000","last_peered":"2024-09-11T06:21:31.584054+0000","last_clean":"2024-09-11T06:21:31.584054+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:21:31.584054+0000","last_undegraded":"2024-09-11T06:21:31.584054+0000","last_fullsized":"2024-09-11T06:21:31.584054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012844779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3327,"num_read_kb":33114,"num_write":460,"num_write_kb":24509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247811+0000","last_change":"2024-09-11T06:20:11.126588+0000","last_active":"2024-09-11T06:21:23.247811+0000","last_peered":"2024-09-11T06:21:23.247811+0000","last_clean":"2024-09-11T06:21:23.247811+0000","last_became_active":"2024-09-11T06:20:11.126287+0000","last_became_peered":"2024-09-11T06:20:11.126287+0000","last_unstale":"2024-09-11T06:21:23.247811+0000","last_undegraded":"2024-09-11T06:21:23.247811+0000","last_fullsized":"2024-09-11T06:21:23.247811+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:52:09.892331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"257'943","reported_seq":6729,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460918+0000","last_change":"2024-09-11T06:21:07.163783+0000","last_active":"2024-09-11T06:21:24.460918+0000","last_peered":"2024-09-11T06:21:24.460918+0000","last_clean":"2024-09-11T06:21:24.460918+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:21:24.460918+0000","last_undegraded":"2024-09-11T06:21:24.460918+0000","last_fullsized":"2024-09-11T06:21:24.460918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:43.468481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039519000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8223,"num_read_kb":61062,"num_write":1340,"num_write_kb":35882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712790+0000","last_change":"2024-09-11T06:17:01.971289+0000","last_active":"2024-09-11T06:21:23.712790+0000","last_peered":"2024-09-11T06:21:23.712790+0000","last_clean":"2024-09-11T06:21:23.712790+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:21:23.712790+0000","last_undegraded":"2024-09-11T06:21:23.712790+0000","last_fullsized":"2024-09-11T06:21:23.712790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"258'974","reported_seq":9906,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247950+0000","last_change":"2024-09-11T06:21:07.164083+0000","last_active":"2024-09-11T06:21:23.247950+0000","last_peered":"2024-09-11T06:21:23.247950+0000","last_clean":"2024-09-11T06:21:23.247950+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:21:23.247950+0000","last_undegraded":"2024-09-11T06:21:23.247950+0000","last_fullsized":"2024-09-11T06:21:23.247950+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048838699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11583,"num_read_kb":37449,"num_write":1370,"num_write_kb":24166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"258'969","reported_seq":10314,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.578977+0000","last_change":"2024-09-11T06:21:07.166913+0000","last_active":"2024-09-11T06:21:24.578977+0000","last_peered":"2024-09-11T06:21:24.578977+0000","last_clean":"2024-09-11T06:21:24.578977+0000","last_became_active":"2024-09-11T06:21:01.134591+0000","last_became_peered":"2024-09-11T06:21:01.134591+0000","last_unstale":"2024-09-11T06:21:24.578977+0000","last_undegraded":"2024-09-11T06:21:24.578977+0000","last_fullsized":"2024-09-11T06:21:24.578977+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036423400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11250,"num_read_kb":40045,"num_write":1055,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":373,"num_bytes_recovered":38854008,"num_keys_recovered":188,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247693+0000","last_change":"2024-09-11T06:20:11.130922+0000","last_active":"2024-09-11T06:21:23.247693+0000","last_peered":"2024-09-11T06:21:23.247693+0000","last_clean":"2024-09-11T06:21:23.247693+0000","last_became_active":"2024-09-11T06:20:11.125223+0000","last_became_peered":"2024-09-11T06:20:11.125223+0000","last_unstale":"2024-09-11T06:21:23.247693+0000","last_undegraded":"2024-09-11T06:21:23.247693+0000","last_fullsized":"2024-09-11T06:21:23.247693+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:32.651537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"256'597","reported_seq":6404,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.712644+0000","last_change":"2024-09-11T06:21:07.211650+0000","last_active":"2024-09-11T06:21:23.712644+0000","last_peered":"2024-09-11T06:21:23.712644+0000","last_clean":"2024-09-11T06:21:23.712644+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:21:23.712644+0000","last_undegraded":"2024-09-11T06:21:23.712644+0000","last_fullsized":"2024-09-11T06:21:23.712644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097915299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5551,"num_read_kb":37240,"num_write":814,"num_write_kb":37266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.637461+0000","last_change":"2024-09-11T06:20:17.138900+0000","last_active":"2024-09-11T06:21:23.637461+0000","last_peered":"2024-09-11T06:21:23.637461+0000","last_clean":"2024-09-11T06:21:23.637461+0000","last_became_active":"2024-09-11T06:20:17.138587+0000","last_became_peered":"2024-09-11T06:20:17.138587+0000","last_unstale":"2024-09-11T06:21:23.637461+0000","last_undegraded":"2024-09-11T06:21:23.637461+0000","last_fullsized":"2024-09-11T06:21:23.637461+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:45.951420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"258'917","reported_seq":4060,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460865+0000","last_change":"2024-09-11T06:21:07.163704+0000","last_active":"2024-09-11T06:21:24.460865+0000","last_peered":"2024-09-11T06:21:24.460865+0000","last_clean":"2024-09-11T06:21:24.460865+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:21:24.460865+0000","last_undegraded":"2024-09-11T06:21:24.460865+0000","last_fullsized":"2024-09-11T06:21:24.460865+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:27.675499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033761000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4034,"num_read_kb":32429,"num_write":1192,"num_write_kb":32728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247705+0000","last_change":"2024-09-11T06:20:11.126087+0000","last_active":"2024-09-11T06:21:23.247705+0000","last_peered":"2024-09-11T06:21:23.247705+0000","last_clean":"2024-09-11T06:21:23.247705+0000","last_became_active":"2024-09-11T06:20:11.125761+0000","last_became_peered":"2024-09-11T06:20:11.125761+0000","last_unstale":"2024-09-11T06:21:23.247705+0000","last_undegraded":"2024-09-11T06:21:23.247705+0000","last_fullsized":"2024-09-11T06:21:23.247705+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:30.205706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"257'608","reported_seq":8311,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.862597+0000","last_change":"2024-09-11T06:21:31.862621+0000","last_active":"2024-09-11T06:21:31.862597+0000","last_peered":"2024-09-11T06:21:31.862597+0000","last_clean":"2024-09-11T06:21:31.862597+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:21:31.862597+0000","last_undegraded":"2024-09-11T06:21:31.862597+0000","last_fullsized":"2024-09-11T06:21:31.862597+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'608","last_scrub_stamp":"2024-09-11T06:21:31.862464+0000","last_deep_scrub":"257'608","last_deep_scrub_stamp":"2024-09-11T06:21:31.862464+0000","last_clean_scrub_stamp":"2024-09-11T06:21:31.862464+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:31.940749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074336300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8361,"num_read_kb":32287,"num_write":839,"num_write_kb":30197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":156,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248095+0000","last_change":"2024-09-11T06:20:11.132669+0000","last_active":"2024-09-11T06:21:23.248095+0000","last_peered":"2024-09-11T06:21:23.248095+0000","last_clean":"2024-09-11T06:21:23.248095+0000","last_became_active":"2024-09-11T06:20:11.128373+0000","last_became_peered":"2024-09-11T06:20:11.128373+0000","last_unstale":"2024-09-11T06:21:23.248095+0000","last_undegraded":"2024-09-11T06:21:23.248095+0000","last_fullsized":"2024-09-11T06:21:23.248095+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:58.608355+0000","last_clean_scrub_stamp":"2024-09-11T06:16:58.608355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:51:55.902272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":308,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.578723+0000","last_change":"2024-09-11T06:20:55.186236+0000","last_active":"2024-09-11T06:21:24.578723+0000","last_peered":"2024-09-11T06:21:24.578723+0000","last_clean":"2024-09-11T06:21:24.578723+0000","last_became_active":"2024-09-11T06:20:55.185644+0000","last_became_peered":"2024-09-11T06:20:55.185644+0000","last_unstale":"2024-09-11T06:21:24.578723+0000","last_undegraded":"2024-09-11T06:21:24.578723+0000","last_fullsized":"2024-09-11T06:21:24.578723+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:16:52.454955+0000","last_clean_scrub_stamp":"2024-09-11T06:16:52.454955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'617","reported_seq":9847,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.584037+0000","last_change":"2024-09-11T06:21:07.171488+0000","last_active":"2024-09-11T06:21:31.584037+0000","last_peered":"2024-09-11T06:21:31.584037+0000","last_clean":"2024-09-11T06:21:31.584037+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:21:31.584037+0000","last_undegraded":"2024-09-11T06:21:31.584037+0000","last_fullsized":"2024-09-11T06:21:31.584037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085945499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10608,"num_read_kb":43637,"num_write":702,"num_write_kb":29819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"257'381","reported_seq":8136,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247967+0000","last_change":"2024-09-11T06:21:07.233807+0000","last_active":"2024-09-11T06:21:23.247967+0000","last_peered":"2024-09-11T06:21:23.247967+0000","last_clean":"2024-09-11T06:21:23.247967+0000","last_became_active":"2024-09-11T06:20:15.126658+0000","last_became_peered":"2024-09-11T06:20:15.126658+0000","last_unstale":"2024-09-11T06:21:23.247967+0000","last_undegraded":"2024-09-11T06:21:23.247967+0000","last_fullsized":"2024-09-11T06:21:23.247967+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:36:46.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015157700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6873,"num_read_kb":49442,"num_write":558,"num_write_kb":30232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":34465896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"258'457","reported_seq":13065,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247789+0000","last_change":"2024-09-11T06:21:07.233521+0000","last_active":"2024-09-11T06:21:23.247789+0000","last_peered":"2024-09-11T06:21:23.247789+0000","last_clean":"2024-09-11T06:21:23.247789+0000","last_became_active":"2024-09-11T06:20:55.185551+0000","last_became_peered":"2024-09-11T06:20:55.185551+0000","last_unstale":"2024-09-11T06:21:23.247789+0000","last_undegraded":"2024-09-11T06:21:23.247789+0000","last_fullsized":"2024-09-11T06:21:23.247789+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:14.553047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013440069999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11885,"num_read_kb":48576,"num_write":550,"num_write_kb":27176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":312,"num_bytes_recovered":43677693,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"258'591","reported_seq":3606,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248929+0000","last_change":"2024-09-11T06:21:07.172022+0000","last_active":"2024-09-11T06:21:23.248929+0000","last_peered":"2024-09-11T06:21:23.248929+0000","last_clean":"2024-09-11T06:21:23.248929+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:21:23.248929+0000","last_undegraded":"2024-09-11T06:21:23.248929+0000","last_fullsized":"2024-09-11T06:21:23.248929+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011988350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3308,"num_read_kb":19950,"num_write":926,"num_write_kb":26888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"257'662","reported_seq":3676,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:29.972890+0000","last_change":"2024-09-11T06:21:29.972956+0000","last_active":"2024-09-11T06:21:29.972890+0000","last_peered":"2024-09-11T06:21:29.972890+0000","last_clean":"2024-09-11T06:21:29.972890+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:21:29.972890+0000","last_undegraded":"2024-09-11T06:21:29.972890+0000","last_fullsized":"2024-09-11T06:21:29.972890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'662","last_scrub_stamp":"2024-09-11T06:21:29.972800+0000","last_deep_scrub":"257'662","last_deep_scrub_stamp":"2024-09-11T06:21:29.972800+0000","last_clean_scrub_stamp":"2024-09-11T06:21:29.972800+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:55.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012361620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3701,"num_read_kb":23930,"num_write":870,"num_write_kb":19296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"256'543","reported_seq":8287,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247910+0000","last_change":"2024-09-11T06:21:07.233878+0000","last_active":"2024-09-11T06:21:23.247910+0000","last_peered":"2024-09-11T06:21:23.247910+0000","last_clean":"2024-09-11T06:21:23.247910+0000","last_became_active":"2024-09-11T06:20:55.187089+0000","last_became_peered":"2024-09-11T06:20:55.187089+0000","last_unstale":"2024-09-11T06:21:23.247910+0000","last_undegraded":"2024-09-11T06:21:23.247910+0000","last_fullsized":"2024-09-11T06:21:23.247910+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:55.409374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001394836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7264,"num_read_kb":39003,"num_write":875,"num_write_kb":32876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":46719635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"257'647","reported_seq":20366,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.248120+0000","last_change":"2024-09-11T06:21:07.165097+0000","last_active":"2024-09-11T06:21:23.248120+0000","last_peered":"2024-09-11T06:21:23.248120+0000","last_clean":"2024-09-11T06:21:23.248120+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:21:23.248120+0000","last_undegraded":"2024-09-11T06:21:23.248120+0000","last_fullsized":"2024-09-11T06:21:23.248120+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046631299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19910,"num_read_kb":76827,"num_write":792,"num_write_kb":30925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"258'605","reported_seq":5598,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.949895+0000","last_change":"2024-09-11T06:21:31.949944+0000","last_active":"2024-09-11T06:21:31.949895+0000","last_peered":"2024-09-11T06:21:31.949895+0000","last_clean":"2024-09-11T06:21:31.949895+0000","last_became_active":"2024-09-11T06:20:55.184580+0000","last_became_peered":"2024-09-11T06:20:55.184580+0000","last_unstale":"2024-09-11T06:21:31.949895+0000","last_undegraded":"2024-09-11T06:21:31.949895+0000","last_fullsized":"2024-09-11T06:21:31.949895+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'605","last_scrub_stamp":"2024-09-11T06:21:31.949807+0000","last_deep_scrub":"258'605","last_deep_scrub_stamp":"2024-09-11T06:21:31.949807+0000","last_clean_scrub_stamp":"2024-09-11T06:21:31.949807+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:48:49.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5156,"num_read_kb":38869,"num_write":703,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":26301332,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"258'540","reported_seq":8827,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.578633+0000","last_change":"2024-09-11T06:21:07.163986+0000","last_active":"2024-09-11T06:21:24.578633+0000","last_peered":"2024-09-11T06:21:24.578633+0000","last_clean":"2024-09-11T06:21:24.578633+0000","last_became_active":"2024-09-11T06:20:55.183516+0000","last_became_peered":"2024-09-11T06:20:55.183516+0000","last_unstale":"2024-09-11T06:21:24.578633+0000","last_undegraded":"2024-09-11T06:21:24.578633+0000","last_fullsized":"2024-09-11T06:21:24.578633+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058563300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10001,"num_read_kb":48815,"num_write":537,"num_write_kb":34952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":20336086,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"255'455","reported_seq":8137,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247616+0000","last_change":"2024-09-11T06:21:07.233623+0000","last_active":"2024-09-11T06:21:23.247616+0000","last_peered":"2024-09-11T06:21:23.247616+0000","last_clean":"2024-09-11T06:21:23.247616+0000","last_became_active":"2024-09-11T06:20:15.123510+0000","last_became_peered":"2024-09-11T06:20:15.123510+0000","last_unstale":"2024-09-11T06:21:23.247616+0000","last_undegraded":"2024-09-11T06:21:23.247616+0000","last_fullsized":"2024-09-11T06:21:23.247616+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:39.520602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014223840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7512,"num_read_kb":50605,"num_write":531,"num_write_kb":34454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":37321190,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"257'453","reported_seq":3526,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:24.460876+0000","last_change":"2024-09-11T06:21:07.163974+0000","last_active":"2024-09-11T06:21:24.460876+0000","last_peered":"2024-09-11T06:21:24.460876+0000","last_clean":"2024-09-11T06:21:24.460876+0000","last_became_active":"2024-09-11T06:20:14.140669+0000","last_became_peered":"2024-09-11T06:20:14.140669+0000","last_unstale":"2024-09-11T06:21:24.460876+0000","last_undegraded":"2024-09-11T06:21:24.460876+0000","last_fullsized":"2024-09-11T06:21:24.460876+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:29:21.007653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053784199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2621,"num_read_kb":28703,"num_write":734,"num_write_kb":23980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":19686402,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"256'420","reported_seq":4184,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:23.247810+0000","last_change":"2024-09-11T06:21:07.232571+0000","last_active":"2024-09-11T06:21:23.247810+0000","last_peered":"2024-09-11T06:21:23.247810+0000","last_clean":"2024-09-11T06:21:23.247810+0000","last_became_active":"2024-09-11T06:20:15.128338+0000","last_became_peered":"2024-09-11T06:20:15.128338+0000","last_unstale":"2024-09-11T06:21:23.247810+0000","last_undegraded":"2024-09-11T06:21:23.247810+0000","last_fullsized":"2024-09-11T06:21:23.247810+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:17:08.665121+0000","last_clean_scrub_stamp":"2024-09-11T06:17:08.665121+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:11.186605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067989400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3148,"num_read_kb":35740,"num_write":591,"num_write_kb":26613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":24813340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240770,"num_read_kb":1384666,"num_write":25519,"num_write_kb":933038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4648,"num_bytes_recovered":642863479,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25754,"internal_metadata":0},"log_size":19203,"ondisk_log_size":19203,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":28087,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56692,"kb_used_data":3300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315148,"statfs":{"total":96636764160,"available":96578711552,"internally_reserved":0,"allocated":3379200,"data_stored":2243516,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34428,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337412,"statfs":{"total":96636764160,"available":96601509888,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48324,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323516,"statfs":{"total":96636764160,"available":96587280384,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748513,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":3240,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991273,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":3284,"kb_used_omap":10,"kb_used_meta":32693,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":3362816,"data_stored":2243516,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":10357,"internal_metadata":33478539},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64952,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306888,"statfs":{"total":96636764160,"available":96570253312,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542203,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52484,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:21:33.166 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.166 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.166 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.166 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.166 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.166 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T06:16:58.608355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T06:16:58.608355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T06:16:58.608355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.167 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T06:16:58.608355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T06:16:58.608355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T06:16:58.608355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T06:16:58.608355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.168 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T06:16:58.608355+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T06:16:52.454955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=16, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.169 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.170 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T06:17:08.665121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=17, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=6, tm_min=21, tm_sec=28, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T06:21:33.170 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T06:21:53.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T06:21:53.464 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-11T06:21:53.465 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-11T06:21:53.476 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2024-09-11T06:21:52.469892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":240886,"num_read_kb":1384766,"num_write":25680,"num_write_kb":935456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4653,"num_bytes_recovered":643453866,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19327,"ondisk_log_size":19327,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":387312,"kb_used_data":26032,"kb_used_omap":37,"kb_used_meta":361114,"kb_avail":754587408,"statfs":{"total":773094113280,"available":772697505792,"internally_reserved":0,"allocated":26656768,"data_stored":14405844,"data_compressed":18378,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":38504,"internal_metadata":369781144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002654"},"pg_stats":[{"pgid":"3.1f","version":"258'361","reported_seq":3859,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:38.005243+0000","last_change":"2024-09-11T06:21:38.005270+0000","last_active":"2024-09-11T06:21:38.005243+0000","last_peered":"2024-09-11T06:21:38.005243+0000","last_clean":"2024-09-11T06:21:38.005243+0000","last_became_active":"2024-09-11T06:20:55.187911+0000","last_became_peered":"2024-09-11T06:20:55.187911+0000","last_unstale":"2024-09-11T06:21:38.005243+0000","last_undegraded":"2024-09-11T06:21:38.005243+0000","last_fullsized":"2024-09-11T06:21:38.005243+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'361","last_scrub_stamp":"2024-09-11T06:21:38.005145+0000","last_deep_scrub":"258'361","last_deep_scrub_stamp":"2024-09-11T06:21:38.005145+0000","last_clean_scrub_stamp":"2024-09-11T06:21:38.005145+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:10:45.088472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097570600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2483,"num_read_kb":28994,"num_write":517,"num_write_kb":29011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":14150952,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"257'547","reported_seq":6065,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:35.979825+0000","last_change":"2024-09-11T06:21:35.979869+0000","last_active":"2024-09-11T06:21:35.979825+0000","last_peered":"2024-09-11T06:21:35.979825+0000","last_clean":"2024-09-11T06:21:35.979825+0000","last_became_active":"2024-09-11T06:18:58.167950+0000","last_became_peered":"2024-09-11T06:18:58.167950+0000","last_unstale":"2024-09-11T06:21:35.979825+0000","last_undegraded":"2024-09-11T06:21:35.979825+0000","last_fullsized":"2024-09-11T06:21:35.979825+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'547","last_scrub_stamp":"2024-09-11T06:21:35.979707+0000","last_deep_scrub":"257'547","last_deep_scrub_stamp":"2024-09-11T06:21:35.979707+0000","last_clean_scrub_stamp":"2024-09-11T06:21:35.979707+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:08.150672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047299499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5799,"num_read_kb":23656,"num_write":730,"num_write_kb":18043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":52,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"257'852","reported_seq":10956,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:40.539159+0000","last_change":"2024-09-11T06:21:40.539189+0000","last_active":"2024-09-11T06:21:40.539159+0000","last_peered":"2024-09-11T06:21:40.539159+0000","last_clean":"2024-09-11T06:21:40.539159+0000","last_became_active":"2024-09-11T06:20:16.128387+0000","last_became_peered":"2024-09-11T06:20:16.128387+0000","last_unstale":"2024-09-11T06:21:40.539159+0000","last_undegraded":"2024-09-11T06:21:40.539159+0000","last_fullsized":"2024-09-11T06:21:40.539159+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'852","last_scrub_stamp":"2024-09-11T06:21:40.539047+0000","last_deep_scrub":"257'852","last_deep_scrub_stamp":"2024-09-11T06:21:40.539047+0000","last_clean_scrub_stamp":"2024-09-11T06:21:40.539047+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:17.475159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00085877900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11560,"num_read_kb":90044,"num_write":1319,"num_write_kb":37601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":52081629,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"258'662","reported_seq":11813,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.697685+0000","last_change":"2024-09-11T06:21:31.697729+0000","last_active":"2024-09-11T06:21:31.697685+0000","last_peered":"2024-09-11T06:21:31.697685+0000","last_clean":"2024-09-11T06:21:31.697685+0000","last_became_active":"2024-09-11T06:20:55.183472+0000","last_became_peered":"2024-09-11T06:20:55.183472+0000","last_unstale":"2024-09-11T06:21:31.697685+0000","last_undegraded":"2024-09-11T06:21:31.697685+0000","last_fullsized":"2024-09-11T06:21:31.697685+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'662","last_scrub_stamp":"2024-09-11T06:21:31.697592+0000","last_deep_scrub":"258'662","last_deep_scrub_stamp":"2024-09-11T06:21:31.697592+0000","last_clean_scrub_stamp":"2024-09-11T06:21:31.697592+0000","objects_scrubbed":1,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:20:30.605449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151093,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12097,"num_read_kb":53988,"num_write":979,"num_write_kb":19086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":10143007,"num_keys_recovered":276,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"256'515","reported_seq":6231,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:37.990126+0000","last_change":"2024-09-11T06:21:37.990151+0000","last_active":"2024-09-11T06:21:37.990126+0000","last_peered":"2024-09-11T06:21:37.990126+0000","last_clean":"2024-09-11T06:21:37.990126+0000","last_became_active":"2024-09-11T06:19:56.123422+0000","last_became_peered":"2024-09-11T06:19:56.123422+0000","last_unstale":"2024-09-11T06:21:37.990126+0000","last_undegraded":"2024-09-11T06:21:37.990126+0000","last_fullsized":"2024-09-11T06:21:37.990126+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'515","last_scrub_stamp":"2024-09-11T06:21:37.990026+0000","last_deep_scrub":"256'515","last_deep_scrub_stamp":"2024-09-11T06:21:37.990026+0000","last_clean_scrub_stamp":"2024-09-11T06:21:37.990026+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:20:03.083178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055166700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5130,"num_read_kb":36360,"num_write":718,"num_write_kb":27489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":38255414,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"274'661","reported_seq":10766,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:30.737719+0000","last_change":"2024-09-11T06:21:30.737742+0000","last_active":"2024-09-11T06:21:30.737719+0000","last_peered":"2024-09-11T06:21:30.737719+0000","last_clean":"2024-09-11T06:21:30.737719+0000","last_became_active":"2024-09-11T06:20:55.183560+0000","last_became_peered":"2024-09-11T06:20:55.183560+0000","last_unstale":"2024-09-11T06:21:30.737719+0000","last_undegraded":"2024-09-11T06:21:30.737719+0000","last_fullsized":"2024-09-11T06:21:30.737719+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"274'661","last_scrub_stamp":"2024-09-11T06:21:30.737655+0000","last_deep_scrub":"274'661","last_deep_scrub_stamp":"2024-09-11T06:21:30.737655+0000","last_clean_scrub_stamp":"2024-09-11T06:21:30.737655+0000","objects_scrubbed":1,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:45:58.686012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00078848799999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10645,"num_read_kb":66160,"num_write":849,"num_write_kb":27853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":22168966,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"257'554","reported_seq":6785,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:39.019187+0000","last_change":"2024-09-11T06:21:39.019214+0000","last_active":"2024-09-11T06:21:39.019187+0000","last_peered":"2024-09-11T06:21:39.019187+0000","last_clean":"2024-09-11T06:21:39.019187+0000","last_became_active":"2024-09-11T06:20:55.181728+0000","last_became_peered":"2024-09-11T06:20:55.181728+0000","last_unstale":"2024-09-11T06:21:39.019187+0000","last_undegraded":"2024-09-11T06:21:39.019187+0000","last_fullsized":"2024-09-11T06:21:39.019187+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'554","last_scrub_stamp":"2024-09-11T06:21:39.019048+0000","last_deep_scrub":"257'554","last_deep_scrub_stamp":"2024-09-11T06:21:39.019048+0000","last_clean_scrub_stamp":"2024-09-11T06:21:39.019048+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:16.788672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000465866,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6471,"num_read_kb":29586,"num_write":634,"num_write_kb":18722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":372,"num_bytes_recovered":14762773,"num_keys_recovered":100,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"257'1131","reported_seq":9753,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:33.987868+0000","last_change":"2024-09-11T06:21:33.987899+0000","last_active":"2024-09-11T06:21:33.987868+0000","last_peered":"2024-09-11T06:21:33.987868+0000","last_clean":"2024-09-11T06:21:33.987868+0000","last_became_active":"2024-09-11T06:17:09.686851+0000","last_became_peered":"2024-09-11T06:17:09.686851+0000","last_unstale":"2024-09-11T06:21:33.987868+0000","last_undegraded":"2024-09-11T06:21:33.987868+0000","last_fullsized":"2024-09-11T06:21:33.987868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'1131","last_scrub_stamp":"2024-09-11T06:21:33.987764+0000","last_deep_scrub":"257'1131","last_deep_scrub_stamp":"2024-09-11T06:21:33.987764+0000","last_clean_scrub_stamp":"2024-09-11T06:21:33.987764+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:42.077982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010472719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13075,"num_read_kb":38666,"num_write":1619,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"255'295","reported_seq":4579,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:36.990019+0000","last_change":"2024-09-11T06:21:36.990081+0000","last_active":"2024-09-11T06:21:36.990019+0000","last_peered":"2024-09-11T06:21:36.990019+0000","last_clean":"2024-09-11T06:21:36.990019+0000","last_became_active":"2024-09-11T06:20:14.140869+0000","last_became_peered":"2024-09-11T06:20:14.140869+0000","last_unstale":"2024-09-11T06:21:36.990019+0000","last_undegraded":"2024-09-11T06:21:36.990019+0000","last_fullsized":"2024-09-11T06:21:36.990019+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'295","last_scrub_stamp":"2024-09-11T06:21:36.989905+0000","last_deep_scrub":"255'295","last_deep_scrub_stamp":"2024-09-11T06:21:36.989905+0000","last_clean_scrub_stamp":"2024-09-11T06:21:36.989905+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:25:12.084429+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001324343,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2899,"num_read_kb":36950,"num_write":396,"num_write_kb":23221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":21224115,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"257'612","reported_seq":8621,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:33.503927+0000","last_change":"2024-09-11T06:21:33.503968+0000","last_active":"2024-09-11T06:21:33.503927+0000","last_peered":"2024-09-11T06:21:33.503927+0000","last_clean":"2024-09-11T06:21:33.503927+0000","last_became_active":"2024-09-11T06:20:15.124862+0000","last_became_peered":"2024-09-11T06:20:15.124862+0000","last_unstale":"2024-09-11T06:21:33.503927+0000","last_undegraded":"2024-09-11T06:21:33.503927+0000","last_fullsized":"2024-09-11T06:21:33.503927+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'612","last_scrub_stamp":"2024-09-11T06:21:33.503804+0000","last_deep_scrub":"257'612","last_deep_scrub_stamp":"2024-09-11T06:21:33.503804+0000","last_clean_scrub_stamp":"2024-09-11T06:21:33.503804+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:29.307194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062779600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9055,"num_read_kb":39121,"num_write":753,"num_write_kb":29738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":17793964,"num_keys_recovered":77,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"257'496","reported_seq":4811,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:30.936251+0000","last_change":"2024-09-11T06:21:30.936290+0000","last_active":"2024-09-11T06:21:30.936251+0000","last_peered":"2024-09-11T06:21:30.936251+0000","last_clean":"2024-09-11T06:21:30.936251+0000","last_became_active":"2024-09-11T06:20:01.126371+0000","last_became_peered":"2024-09-11T06:20:01.126371+0000","last_unstale":"2024-09-11T06:21:30.936251+0000","last_undegraded":"2024-09-11T06:21:30.936251+0000","last_fullsized":"2024-09-11T06:21:30.936251+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'496","last_scrub_stamp":"2024-09-11T06:21:30.936169+0000","last_deep_scrub":"257'496","last_deep_scrub_stamp":"2024-09-11T06:21:30.936169+0000","last_clean_scrub_stamp":"2024-09-11T06:21:30.936169+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:03:12.736985+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001549929,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3619,"num_read_kb":43290,"num_write":684,"num_write_kb":36893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":244,"num_bytes_recovered":40168837,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"257'400","reported_seq":12003,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:36.593122+0000","last_change":"2024-09-11T06:21:36.593148+0000","last_active":"2024-09-11T06:21:36.593122+0000","last_peered":"2024-09-11T06:21:36.593122+0000","last_clean":"2024-09-11T06:21:36.593122+0000","last_became_active":"2024-09-11T06:20:15.123718+0000","last_became_peered":"2024-09-11T06:20:15.123718+0000","last_unstale":"2024-09-11T06:21:36.593122+0000","last_undegraded":"2024-09-11T06:21:36.593122+0000","last_fullsized":"2024-09-11T06:21:36.593122+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'400","last_scrub_stamp":"2024-09-11T06:21:36.593023+0000","last_deep_scrub":"257'400","last_deep_scrub_stamp":"2024-09-11T06:21:36.593023+0000","last_clean_scrub_stamp":"2024-09-11T06:21:36.593023+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:23:58.566224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054683100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9669,"num_read_kb":71024,"num_write":411,"num_write_kb":42855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":83153006,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:32.615153+0000","last_change":"2024-09-11T06:21:32.615173+0000","last_active":"2024-09-11T06:21:32.615153+0000","last_peered":"2024-09-11T06:21:32.615153+0000","last_clean":"2024-09-11T06:21:32.615153+0000","last_became_active":"2024-09-11T06:20:11.125589+0000","last_became_peered":"2024-09-11T06:20:11.125589+0000","last_unstale":"2024-09-11T06:21:32.615153+0000","last_undegraded":"2024-09-11T06:21:32.615153+0000","last_fullsized":"2024-09-11T06:21:32.615153+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:21:32.615077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:21:32.615077+0000","last_clean_scrub_stamp":"2024-09-11T06:21:32.615077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:22:59.196693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"258'374","reported_seq":5158,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:33.885100+0000","last_change":"2024-09-11T06:21:33.885151+0000","last_active":"2024-09-11T06:21:33.885100+0000","last_peered":"2024-09-11T06:21:33.885100+0000","last_clean":"2024-09-11T06:21:33.885100+0000","last_became_active":"2024-09-11T06:17:09.681695+0000","last_became_peered":"2024-09-11T06:17:09.681695+0000","last_unstale":"2024-09-11T06:21:33.885100+0000","last_undegraded":"2024-09-11T06:21:33.885100+0000","last_fullsized":"2024-09-11T06:21:33.885100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'374","last_scrub_stamp":"2024-09-11T06:21:33.884991+0000","last_deep_scrub":"258'374","last_deep_scrub_stamp":"2024-09-11T06:21:33.884991+0000","last_clean_scrub_stamp":"2024-09-11T06:21:33.884991+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:49.536148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095120700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3952,"num_read_kb":49104,"num_write":471,"num_write_kb":30546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":544,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:37.010137+0000","last_change":"2024-09-11T06:21:37.010197+0000","last_active":"2024-09-11T06:21:37.010137+0000","last_peered":"2024-09-11T06:21:37.010137+0000","last_clean":"2024-09-11T06:21:37.010137+0000","last_became_active":"2024-09-11T06:19:53.215160+0000","last_became_peered":"2024-09-11T06:19:53.215160+0000","last_unstale":"2024-09-11T06:21:37.010137+0000","last_undegraded":"2024-09-11T06:21:37.010137+0000","last_fullsized":"2024-09-11T06:21:37.010137+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:21:37.010036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:21:37.010036+0000","last_clean_scrub_stamp":"2024-09-11T06:21:37.010036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:02.249527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000386382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"256'364","reported_seq":3909,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:32.887413+0000","last_change":"2024-09-11T06:21:32.887458+0000","last_active":"2024-09-11T06:21:32.887413+0000","last_peered":"2024-09-11T06:21:32.887413+0000","last_clean":"2024-09-11T06:21:32.887413+0000","last_became_active":"2024-09-11T06:17:09.681429+0000","last_became_peered":"2024-09-11T06:17:09.681429+0000","last_unstale":"2024-09-11T06:21:32.887413+0000","last_undegraded":"2024-09-11T06:21:32.887413+0000","last_fullsized":"2024-09-11T06:21:32.887413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'364","last_scrub_stamp":"2024-09-11T06:21:32.887317+0000","last_deep_scrub":"256'364","last_deep_scrub_stamp":"2024-09-11T06:21:32.887317+0000","last_clean_scrub_stamp":"2024-09-11T06:21:32.887317+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:48:36.294496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012844779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3327,"num_read_kb":33114,"num_write":460,"num_write_kb":24509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:33.599008+0000","last_change":"2024-09-11T06:21:33.599048+0000","last_active":"2024-09-11T06:21:33.599008+0000","last_peered":"2024-09-11T06:21:33.599008+0000","last_clean":"2024-09-11T06:21:33.599008+0000","last_became_active":"2024-09-11T06:20:11.126287+0000","last_became_peered":"2024-09-11T06:20:11.126287+0000","last_unstale":"2024-09-11T06:21:33.599008+0000","last_undegraded":"2024-09-11T06:21:33.599008+0000","last_fullsized":"2024-09-11T06:21:33.599008+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:21:33.598925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:21:33.598925+0000","last_clean_scrub_stamp":"2024-09-11T06:21:33.598925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:04.554218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"257'943","reported_seq":6738,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:32.447050+0000","last_change":"2024-09-11T06:21:32.447077+0000","last_active":"2024-09-11T06:21:32.447050+0000","last_peered":"2024-09-11T06:21:32.447050+0000","last_clean":"2024-09-11T06:21:32.447050+0000","last_became_active":"2024-09-11T06:17:09.686952+0000","last_became_peered":"2024-09-11T06:17:09.686952+0000","last_unstale":"2024-09-11T06:21:32.447050+0000","last_undegraded":"2024-09-11T06:21:32.447050+0000","last_fullsized":"2024-09-11T06:21:32.447050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'943","last_scrub_stamp":"2024-09-11T06:21:32.446952+0000","last_deep_scrub":"257'943","last_deep_scrub_stamp":"2024-09-11T06:21:32.446952+0000","last_clean_scrub_stamp":"2024-09-11T06:21:32.446952+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:28.790518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039519000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8223,"num_read_kb":61062,"num_write":1340,"num_write_kb":35882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:32.956483+0000","last_change":"2024-09-11T06:21:32.956521+0000","last_active":"2024-09-11T06:21:32.956483+0000","last_peered":"2024-09-11T06:21:32.956483+0000","last_clean":"2024-09-11T06:21:32.956483+0000","last_became_active":"2024-09-11T06:16:59.986898+0000","last_became_peered":"2024-09-11T06:16:59.986898+0000","last_unstale":"2024-09-11T06:21:32.956483+0000","last_undegraded":"2024-09-11T06:21:32.956483+0000","last_fullsized":"2024-09-11T06:21:32.956483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:21:32.956359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:21:32.956359+0000","last_clean_scrub_stamp":"2024-09-11T06:21:32.956359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:32.428022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000364788,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"258'974","reported_seq":9914,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.502788+0000","last_change":"2024-09-11T06:21:31.502833+0000","last_active":"2024-09-11T06:21:31.502788+0000","last_peered":"2024-09-11T06:21:31.502788+0000","last_clean":"2024-09-11T06:21:31.502788+0000","last_became_active":"2024-09-11T06:19:01.110057+0000","last_became_peered":"2024-09-11T06:19:01.110057+0000","last_unstale":"2024-09-11T06:21:31.502788+0000","last_undegraded":"2024-09-11T06:21:31.502788+0000","last_fullsized":"2024-09-11T06:21:31.502788+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'974","last_scrub_stamp":"2024-09-11T06:21:31.502650+0000","last_deep_scrub":"258'974","last_deep_scrub_stamp":"2024-09-11T06:21:31.502650+0000","last_clean_scrub_stamp":"2024-09-11T06:21:31.502650+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:46.072455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00048838699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11583,"num_read_kb":37449,"num_write":1370,"num_write_kb":24166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":131124,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"258'969","reported_seq":10322,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:32.937344+0000","last_change":"2024-09-11T06:21:32.937386+0000","last_active":"2024-09-11T06:21:32.937344+0000","last_peered":"2024-09-11T06:21:32.937344+0000","last_clean":"2024-09-11T06:21:32.937344+0000","last_became_active":"2024-09-11T06:21:01.134591+0000","last_became_peered":"2024-09-11T06:21:01.134591+0000","last_unstale":"2024-09-11T06:21:32.937344+0000","last_undegraded":"2024-09-11T06:21:32.937344+0000","last_fullsized":"2024-09-11T06:21:32.937344+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'969","last_scrub_stamp":"2024-09-11T06:21:32.937227+0000","last_deep_scrub":"258'969","last_deep_scrub_stamp":"2024-09-11T06:21:32.937227+0000","last_clean_scrub_stamp":"2024-09-11T06:21:32.937227+0000","objects_scrubbed":1,"log_size":969,"log_dups_size":0,"ondisk_log_size":969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:11.094562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00036423400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11250,"num_read_kb":40045,"num_write":1055,"num_write_kb":33910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":373,"num_bytes_recovered":38854008,"num_keys_recovered":188,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"274'3","reported_seq":166,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:34.650793+0000","last_change":"2024-09-11T06:21:34.650820+0000","last_active":"2024-09-11T06:21:34.650793+0000","last_peered":"2024-09-11T06:21:34.650793+0000","last_clean":"2024-09-11T06:21:34.650793+0000","last_became_active":"2024-09-11T06:20:11.125223+0000","last_became_peered":"2024-09-11T06:20:11.125223+0000","last_unstale":"2024-09-11T06:21:34.650793+0000","last_undegraded":"2024-09-11T06:21:34.650793+0000","last_fullsized":"2024-09-11T06:21:34.650793+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"274'3","last_scrub_stamp":"2024-09-11T06:21:34.650707+0000","last_deep_scrub":"274'3","last_deep_scrub_stamp":"2024-09-11T06:21:34.650707+0000","last_clean_scrub_stamp":"2024-09-11T06:21:34.650707+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:25:17.848301+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00062863600000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"256'597","reported_seq":6412,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:34.967242+0000","last_change":"2024-09-11T06:21:34.967269+0000","last_active":"2024-09-11T06:21:34.967242+0000","last_peered":"2024-09-11T06:21:34.967242+0000","last_clean":"2024-09-11T06:21:34.967242+0000","last_became_active":"2024-09-11T06:17:09.687371+0000","last_became_peered":"2024-09-11T06:17:09.687371+0000","last_unstale":"2024-09-11T06:21:34.967242+0000","last_undegraded":"2024-09-11T06:21:34.967242+0000","last_fullsized":"2024-09-11T06:21:34.967242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'597","last_scrub_stamp":"2024-09-11T06:21:34.967150+0000","last_deep_scrub":"256'597","last_deep_scrub_stamp":"2024-09-11T06:21:34.967150+0000","last_clean_scrub_stamp":"2024-09-11T06:21:34.967150+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:56.484692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097915299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5551,"num_read_kb":37240,"num_write":814,"num_write_kb":37266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":271,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:33.083133+0000","last_change":"2024-09-11T06:21:33.083157+0000","last_active":"2024-09-11T06:21:33.083133+0000","last_peered":"2024-09-11T06:21:33.083133+0000","last_clean":"2024-09-11T06:21:33.083133+0000","last_became_active":"2024-09-11T06:20:17.138587+0000","last_became_peered":"2024-09-11T06:20:17.138587+0000","last_unstale":"2024-09-11T06:21:33.083133+0000","last_undegraded":"2024-09-11T06:21:33.083133+0000","last_fullsized":"2024-09-11T06:21:33.083133+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:21:33.083039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:21:33.083039+0000","last_clean_scrub_stamp":"2024-09-11T06:21:33.083039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:54.217868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"258'917","reported_seq":4069,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:33.404854+0000","last_change":"2024-09-11T06:21:33.404899+0000","last_active":"2024-09-11T06:21:33.404854+0000","last_peered":"2024-09-11T06:21:33.404854+0000","last_clean":"2024-09-11T06:21:33.404854+0000","last_became_active":"2024-09-11T06:19:01.110325+0000","last_became_peered":"2024-09-11T06:19:01.110325+0000","last_unstale":"2024-09-11T06:21:33.404854+0000","last_undegraded":"2024-09-11T06:21:33.404854+0000","last_fullsized":"2024-09-11T06:21:33.404854+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'917","last_scrub_stamp":"2024-09-11T06:21:33.404719+0000","last_deep_scrub":"258'917","last_deep_scrub_stamp":"2024-09-11T06:21:33.404719+0000","last_clean_scrub_stamp":"2024-09-11T06:21:33.404719+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:38.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033761000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4034,"num_read_kb":32429,"num_write":1192,"num_write_kb":32728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1615962,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.578083+0000","last_change":"2024-09-11T06:21:31.578104+0000","last_active":"2024-09-11T06:21:31.578083+0000","last_peered":"2024-09-11T06:21:31.578083+0000","last_clean":"2024-09-11T06:21:31.578083+0000","last_became_active":"2024-09-11T06:20:11.125761+0000","last_became_peered":"2024-09-11T06:20:11.125761+0000","last_unstale":"2024-09-11T06:21:31.578083+0000","last_undegraded":"2024-09-11T06:21:31.578083+0000","last_fullsized":"2024-09-11T06:21:31.578083+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T06:21:31.578004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T06:21:31.578004+0000","last_clean_scrub_stamp":"2024-09-11T06:21:31.578004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:38:39.949553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"257'608","reported_seq":8311,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.862597+0000","last_change":"2024-09-11T06:21:31.862621+0000","last_active":"2024-09-11T06:21:31.862597+0000","last_peered":"2024-09-11T06:21:31.862597+0000","last_clean":"2024-09-11T06:21:31.862597+0000","last_became_active":"2024-09-11T06:18:58.166382+0000","last_became_peered":"2024-09-11T06:18:58.166382+0000","last_unstale":"2024-09-11T06:21:31.862597+0000","last_undegraded":"2024-09-11T06:21:31.862597+0000","last_fullsized":"2024-09-11T06:21:31.862597+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'608","last_scrub_stamp":"2024-09-11T06:21:31.862464+0000","last_deep_scrub":"257'608","last_deep_scrub_stamp":"2024-09-11T06:21:31.862464+0000","last_clean_scrub_stamp":"2024-09-11T06:21:31.862464+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:31.940749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074336300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8361,"num_read_kb":32287,"num_write":839,"num_write_kb":30197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"274'2","reported_seq":166,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:35.630753+0000","last_change":"2024-09-11T06:21:35.630784+0000","last_active":"2024-09-11T06:21:35.630753+0000","last_peered":"2024-09-11T06:21:35.630753+0000","last_clean":"2024-09-11T06:21:35.630753+0000","last_became_active":"2024-09-11T06:20:11.128373+0000","last_became_peered":"2024-09-11T06:20:11.128373+0000","last_unstale":"2024-09-11T06:21:35.630753+0000","last_undegraded":"2024-09-11T06:21:35.630753+0000","last_fullsized":"2024-09-11T06:21:35.630753+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"274'2","last_scrub_stamp":"2024-09-11T06:21:35.630660+0000","last_deep_scrub":"274'2","last_deep_scrub_stamp":"2024-09-11T06:21:35.630660+0000","last_clean_scrub_stamp":"2024-09-11T06:21:35.630660+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:09:40.548997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"274'119","reported_seq":318,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:32.727737+0000","last_change":"2024-09-11T06:21:32.727788+0000","last_active":"2024-09-11T06:21:32.727737+0000","last_peered":"2024-09-11T06:21:32.727737+0000","last_clean":"2024-09-11T06:21:32.727737+0000","last_became_active":"2024-09-11T06:20:55.185644+0000","last_became_peered":"2024-09-11T06:20:55.185644+0000","last_unstale":"2024-09-11T06:21:32.727737+0000","last_undegraded":"2024-09-11T06:21:32.727737+0000","last_fullsized":"2024-09-11T06:21:32.727737+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"274'119","last_scrub_stamp":"2024-09-11T06:21:32.727654+0000","last_deep_scrub":"274'119","last_deep_scrub_stamp":"2024-09-11T06:21:32.727654+0000","last_clean_scrub_stamp":"2024-09-11T06:21:32.727654+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:00.319098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"256'617","reported_seq":9855,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:34.932504+0000","last_change":"2024-09-11T06:21:34.932533+0000","last_active":"2024-09-11T06:21:34.932504+0000","last_peered":"2024-09-11T06:21:34.932504+0000","last_clean":"2024-09-11T06:21:34.932504+0000","last_became_active":"2024-09-11T06:17:09.682082+0000","last_became_peered":"2024-09-11T06:17:09.682082+0000","last_unstale":"2024-09-11T06:21:34.932504+0000","last_undegraded":"2024-09-11T06:21:34.932504+0000","last_fullsized":"2024-09-11T06:21:34.932504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'617","last_scrub_stamp":"2024-09-11T06:21:34.932410+0000","last_deep_scrub":"256'617","last_deep_scrub_stamp":"2024-09-11T06:21:34.932410+0000","last_clean_scrub_stamp":"2024-09-11T06:21:34.932410+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:31:07.274322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085945499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10608,"num_read_kb":43637,"num_write":702,"num_write_kb":29819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"257'381","reported_seq":8145,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:38.535191+0000","last_change":"2024-09-11T06:21:38.535221+0000","last_active":"2024-09-11T06:21:38.535191+0000","last_peered":"2024-09-11T06:21:38.535191+0000","last_clean":"2024-09-11T06:21:38.535191+0000","last_became_active":"2024-09-11T06:20:15.126658+0000","last_became_peered":"2024-09-11T06:20:15.126658+0000","last_unstale":"2024-09-11T06:21:38.535191+0000","last_undegraded":"2024-09-11T06:21:38.535191+0000","last_fullsized":"2024-09-11T06:21:38.535191+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'381","last_scrub_stamp":"2024-09-11T06:21:38.535091+0000","last_deep_scrub":"257'381","last_deep_scrub_stamp":"2024-09-11T06:21:38.535091+0000","last_clean_scrub_stamp":"2024-09-11T06:21:38.535091+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:42:04.225200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0015157700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6873,"num_read_kb":49442,"num_write":558,"num_write_kb":30232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":34465896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"258'457","reported_seq":13074,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:41.559054+0000","last_change":"2024-09-11T06:21:41.559083+0000","last_active":"2024-09-11T06:21:41.559054+0000","last_peered":"2024-09-11T06:21:41.559054+0000","last_clean":"2024-09-11T06:21:41.559054+0000","last_became_active":"2024-09-11T06:20:55.185551+0000","last_became_peered":"2024-09-11T06:20:55.185551+0000","last_unstale":"2024-09-11T06:21:41.559054+0000","last_undegraded":"2024-09-11T06:21:41.559054+0000","last_fullsized":"2024-09-11T06:21:41.559054+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'457","last_scrub_stamp":"2024-09-11T06:21:41.558946+0000","last_deep_scrub":"258'457","last_deep_scrub_stamp":"2024-09-11T06:21:41.558946+0000","last_clean_scrub_stamp":"2024-09-11T06:21:41.558946+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:06.301474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013440069999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11885,"num_read_kb":48576,"num_write":550,"num_write_kb":27176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":312,"num_bytes_recovered":43677693,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"258'591","reported_seq":3615,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:35.964556+0000","last_change":"2024-09-11T06:21:35.964556+0000","last_active":"2024-09-11T06:21:35.964556+0000","last_peered":"2024-09-11T06:21:35.964556+0000","last_clean":"2024-09-11T06:21:35.964556+0000","last_became_active":"2024-09-11T06:19:38.150407+0000","last_became_peered":"2024-09-11T06:19:38.150407+0000","last_unstale":"2024-09-11T06:21:35.964556+0000","last_undegraded":"2024-09-11T06:21:35.964556+0000","last_fullsized":"2024-09-11T06:21:35.964556+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'591","last_scrub_stamp":"2024-09-11T06:21:35.964428+0000","last_deep_scrub":"258'591","last_deep_scrub_stamp":"2024-09-11T06:21:35.964428+0000","last_clean_scrub_stamp":"2024-09-11T06:21:35.964428+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:03:53.193807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011988350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3308,"num_read_kb":19950,"num_write":926,"num_write_kb":26888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":3888212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"257'662","reported_seq":3677,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:29.972956+0000","last_change":"2024-09-11T06:21:29.972956+0000","last_active":"2024-09-11T06:21:29.972956+0000","last_peered":"2024-09-11T06:21:29.972956+0000","last_clean":"2024-09-11T06:21:29.972956+0000","last_became_active":"2024-09-11T06:17:09.681633+0000","last_became_peered":"2024-09-11T06:17:09.681633+0000","last_unstale":"2024-09-11T06:21:29.972956+0000","last_undegraded":"2024-09-11T06:21:29.972956+0000","last_fullsized":"2024-09-11T06:21:29.972956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'662","last_scrub_stamp":"2024-09-11T06:21:29.972800+0000","last_deep_scrub":"257'662","last_deep_scrub_stamp":"2024-09-11T06:21:29.972800+0000","last_clean_scrub_stamp":"2024-09-11T06:21:29.972800+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:55.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012361620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3701,"num_read_kb":23930,"num_write":870,"num_write_kb":19296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"256'543","reported_seq":8296,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:42.528943+0000","last_change":"2024-09-11T06:21:42.528971+0000","last_active":"2024-09-11T06:21:42.528943+0000","last_peered":"2024-09-11T06:21:42.528943+0000","last_clean":"2024-09-11T06:21:42.528943+0000","last_became_active":"2024-09-11T06:20:55.187089+0000","last_became_peered":"2024-09-11T06:20:55.187089+0000","last_unstale":"2024-09-11T06:21:42.528943+0000","last_undegraded":"2024-09-11T06:21:42.528943+0000","last_fullsized":"2024-09-11T06:21:42.528943+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'543","last_scrub_stamp":"2024-09-11T06:21:42.528822+0000","last_deep_scrub":"256'543","last_deep_scrub_stamp":"2024-09-11T06:21:42.528822+0000","last_clean_scrub_stamp":"2024-09-11T06:21:42.528822+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:10.315979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001394836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7264,"num_read_kb":39003,"num_write":875,"num_write_kb":32876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":416,"num_bytes_recovered":46719635,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"257'647","reported_seq":20374,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:32.466793+0000","last_change":"2024-09-11T06:21:32.466830+0000","last_active":"2024-09-11T06:21:32.466793+0000","last_peered":"2024-09-11T06:21:32.466793+0000","last_clean":"2024-09-11T06:21:32.466793+0000","last_became_active":"2024-09-11T06:19:56.122427+0000","last_became_peered":"2024-09-11T06:19:56.122427+0000","last_unstale":"2024-09-11T06:21:32.466793+0000","last_undegraded":"2024-09-11T06:21:32.466793+0000","last_fullsized":"2024-09-11T06:21:32.466793+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'647","last_scrub_stamp":"2024-09-11T06:21:32.466680+0000","last_deep_scrub":"257'647","last_deep_scrub_stamp":"2024-09-11T06:21:32.466680+0000","last_clean_scrub_stamp":"2024-09-11T06:21:32.466680+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:22:01.215857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046631299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19910,"num_read_kb":76827,"num_write":792,"num_write_kb":30925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":31018812,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"258'605","reported_seq":5598,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:31.949895+0000","last_change":"2024-09-11T06:21:31.949944+0000","last_active":"2024-09-11T06:21:31.949895+0000","last_peered":"2024-09-11T06:21:31.949895+0000","last_clean":"2024-09-11T06:21:31.949895+0000","last_became_active":"2024-09-11T06:20:55.184580+0000","last_became_peered":"2024-09-11T06:20:55.184580+0000","last_unstale":"2024-09-11T06:21:31.949895+0000","last_undegraded":"2024-09-11T06:21:31.949895+0000","last_fullsized":"2024-09-11T06:21:31.949895+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'605","last_scrub_stamp":"2024-09-11T06:21:31.949807+0000","last_deep_scrub":"258'605","last_deep_scrub_stamp":"2024-09-11T06:21:31.949807+0000","last_clean_scrub_stamp":"2024-09-11T06:21:31.949807+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:48:49.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001209246,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5156,"num_read_kb":38869,"num_write":703,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":26301332,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"258'540","reported_seq":8835,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:33.729377+0000","last_change":"2024-09-11T06:21:33.729399+0000","last_active":"2024-09-11T06:21:33.729377+0000","last_peered":"2024-09-11T06:21:33.729377+0000","last_clean":"2024-09-11T06:21:33.729377+0000","last_became_active":"2024-09-11T06:20:55.183516+0000","last_became_peered":"2024-09-11T06:20:55.183516+0000","last_unstale":"2024-09-11T06:21:33.729377+0000","last_undegraded":"2024-09-11T06:21:33.729377+0000","last_fullsized":"2024-09-11T06:21:33.729377+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'540","last_scrub_stamp":"2024-09-11T06:21:33.729300+0000","last_deep_scrub":"258'540","last_deep_scrub_stamp":"2024-09-11T06:21:33.729300+0000","last_clean_scrub_stamp":"2024-09-11T06:21:33.729300+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:14:16.399259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058563300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10001,"num_read_kb":48815,"num_write":537,"num_write_kb":34952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":20336086,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"255'455","reported_seq":8146,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:37.566421+0000","last_change":"2024-09-11T06:21:37.566465+0000","last_active":"2024-09-11T06:21:37.566421+0000","last_peered":"2024-09-11T06:21:37.566421+0000","last_clean":"2024-09-11T06:21:37.566421+0000","last_became_active":"2024-09-11T06:20:15.123510+0000","last_became_peered":"2024-09-11T06:20:15.123510+0000","last_unstale":"2024-09-11T06:21:37.566421+0000","last_undegraded":"2024-09-11T06:21:37.566421+0000","last_fullsized":"2024-09-11T06:21:37.566421+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'455","last_scrub_stamp":"2024-09-11T06:21:37.566301+0000","last_deep_scrub":"255'455","last_deep_scrub_stamp":"2024-09-11T06:21:37.566301+0000","last_clean_scrub_stamp":"2024-09-11T06:21:37.566301+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:05.934343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0014223840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7512,"num_read_kb":50605,"num_write":531,"num_write_kb":34454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":37321190,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"257'453","reported_seq":3536,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:34.391706+0000","last_change":"2024-09-11T06:21:34.391706+0000","last_active":"2024-09-11T06:21:34.391706+0000","last_peered":"2024-09-11T06:21:34.391706+0000","last_clean":"2024-09-11T06:21:34.391706+0000","last_became_active":"2024-09-11T06:20:14.140669+0000","last_became_peered":"2024-09-11T06:20:14.140669+0000","last_unstale":"2024-09-11T06:21:34.391706+0000","last_undegraded":"2024-09-11T06:21:34.391706+0000","last_fullsized":"2024-09-11T06:21:34.391706+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'453","last_scrub_stamp":"2024-09-11T06:21:34.391570+0000","last_deep_scrub":"257'453","last_deep_scrub_stamp":"2024-09-11T06:21:34.391570+0000","last_clean_scrub_stamp":"2024-09-11T06:21:34.391570+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:32:01.745733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053784199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2621,"num_read_kb":28703,"num_write":734,"num_write_kb":23980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":19686402,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"256'420","reported_seq":4193,"reported_epoch":274,"state":"active+clean","last_fresh":"2024-09-11T06:21:39.521332+0000","last_change":"2024-09-11T06:21:39.521379+0000","last_active":"2024-09-11T06:21:39.521332+0000","last_peered":"2024-09-11T06:21:39.521332+0000","last_clean":"2024-09-11T06:21:39.521332+0000","last_became_active":"2024-09-11T06:20:15.128338+0000","last_became_peered":"2024-09-11T06:20:15.128338+0000","last_unstale":"2024-09-11T06:21:39.521332+0000","last_undegraded":"2024-09-11T06:21:39.521332+0000","last_fullsized":"2024-09-11T06:21:39.521332+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'420","last_scrub_stamp":"2024-09-11T06:21:39.521198+0000","last_deep_scrub":"256'420","last_deep_scrub_stamp":"2024-09-11T06:21:39.521198+0000","last_clean_scrub_stamp":"2024-09-11T06:21:39.521198+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:21:42.250787+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00067989400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3148,"num_read_kb":35740,"num_write":591,"num_write_kb":26613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":24813340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240770,"num_read_kb":1384666,"num_write":25519,"num_write_kb":933038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4648,"num_bytes_recovered":642863479,"num_keys_recovered":916,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25754,"internal_metadata":0},"log_size":19203,"ondisk_log_size":19203,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":28087,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56692,"kb_used_data":3300,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315148,"statfs":{"total":96636764160,"available":96578711552,"internally_reserved":0,"allocated":3379200,"data_stored":2243516,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34424,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337416,"statfs":{"total":96636764160,"available":96601513984,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48316,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323524,"statfs":{"total":96636764160,"available":96587288576,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":130,"seq":558345748517,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":3240,"kb_used_omap":18,"kb_used_meta":28973,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18586,"internal_metadata":29669222},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":92,"seq":395136991277,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36004,"kb_used_data":3284,"kb_used_omap":10,"kb_used_meta":32693,"kb_avail":94335836,"statfs":{"total":96636764160,"available":96599896064,"internally_reserved":0,"allocated":3362816,"data_stored":2243516,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":10357,"internal_metadata":33478539},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48312,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323528,"statfs":{"total":96636764160,"available":96587292672,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542207,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78844,"kb_used_data":3244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292996,"statfs":{"total":96636764160,"available":96556027904,"internally_reserved":0,"allocated":3321856,"data_stored":1653148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52472,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319368,"statfs":{"total":96636764160,"available":96583032832,"internally_reserved":0,"allocated":3317760,"data_stored":1653129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":9709,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8669,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8763,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16991,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T06:21:53.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T06:21:53.771 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T06:21:53.771 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T06:21:53.771 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T06:21:53.771 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:53.820 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T06:21:53.820 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T06:21:53.820 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:53.863 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T06:21:53.864 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T06:21:53.864 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:53.903 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T06:21:53.904 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T06:21:53.904 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:53.976 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T06:21:53.977 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T06:21:53.977 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.018 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T06:21:54.018 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T06:21:54.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.057 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T06:21:54.058 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T06:21:54.058 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.132 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T06:21:54.132 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T06:21:54.132 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.211 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T06:21:54.211 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T06:21:54.211 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T06:21:54.212 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.237 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T06:21:54.238 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T06:21:54.238 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.278 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T06:21:54.278 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T06:21:54.279 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T06:21:54.279 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.290 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T06:21:54.290 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T06:21:54.290 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.342 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T06:21:54.342 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T06:21:54.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T06:21:54.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-11T06:21:54.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-11T06:21:54.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-11T06:21:54.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-11T06:21:54.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-11T06:21:54.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-11T06:21:54.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-11T06:21:54.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-11T06:21:54.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-11T06:21:54.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-11T06:21:54.355 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T06:21:54.355 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T06:21:54.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-11T06:21:54.425 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:21:54.425 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T06:21:54.666 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:21:54.667 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T06:21:54.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:21:54.744 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T06:21:54.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:21:54.826 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T06:21:54.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:21:54.901 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T06:21:55.032 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:21:55.032 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T06:21:55.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:21:55.119 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T06:21:55.187 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:21:55.187 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T06:21:55.242 INFO:tasks.ceph:Archiving mon data... 2024-09-11T06:21:55.243 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/data/mon.a.tgz 2024-09-11T06:21:55.243 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-11T06:21:55.259 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.26vBvOGY1X 2024-09-11T06:21:55.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.26vBvOGY1X 2024-09-11T06:21:55.444 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.26vBvOGY1X 2024-09-11T06:21:55.527 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.26vBvOGY1X is 525KB 2024-09-11T06:21:55.627 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.26vBvOGY1X 2024-09-11T06:21:55.642 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/data/mon.c.tgz 2024-09-11T06:21:55.643 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-11T06:21:55.697 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.CnZA2gfqxv 2024-09-11T06:21:55.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CnZA2gfqxv 2024-09-11T06:21:55.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.CnZA2gfqxv 2024-09-11T06:21:55.991 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.CnZA2gfqxv is 698KB 2024-09-11T06:21:56.063 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.CnZA2gfqxv 2024-09-11T06:21:56.078 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/data/mon.b.tgz 2024-09-11T06:21:56.078 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-11T06:21:56.097 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.L5ogDYBQXA 2024-09-11T06:21:56.097 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.L5ogDYBQXA 2024-09-11T06:21:56.333 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.L5ogDYBQXA 2024-09-11T06:21:56.419 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.L5ogDYBQXA is 698KB 2024-09-11T06:21:56.492 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.L5ogDYBQXA 2024-09-11T06:21:56.507 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T06:21:56.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T06:21:56.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T06:21:56.589 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T06:21:56.625 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T06:21:56.625 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T06:21:56.626 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/remote/smithi070/crash 2024-09-11T06:21:56.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T06:21:56.653 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/remote/smithi194/crash 2024-09-11T06:21:56.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T06:21:56.688 INFO:tasks.ceph:Compressing logs... 2024-09-11T06:21:56.688 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T06:21:56.698 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T06:21:56.719 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64638.log 2024-09-11T06:21:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33254.log 2024-09-11T06:21:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T06:21:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33043.log 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.33254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33254.log.gz 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33214.log 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.33043.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33043.log.gz 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.33214.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33214.log.gz 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32963.log 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33083.log 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.32963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32963.log.gz 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33003.log 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33123.log 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.33083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33083.log.gz 2024-09-11T06:21:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.33003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33003.log.gz 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.33123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33123.log.gz 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.5.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph.audit.log.gz --verbose 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr: -- /var/log/ceph/ceph-client.admin.33167.log 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.33167.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33167.log.gz 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.b.log: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T06:21:56.770 INFO:teuthology.orchestra.run.smithi194.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51875.log 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64638.log.gz 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61230.log 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61373.log 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51875.log.gz 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61230.log.gz 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64242.log 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76464.log 2024-09-11T06:21:56.837 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61373.log.gz 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65962.log 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64242.log.gz 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75162.log 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76464.log.gz 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76422.log 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65962.log.gz 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37936.log 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75162.log.gz 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65738.log 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76422.log.gz 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37936.log.gz 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37405.log 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75036.log 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65738.log.gz 2024-09-11T06:21:56.838 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72343.log 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37405.log.gz 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75036.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.54094.log 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75036.log.gz 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65457.log 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72343.log.gz 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/objectstore_tool.54094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74868.log 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60317.log 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65457.log.gz 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74868.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.49586.log 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74868.log.gz 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48194.log 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60317.log.gz 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74264.log 2024-09-11T06:21:56.839 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49586.log.gz 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69213.log 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48194.log.gz 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68633.log 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74264.log.gz 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.69213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69213.log.gz 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40021.log 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64159.log 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68633.log.gz 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40021.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.50928.log -- replaced with /var/log/ceph/ceph-client.admin.40021.log.gz 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60672.log 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64159.log.gz 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50928.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.50928.log.gz -5 2024-09-11T06:21:56.840 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75337.log 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60672.log.gz 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51311.log 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75337.log.gz 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63337.log 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51311.log: 95.1% -- replaced with /var/log/ceph/objectstore_tool.54094.log.gz 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51311.log.gz 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52946.log 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77136.log 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63337.log.gz 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67995.log 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52946.log.gz 2024-09-11T06:21:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.77136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76380.log 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77136.log.gz 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38949.log 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67995.log.gz 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76380.log.gz 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37363.log 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38949.log.gz 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76039.log 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64679.log 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37363.log.gz 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38301.log 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76039.log.gz 2024-09-11T06:21:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37965.log 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64679.log.gz 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75558.log 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38301.log.gz 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61699.log 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37965.log.gz 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60971.log 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75558.log.gz 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63380.log 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61699.log.gz 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66225.log 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60971.log.gz 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63380.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63380.log.gz 2024-09-11T06:21:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5/var/log/ceph/ceph-client.admin.66225.log: --verbose -- /var/log/ceph/ceph-client.admin.37629.log 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66225.log.gz 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76254.log 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38948.log 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37629.log.gz 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76254.log.gz 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48527.log 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75120.log 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38948.log.gz 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43325.log 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48527.log.gz 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75120.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.46159.log 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75120.log.gz 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70927.log 2024-09-11T06:21:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43325.log.gz 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/objectstore_tool.46159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40282.log 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70927.log.gz 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.53118.log 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40282.log.gz 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37231.log 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48310.log 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/objectstore_tool.53118.log: /var/log/ceph/ceph-client.admin.37231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37231.log.gz 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68434.log 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41663.log 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48310.log.gz 2024-09-11T06:21:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68434.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.43379.log 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68434.log.gz 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74700.log 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41663.log.gz 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/objectstore_tool.43379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66021.log 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41501.log 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74700.log.gz 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51429.log 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66021.log.gz 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41501.log: /var/log/ceph/ceph-client.admin.53612.log 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41501.log.gz 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51429.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66508.log 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51429.log.gz 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60276.log 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53612.log.gz 2024-09-11T06:21:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66508.log.gz 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77220.log 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60276.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60276.log.gz 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.74658.log 95.0% -- replaced with /var/log/ceph/objectstore_tool.46159.log.gz 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.77220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77220.log.gz 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73739.log 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74658.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74658.log.gz 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.74742.log 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.73739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73739.log.gz 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70470.log 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74742.log.gz 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57619.log 2024-09-11T06:21:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75560.log 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70470.log.gz 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.53118.log.gz 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57619.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57619.log.gz 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60615.log 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.43379.log.gz 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75560.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.75560.log.gz -- 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.37622.log 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69308.log 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60615.log.gz 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37622.log.gz 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75334.log 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.69308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63078.log 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69308.log.gz 2024-09-11T06:21:56.848 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75334.log.gz 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51169.log 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75341.log 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63078.log.gz 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77178.log 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51169.log.gz 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51694.log 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75341.log.gz 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.77178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77178.log.gz 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61575.log 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51694.log.gz 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61998.log 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2024-09-11T06:21:56.849 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61575.log.gz 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75677.log 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51430.log 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61998.log.gz 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75677.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.75342.log 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75677.log.gz 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75680.log 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51430.log.gz 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59994.log 0.0% 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75342.log.gz 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40364.log 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75680.log.gz 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59994.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.59994.log.gz 2024-09-11T06:21:56.850 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75916.log 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52507.log 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40364.log.gz 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75916.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.75916.log.gz 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69793.log 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55302.log 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52507.log.gz 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.69793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69793.log.gz 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37447.log 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74509.log 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55302.log.gz 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37447.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.38275.log -- replaced with /var/log/ceph/ceph-client.admin.37447.log.gz 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74910.log 2024-09-11T06:21:56.851 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74509.log.gz 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38275.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38275.log.gz -5 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51999.log 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74616.log 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74910.log.gz 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51999.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51999.log.gz -5 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75985.log 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38749.log 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74616.log.gz 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75985.log.gz 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64760.log 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.38749.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48662.log 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38749.log.gz 2024-09-11T06:21:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64760.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.64760.log.gz 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52727.log 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5/var/log/ceph/ceph-client.admin.48662.log: --verbose -- /var/log/ceph/ceph-client.admin.63215.log 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48662.log.gz 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52727.log.gz 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68911.log 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38623.log 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63215.log.gz 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69651.log 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68911.log.gz 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76800.log 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38623.log.gz 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.69651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71267.log 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69651.log.gz 2024-09-11T06:21:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71663.log 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76800.log.gz 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63422.log 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71267.log.gz 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49101.log 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71663.log.gz 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63422.log.gz 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75344.log 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72641.log 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49101.log.gz 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75344.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.75344.log.gz --verbose 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/ceph-client.admin.51534.log 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59059.log 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72641.log.gz 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51534.log.gz 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52302.log 2024-09-11T06:21:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59059.log.gz 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52302.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.52302.log.gz 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51066.log 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54528.log 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51066.log.gz 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76674.log 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70649.log 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54528.log.gz 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76674.log.gz 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60814.log 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37620.log 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70649.log.gz 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2024-09-11T06:21:56.855 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60814.log.gz 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37620.log: /var/log/ceph/ceph-client.admin.37944.log 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37620.log.gz 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76632.log 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37623.log 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37944.log.gz 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76632.log.gz 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37623.log.gz 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62478.log 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.42627.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56952.log 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62478.log.gz 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63762.log 2024-09-11T06:21:56.856 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39431.log 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56952.log.gz 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63762.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.63762.log.gz 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57871.log 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39431.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39431.log.gz 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57871.log.gz 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66570.log 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59337.log 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50187.log 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66570.log.gz 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59337.log.gz 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38707.log 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37945.log 2024-09-11T06:21:56.857 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50187.log.gz 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38707.log.gz 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62560.log 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76842.log 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37945.log.gz 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75675.log 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62560.log.gz 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39899.log 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76842.log.gz 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75675.log.gz 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33689.log 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71049.log 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39899.log.gz 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-client.admin.33689.log: 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33689.log.gz 2024-09-11T06:21:56.858 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76506.log 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71049.log.gz 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59851.log 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77010.log 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76506.log.gz 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72085.log 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59851.log.gz 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.77010.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.77010.log.gz 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66610.log 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69255.log 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72085.log.gz 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66610.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.66610.log.gz 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39857.log 2024-09-11T06:21:56.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.69255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50649.log 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69255.log.gz 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41266.log 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39857.log.gz 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50649.log.gz 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41787.log 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74140.log 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41266.log.gz 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48131.log 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41787.log.gz 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62879.log 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74140.log.gz 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72423.log 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48131.log.gz 2024-09-11T06:21:56.860 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72940.log 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62879.log.gz 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77260.log 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72423.log.gz 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49291.log 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72940.log.gz 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.77260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65922.log 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77260.log.gz 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57289.log 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49291.log.gz 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47500.log 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65922.log.gz 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38161.log 2024-09-11T06:21:56.861 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57289.log.gz 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37312.log 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47500.log.gz 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75340.log 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38161.log.gz 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37312.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.70512.log -- replaced with /var/log/ceph/ceph-client.admin.37312.log.gz 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41747.log 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75340.log.gz 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64299.log 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70512.log.gz 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74952.log 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41747.log.gz 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76338.log 2024-09-11T06:21:56.862 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64299.log.gz 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74510.log 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74952.log.gz 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76338.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.76338.log.gz /var/log/ceph/ceph-client.admin.74077.log 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73881.log 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74510.log.gz 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48919.log 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74077.log.gz 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.73881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39657.log 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73881.log.gz 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37938.log 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48919.log.gz 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76296.log 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39657.log.gz 2024-09-11T06:21:56.863 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74784.log 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37938.log.gz 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71703.log 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76296.log.gz 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65518.log 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74784.log.gz 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46120.log 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71703.log.gz 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59754.log 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65518.log.gz 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76968.log 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46120.log.gz 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59754.log.gz 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41404.log 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69573.log 2024-09-11T06:21:56.864 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76968.log.gz 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41404.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-mon.c.log 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41404.log.gz 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.69573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76758.log 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69573.log.gz 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37131.log 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76758.log.gz 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75915.log 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65060.log 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37131.log.gz 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68351.log 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75915.log.gz 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65060.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.65060.log.gz 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64501.log 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57930.log 2024-09-11T06:21:56.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68351.log.gz 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64501.log.gz 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75984.log 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69111.log 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57930.log.gz 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65019.log 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75984.log.gz 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.69111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69111.log.gz 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76884.log 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37917.log 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65019.log.gz 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61679.log 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76884.log.gz 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64058.log 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37917.log.gz 2024-09-11T06:21:56.866 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67517.log 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61679.log.gz 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64058.log.gz 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75078.log 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68775.log 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67517.log.gz 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59296.log 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75078.log.gz 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73124.log 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68775.log.gz 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71586.log 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59296.log.gz 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.73124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73124.log.gz 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62354.log 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66697.log 2024-09-11T06:21:56.867 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71586.log.gz 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37627.log 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62354.log.gz 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67355.log 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66697.log.gz 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76548.log 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37627.log.gz 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70073.log 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67355.log.gz 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72024.log 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76548.log.gz 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41705.log 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70073.log.gz 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72024.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.56088.log 0.0% 2024-09-11T06:21:56.868 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72024.log.gz 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62436.log 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41705.log.gz 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/objectstore_tool.56088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47556.log 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62436.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62436.log.gz 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.72920.log 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47556.log.gz 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67695.log 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72920.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72920.log.gz 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50968.log 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67695.log.gz 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68993.log 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50968.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50968.log.gz 2024-09-11T06:21:56.869 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68993.log.gz 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46929.log 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37626.log 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46929.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46929.log.gz 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62237.log 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37626.log.gz 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59631.log 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62237.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62237.log.gz 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61617.log 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59631.log.gz 2024-09-11T06:21:56.870 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47122.log 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61617.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61617.log.gz 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47792.log 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47122.log.gz 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48010.log 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47792.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47792.log.gz 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62518.log 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48010.log.gz 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74406.log 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.56088.log.gz 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62518.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57575.log 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62518.log.gz 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63560.log 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74406.log.gz 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66406.log 2024-09-11T06:21:56.871 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57575.log.gz 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.63560.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65737.log 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63560.log.gz 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66406.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66406.log.gz 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/ceph-client.admin.70331.log 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65737.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.65737.log.gz -5 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67178.log 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40119.log 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70331.log.gz 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76926.log 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67178.log.gz 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55342.log 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40119.log.gz 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76212.log 2024-09-11T06:21:56.872 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76926.log.gz 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37937.log 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55342.log.gz 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76212.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76212.log.gz 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51895.log 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37937.log.gz 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73343.log 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52137.log 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51895.log.gz 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.73343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52527.log 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73343.log.gz 2024-09-11T06:21:56.873 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66083.log 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52137.log: /var/log/ceph/ceph-client.admin.52527.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39919.log 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52137.log.gz 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52527.log.gz 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53003.log 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66083.log.gz 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39451.log 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39919.log.gz 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33294.log 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53003.log: /var/log/ceph/ceph-client.admin.39451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65374.log 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53003.log.gz 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33294.log.gz 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39332.log 2024-09-11T06:21:56.874 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61290.log 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65374.log: /var/log/ceph/ceph-client.admin.39332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65374.log.gz 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39332.log.gz 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38539.log 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67955.log 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61290.log.gz 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75335.log 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38539.log: /var/log/ceph/ceph-client.admin.67955.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38539.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67955.log.gz 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75335.log.gz 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40844.log 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67136.log 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40707.log 2024-09-11T06:21:56.875 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40844.log.gz 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67136.log.gz 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74574.log 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40707.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75343.log 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70032.log 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75343.log: /var/log/ceph/ceph-client.admin.74574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74574.log.gz 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75343.log.gz 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40963.log 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70851.log 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70032.log.gz 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40963.log.gz 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59017.log 2024-09-11T06:21:56.876 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38497.log 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59017.log: /var/log/ceph/ceph-client.admin.70851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70851.log.gz 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59017.log.gz 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38497.log: /var/log/ceph/ceph.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38497.log.gz 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52424.log 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49507.log 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52424.log.gz 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47224.log 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49507.log.gz 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66630.log 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47224.log.gz 2024-09-11T06:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72322.log 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56528.log 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66630.log.gz 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72322.log: 0.0%gzip -5 --verbose -- /var/log/ceph/objectstore_tool.45166.log 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72322.log.gz 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37287.log 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56528.log.gz 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/objectstore_tool.45166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38281.log 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37287.log.gz 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41205.log 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38281.log.gz 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74197.log 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41205.log.gz 2024-09-11T06:21:56.878 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59535.log 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74197.log.gz 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42695.log 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59535.log.gz 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61453.log 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42695.log.gz 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40468.log 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61453.log.gz 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38279.log 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40468.log.gz 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73662.log 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38279.log.gz 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr: 95.0%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27459.log 2024-09-11T06:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/objectstore_tool.45166.log.gz 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66103.log 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.tmp-client.admin.27459.log: /var/log/ceph/ceph-client.admin.73662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73662.log.gz 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27459.log.gz 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67765.log 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75987.log 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66103.log.gz 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67765.log.gz 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42185.log 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75987.log.gz 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.44261.log 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42185.log.gz 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77094.log 2024-09-11T06:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43591.log 2024-09-11T06:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/objectstore_tool.44261.log: /var/log/ceph/ceph-client.admin.77094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77094.log.gz 2024-09-11T06:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.44261.log.gz 2024-09-11T06:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63214.log 2024-09-11T06:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.55091.log 2024-09-11T06:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43591.log.gz 2024-09-11T06:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63214.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65277.log 2024-09-11T06:21:56.881 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.907 INFO:teuthology.orchestra.run.smithi194.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/objectstore_tool.55091.log: 95.0% -- replaced with /var/log/ceph/objectstore_tool.55091.log.gz 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63819.log 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51959.log 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65277.log.gz 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63819.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42504.log 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51959.log.gz 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42566.log 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75678.log 2024-09-11T06:21:56.910 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42504.log.gz 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42566.log.gz 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67574.log 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75678.log.gz 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72524.log 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39210.log 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67574.log.gz 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72524.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71287.log 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39210.log.gz 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51695.log 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71287.log.gz 2024-09-11T06:21:56.911 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51695.log.gz 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65519.log 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47678.log 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59911.log 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65519.log.gz 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47678.log.gz 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76716.log 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59911.log.gz 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38280.log 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75679.log 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76716.log.gz 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38280.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38280.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.49229.log 2024-09-11T06:21:56.912 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75679.log.gz 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40886.log 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75876.log 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49229.log.gz 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40886.log.gz 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61053.log 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75876.log.gz 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74994.log 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61053.log.gz 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74994.log.gz 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66957.log 2024-09-11T06:21:56.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60097.log 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62055.log 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66957.log.gz 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60097.log.gz 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39759.log 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38864.log 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62055.log.gz 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39759.log.gz 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57152.log 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38951.log 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.38864.log: /var/log/ceph/ceph-client.admin.57152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57152.log.gz 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.0.38864.log.gz 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60076.log 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77052.log 2024-09-11T06:21:56.914 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38951.log.gz 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60076.log.gz 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38276.log 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.77052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77052.log.gz 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43046.log 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66304.log 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38276.log.gz 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43046.log.gz 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76590.log 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66304.log.gz 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71807.log 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39372.log 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.76590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76590.log.gz 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.71807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71807.log.gz 2024-09-11T06:21:56.915 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73383.log 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39372.log.gz 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67092.log 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68254.log 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.73383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73383.log.gz 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67092.log.gz 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62859.log 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42909.log 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68254.log.gz 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62859.log.gz 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69693.log 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68393.log 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42909.log.gz 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.69693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69693.log.gz 2024-09-11T06:21:56.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66894.log 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.68393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68393.log.gz 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74826.log 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57247.log 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66894.log: /var/log/ceph/ceph-client.admin.74826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66894.log.gz 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74826.log.gz 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52364.log 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70311.log 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57247.log.gz 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52364.log.gz 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33596.log 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44575.log 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.70311.log: /var/log/ceph/ceph-client.admin.33596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70311.log.gz 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33596.log.gz 2024-09-11T06:21:56.917 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74426.log 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63879.log 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44575.log.gz 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.74426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74426.log.gz 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58436.log 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63879.log.gz 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37618.log 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58436.log.gz 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40406.log 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37618.log.gz 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51352.log 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50830.log 2024-09-11T06:21:56.918 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40406.log.gz 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51352.log.gz 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72863.log 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40467.log 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50830.log.gz 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.72863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72863.log.gz 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52667.log 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54056.log 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40467.log: /var/log/ceph/ceph-client.admin.52667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40467.log.gz 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52667.log.gz 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73042.log 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54056.log.gz 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.73042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73042.log.gz 2024-09-11T06:21:56.919 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76038.log 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37939.log 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.76038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76038.log.gz 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61475.log 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37939.log.gz 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61475.log.gz 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75672.log 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38811.log 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.75672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75672.log.gz 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38581.log 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38811.log.gz 2024-09-11T06:21:56.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38581.log.gz 2024-09-11T06:21:56.921 INFO:teuthology.orchestra.run.smithi070.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T06:21:56.978 INFO:teuthology.orchestra.run.smithi070.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T06:21:57.153 INFO:teuthology.orchestra.run.smithi070.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T06:21:57.429 INFO:teuthology.orchestra.run.smithi194.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T06:21:59.349 INFO:teuthology.orchestra.run.smithi194.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T06:21:59.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-11T06:21:59.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-11T06:21:59.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-11T06:21:59.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-11T06:21:59.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-11T06:21:59.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-11T06:21:59.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-11T06:21:59.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-11T06:21:59.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-11T06:21:59.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-11T06:21:59.946 INFO:teuthology.orchestra.run.smithi070.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T06:22:00.477 INFO:teuthology.orchestra.run.smithi070.stderr: 96.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T06:22:00.835 INFO:teuthology.orchestra.run.smithi194.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T06:22:00.919 INFO:teuthology.orchestra.run.smithi070.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T06:22:01.274 INFO:teuthology.orchestra.run.smithi194.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T06:22:01.276 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-11T06:22:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m4.529s 2024-09-11T06:22:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m11.523s 2024-09-11T06:22:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m0.489s 2024-09-11T06:22:02.774 INFO:teuthology.orchestra.run.smithi070.stderr: 96.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T06:22:02.776 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-11T06:22:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m6.066s 2024-09-11T06:22:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m17.110s 2024-09-11T06:22:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.874s 2024-09-11T06:22:02.777 INFO:tasks.ceph:Archiving logs... 2024-09-11T06:22:02.777 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/remote/smithi070/log 2024-09-11T06:22:02.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T06:22:05.097 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/remote/smithi194/log 2024-09-11T06:22:05.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T06:22:06.523 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T06:22:06.533 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T06:22:06.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T06:22:06.536 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T06:22:06.622 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T06:22:06.632 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T06:22:06.633 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T06:22:06.635 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T06:22:06.649 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-11T06:22:06.652 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-11T06:22:06.654 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T06:22:06.654 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-11T06:22:06.654 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +557us[ +534us] +/- 52ms 2024-09-11T06:22:06.654 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -409us[ -432us] +/- 58ms 2024-09-11T06:22:06.654 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -308us[ -308us] +/- 72ms 2024-09-11T06:22:06.654 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:22:06.657 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T06:22:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-11T06:22:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +571us[ +549us] +/- 52ms 2024-09-11T06:22:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 117 -383us[ -436us] +/- 57ms 2024-09-11T06:22:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -166us[ -166us] +/- 72ms 2024-09-11T06:22:06.658 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T06:22:06.659 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T06:22:06.669 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T06:22:06.669 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T06:22:06.679 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T06:22:06.832 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T06:22:06.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T06:22:06.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:22:06.947 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T06:22:06.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:22:06.978 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T06:22:06.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T06:22:06.998 INFO:teuthology.task.internal:Duration was 739.699135 seconds 2024-09-11T06:22:06.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T06:22:07.008 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T06:22:07.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T06:22:07.011 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T06:22:07.048 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T06:22:07.059 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T06:22:07.340 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T06:22:07.341 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-11T06:22:07.341 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T06:22:07.402 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-11T06:22:07.402 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T06:22:07.426 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T06:22:07.426 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T06:22:07.444 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T06:22:07.493 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T06:22:07.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T06:22:07.511 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T06:22:07.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T06:22:07.674 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T06:22:07.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T06:22:07.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T06:22:07.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T06:22:07.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T06:22:07.741 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T06:22:07.762 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-11T06:22:07.788 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-11T06:22:07.811 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T06:22:07.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:22:07.837 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T06:22:07.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:22:07.865 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T06:22:07.875 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T06:22:07.876 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/remote/smithi070 2024-09-11T06:22:07.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T06:22:07.919 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900606/remote/smithi194 2024-09-11T06:22:07.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T06:22:07.953 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T06:22:07.953 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T06:22:07.955 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T06:22:08.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T06:22:08.014 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T06:22:08.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T06:22:08.025 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T06:22:08.025 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T06:22:08.027 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T06:22:08.040 INFO:teuthology.orchestra.run.smithi070.stdout: 265563 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 06:22 /home/ubuntu/cephtest 2024-09-11T06:22:08.057 INFO:teuthology.orchestra.run.smithi194.stdout: 265934 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 06:22 /home/ubuntu/cephtest 2024-09-11T06:22:08.058 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T06:22:08.069 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T06:22:08.093 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} duration: 739.6991350650787 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T06:22:08.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T06:22:08.169 INFO:teuthology.run:pass